Kelly Brook's ex stopped her from going to a party thrown by Diddy: 'He was looking out for me...'