Kim Kardashian's Ex Ray J Says He Grew 'Loud' and 'Aggressive' with Diddy's Sons — Before Chris Brown Stopped Fight Outside Club