"No one will have fun if you're there"

My boyfriend of almost five years wanted to go to a friend's house, where a ton of girls would be. I asked to go with him. 

He said, "No one will have fun if you're there." 

It still stings thinking about it. 

I found out later that he was cheating with one of the girls. No wonder no one would have had fun.