My 'friend' is singling me out as a jerk?

Excuse my French, but I don’t really know how to put it another way:

Whenever my friends joke around and laugh around him (not even about him), it’s fine, but if I laugh or joke around, he assumes I’m being a d*ck. And then he yells at me and I always tell him to stop freaking out and take a joke once in a while and “everyone else laughed too, why are you singling me out?”. And I’ve talked to him about it many times. It’s never out of context, so I’m not bringing it up out of no where. Last time I talked to him about it, he seemed to think it was 110% my bad. My friends agree that he’s the one being a d*ck, not me.
He’s always an asshole to me for no reason (unless I’m missing something). Always telling me to shut up, go away, excluding me, and again singling me out as an asshole whenever other people are doing the same thing (I’m not influenced by the other people, I’m just being me).

I really don’t know what to do. It’s been like this for about a year on and off. And it’s not like I can just ignore him, because we have the same friends and I’m not willing to give up all my friends just to leave one bad one.