Friend help...

I’m really tired of my friend , kind of in a way controlling me, I mean he’s not always like that, just occasionally. For example sometimes well get along real fine and everythings alrght but most of the time when I don’t wanna do something he wants to do he gets all defensive and angry by saying “well why not?” like it’s my fault I can’t always think the same way he does, it’s like he puts this whole guilt trip on me… Im finding it really hard to stand up for myself.. What do I do?... I feel I’m like the submissive woman in the movie “the secretary” (if that helps sum up what I’m feeling.)