How do you break up with someone you're not really in a relationship with?

Yeah, this is the second break-up question from me today. Please bear with me.

I’ll try to keep this as short at possible.
See, I’ve been seeing this guy for some months. We’ve never really had the conversation, so we’ve never discussed what we are. I guess we’ve kind of been leading up to a relationship, or at least he has thought that, I think, but I was never really sure about what I wanted. I know now, though, that I want to end it.
I just don’t know how to. I can’t really break up, since we’re not officially anything. We have some of the same friends, I really like him as a person and I’m afraid everything will be so awkward. I don’t want to hurt him. I’m bad a confrontations.
I guess I’m just looking for some advice here.

Peace.