What to do about my crazy mixed-up love story?

Alright, so here’s the deal. I’m crazy about this guy. Never felt this way about anyone ever before. And..never before has anyone felt this way about me.
Here’s the catch: He lives half-way across the world. I’ll keep the location private for the sake of anonymity, but there’s no way to see eachother more than the summer/winter vacation I take there. Moreover, there are tons of obstacles that keep us from talking regularly while I’m here and he’s over there.
Because of this, it’s sorta complicated. We’re not together, officially, but at the same time, neither one of us is seeing other people or anything.
Lot’s of people are telling me I’m stupid for holding out—I’m embarassed by them, but my feelings remain unchanged.
Should I forget about him?