What's your opinion on the premise of not hanging out with a good friend of the opposite sex (or someone you like more than a friend) because you like them too much?

This isn’t about me, either. I was just thinking about it and what one should do in this situation. You always see it on T.V. and stuff and it had me pondering. Is it selfish and rude, or is the emotional torture too much to handle?