Is the term "straight" derogatory?

In reference to a person who is not homosexual, is saying that one is “straight” a derogatory or offensive means of (not) classifying homosexual people? A professional used the term today, making me wonder where the word’s origin is. I’m not meaning to offend, just wondering.