Anybody have experience with or know anything about sulfa drug allergies?

I was prescribed a 16 day course of a high dose of bactrim, a sulfa antibiotic. Around day 12 I started having neck pain and a low-grade fever. I finished the course yesterday.

Neck pain and fever are symptoms of sulfa drug allergy, and onset of symptoms is said to occur within 1–2 weeks of starting the drug. But I just saw my doctor and he thinks, because I don’t have a rash, that this couldn’t be an allergic reaction. I’m not so convinced. He doesn’t think it’s anything to worry about.

What do you think?