How much does it annoy you when someone doesn't get your humor?

you make a clever joke and everyone but one person laughs.And tat one person either looks confused or irritated because they just don’t GET it!Its like you want to smack them in the head and tell them to lighten the hell up!