What is my boyfriend allergic to in lipstick?

For some reason every time I wear lipstick or chapstick and I kiss my boyfriend his lips swell. I know that means he is allergic so I stopped wearing it. But, is there a lipstick, chapstick, or ingredient in those that I can watch out for so I can wear lipstick again?