Is it safe to wish a woman Happy Mother's day? [see details].

How do women feel about it if they are not a mother. Sure we all had a mother, but for some of us, she has passed away. Does saying happy Mother’s Day risk calling up unpleasant memories. Is it only safe to say when you know the woman in question is currently a mom?