What if the actions of man, caused global cooling?

People are all a buzz over global warming, but what if there were things man did that caused the Earth to get cooler and cooler. Would people care as much or worry more? Would it be how fast the cooling took place? If the summers never got hotter than 72deg and was getting slowly cooler would anyone be complaining as much as global warming?