Does touching hair detached from a living person bother you. If so, why?

I noticed that running your fingers through someones hair is considered sexy when it is actually attached to the person. People seem to find hair gross once it has fallen out.

Any thoughts on this. Can I be the only person to notice this?