Why is it when ever I look bad, that's when guys seem to notice me?

Ladies, I’m not sure if you have this issue, but my friend and I were discussing it earlier. For some reason whenever we are looking our worst, wearing sweatpants, no make-up, and our hair is atrocious that is when guys decide to talk to us.
Men, Is this some weird phenomenon? Can you sense that we don’t look our best and like it? Or is this just something my friend and I encounter?