Have you ever been on the outside looking in?

This may be a loaded question for many people. You made a major mistake with your s/o and someone took your place? You could only see him or her from a distance and hate the position that you are in? This question may also apply to your lost job or any condition that fits your situation in the past. So, question: have you ever been on the outside looking in? What were your feelings?