Have you ever been told you're to good for someone by that person?

i.e. you’re in a relationship, and the person says to you “you’re too good for me”
Now This has happened to me 3 times now, the first 2 resulting in nothing as I told them I didn’t care whether they we’re or not, even though I thought they were, and the third time resulted in the person saying “I should never speak to you again, I want you to forget about me, so you’ll never have to worry about me again.
I’m wanting to know if, anyone else has had this, if they’ve experienced it as many times as I have, and if it pisses you off as much as it does me!!! (I mean, it’s sorta flattering but “Can’t I just like you please!?!?”)