A guy I didn't date dumped me?

I thought I had made a good friend in college (I don’t have many there), but I quickly changed my mind. He was clearly interested in me, and so I decided to back off a little bit. Instead of sitting next to him in class, I sited with other two guys. The problem is, out of nowhere, he came to me telling that we were not a match and we couldn’t date (I had left pretty clear that I didn’t want a boyfriend – I said these exact words to him). It’s been two days since that happen and he keeps coming to me like nothing happened. What is bothering is that I never showed interest in him and he had the nerve to ’‘dump’’ me?! How would you react if one of your friends did this to you out of nowhere?
PS: In one of our last conversations before this happened, he kept asking me if I wanted I boyfriend, if I was in love and telling that he was very likely in love with someone (me). I told him in that conversation that I didn’t want a boyfriend and quickly change the topic. He was making me uncomfortable.