What should I do about this long distance relationship?

A guy I had been involved with (never officially dated) moved but before he left he expressed he loved me, and I felt he did when we were together because he was always there for me and took care of me. I did not look at him that way at first but over time my feelings grew.

We still talk/text each other on the phone but lately I have been feeling frustrated. Before we separated our ways we did make it clear we could see other people during this time. I said maybe we can discuss dating long distance if we still feel the same within a year.

However I find it hard because I feel like the way we keep in touch “I miss you” and “can’t wait to see you” etc makes me feel I would be betraying him if I saw other guys. What do you think I should do? I don’t want to hurt his feelings but at the same time I do care about him and am not sure if I am even interested in other guys. He is very quiet so he does not express what he wants, I think he doesn’t know what to do about the situation. He always says “Whatever you want” or “I just want you to be happy.”