Should I move on from this guy I've been dating long-distance for almost a year?

I am really at a loss here. I am a 34 year old single mother of a 5 & 6 year old and started dating a 41 year old man who is a single father of a 15 year old last August. It has been a long-distance relationship and I wasn’t looking for any relationship. We’re both very cautious of who we allow into our childrens’ lives. I’ve flown to see him a few weekends and we just went away for six days. Other than that we have spent many, and I mean many, waking hours on the phone. Finally we both told each other about where we think this relationship could go, and found out that we were both imagining a future together. One of us (probably me & my children) moving. I have met his daughter and his mother.
Last month I started to sense him being a little distant, but it didn’t seem to have anything to do with me. When we went away we drove for ten hours with his daughter and dropped her off at her grandparents’ house. Then we went on our 6 day trip that we have been excited about for months. He kissed me one time, but other than showed little to no affection which is a vast change from how things have been previously. We slept in the same bed, but two feet apart, never held hands. Nothing. We did have a good time spending time together at the music festival. He gave me a few reasons for his distance which made sense one moment and made me more confused the next.
1— When I asked him about it he said that he feels distant from everyone right now.
2— We are both very intense (sexually) and he wouldn’t want to “just go through the motions”.
3— This is me caring about you.
4— There isn’t anyone else. ( we agreed to tell each other if we met someone else)
I told him that I love him, and he told me that he thought that I ran from 1st to 3rd over the pitchers mound. After thinking about it I understand, and kind of agree. I don’t think I did anything egregiously wrong, but it was too soon for him then I get that. He did say that it’s not that he doesn’t have feelings like that, but that he really likes dating. So now I am giving him space. He doesn’t call me the way he used too, and I am not calling him even though I want too. I feel sick. Can’t eat. I’m miserable because I do care about him but will move on if I need too. I refuse to allow myself to wallow though. My kids need me to be positive. He’s had some crazy stalker girls in the past and I am not “that girl”. I just want some more clarity. I started taking belly dancing classes and walking at lunch with a friend. I know these feelings will pass. It’s just not clear what happened. He’s been planning on coming up to visit family and see me in August and we were talking about going on a cruise in October. I don’t know what to think?
Do you think I should move on? Talk to him about it? Ask him if we’re still dating or if we’re done in his eyes. It makes me nervous that he got distant, and that if this blows over he will just do it again.