Is this a bad sign?

I’ve known this guy for five years. We’ve never communicated that much until this summer. We flirted a lot and I told him I liked him and the signals he gave me seemed like he liked me too. We were trying to find a time to hang out and he said he was going shopping and asked if I’d want to go. I already had plans to go to the county fair, so I asked him if he thought he’d like to come with me. He said no, and that he hated that fair. The day before the fair I got a text from him saying he was going to the fair. I met him there. He introduced me to his mom and she knew information about me, so he must have been talking to her about me. His friends were there with their girlfriends, and he used the word girlfriend several times. I texted him the next morning asking if he had fun and then I asked who his friends were because he didn’t introduce us. He then asked me if I thought they were cute and why I was hiding it from him. He said it was because they didn’t mean that much to him, and even went as far to call his “friend” a d***. I really like him, but I’m afraid his insecurity could turn physical eventually. Suggestions?