Should I let the guy go?

So I met this guy on vacation and he seem like a really calm person and chill. Unfortunately, during the stay of my vacation I didn’t get to hang out with him as much since I was always scheduled for different activities and all.

He ended up telling me he was interested in me, I didn’t notice until I reread the texts he sent me. I thought he was interested in my friend. My question is should I let him go and not try to fix things.

We had two conflicts about trust. He gets mad when I say things like you can’t trust people right away. He wants me to trust him but it’s only been 3 weeks I’ve known him.

The first time it happened I went after him to explain myself then everything was cool. Then the other day I said not everyone can be trusted and he got mad again and he didn’t answer after that.

Should I text him again or let it go? The reason why I wouldn’t it’s because I already did it once and I don’t want to seem like I’m running after him. I don’t understand how it’s only been 3 weeks and I already feel something(bad feeling in the stomach) whenever things are kinda tense. Why is he getting offended when I say this?

If you don’t understand something let me know! Thank you.