ATTN: Male jellies- I need advice on this dating predicament?

So I’ve been out on a few dates with this guy I used to work with and we’ve been texting pretty regularly. He’s a nearly perfect match to my personality and I’m really excited about the possibilities. I’m just very concerned that my general dislike of physical contact is going to turn him away. I know it’s weird, but I do not like hugs or any emotional/romantic physical contact. I’m not completely opposed to it, but I need to be in control of the situation and be the one initiating such contact, which can take awhile for me to build up the trust and courage to do so. I’ve explained this to him and he seems understanding, but I want to know what you think. How long would you deal with such circumstances? Is this something that can harm my chances of a relationship here?