Why won't he make any physical contact at all?

For those who don’t know: I met a guy through a mutual friend at my birthday party. He was flirtatious and put his hand around my waist and seemed very confident.

We have been talking every night for three weeks. He’d call me every night and even when we’re both out on weekends he’d make an effort to call. We only hung out 4 times and out of the 4 only ONCE we’ve been alone. He’d make plans with me each weekend but it’d always end up being our friends instead of us being alone.

He knows I just got out of a 5 year relationship a month ago. My friend told him. I didn’t bring it up to the guy and he didn’t ask me about my past relationship so I don’t know. I’m thinking maybe he’s going slow because of that?

He doesn’t touch me at all though. Not even playfully…and not even a hand around the waist when talking (subtly) like at the party! But he does hug me before we part each time.