Should a dead beat Dad be allowed to talk to his kids?

I was married for 6.5 years. We had two kids, who are now 6 and 7. He cheated on me with another woman, and after many times of trying I finally got a back bone and told him where to go.

Now fast forward two years. He’s barely had contact with his two kids. He’s also a master controller, manipulator, and an abuser. Emotionally, physically and mentally.

My sister tells me that he should be able to talk to his kids. That I will look like the “bad guy” if I don’t let him have contact.

I am afraid that it will hurt my kids more in the long run if they talk to him. He only tried calling when it suited him. Making promises that he can’t keep, like telling my 7 year old daughter that she can come live with Daddy when she’s older. When I try and tell him he simply can’t make any promises, he literally tells me off.

Am I doing the right thing by not letting him talk to them? After all I am the one that picks up the pieces when Daddy is done with his whim. Am I wrong in wishing he would just disappear off the face of the earth and leave us alone? It would suit me just fine…but am I doing the right thing by my kids?

He’s barely had contact in the last two years with them. 2 years is a heck of a long time in a 7 and 6 year olds life.

What’s the right thing to do? BTW, he lives on the east coast in the US…and we live on the west coast in Canada.