Custody Question.

Okay so I went to court to finalize my divorce and custody on November 2nd. I was awarded Sole Legal Custody but he still got visitation every other weekend. Well he is aware of this and we talked about when his weekends would be started and what holidays he had and everything. Since the court date he has not gotten them for any of his weekends and hasn’t contacted me. Is there anyway I can go back to court and have his rights and/or visitation taken away? Or do I have to wait longer? Or is this even possible?