What should my next step be?

Ok many of you probably remember me asking about my husband talking to an ex sex buddy turned friend and if it was normal to be upset about it like I was or if I should just blow it off. Well we agreed to go to counseling, I let him know how upset I was about the whole talking to a woman at work at night and let him know that was stepping over the line to me in our marriage. Well since then he has talked to her almost everytime he has been to work, they had made plans to go to breakfast together and he asked if I wanted to go after he already told her it was ok, he sees no wrong in talking to this girl because he says he has no feelings for her and never has that it was just sex. My big concern is he must feel something for her if him talking to her is more important than my feelings and if he had sex with her once and didnt have feelings and he still doesnt have feelings who is to say he wont do it again? Im not sure what to do or where to go from here if he doesnt respect our relationship or even see anything he is doing wrong. Im at a loss anyone please.