Should I move on?

Me and my “boyfriend” have been together for 2 years. We live together and everything. We have had a very hard 2 years. My divorce and custody battle. And he has went through 2 custody battles. His mother and I used to be very close then all of a sudden she just stopped talking to me. He has now bought a new home and is fixing it up but still living with me while he does this. He said he is unsure if we can fix everything and he cant forget about the last 2 years. But like I said we had a lot of stress on us. Now that we are through all that stress, he doesn’t know. I even went as far as calling his mother and recording our conversation so he can hear how she speaks to me. I haven’t let him listen to it yet because I do not want to start anything. But I do want to keep him. Please tell me what to do. I do love this man with all my heart and his kids and mine would be devastated as would I if we truly split up.