My partner and I are both infected with HPV. Are we going to live normal lives? Should we be bothered?

I found out that I have HPV. I do not know who infected who but we do not really know what to make of it. I mean, we’ve been together for six years, planning to get married, and have kids. I do not know which one of us had it first. Maybe he did, but he has stronger immune system than I do so I developed warts. After the warts have disappeared, and not that we both know we have HPV and there is nothing we can do about it, what now? I understand we have to keep our immune systems strong, and that I need to get an anti-hvp shot and to totally get rid of my warts, and I understand there is nothing really a male can do about it… but then what? Should we stop enjoying sex? Should we limit sex? Should we deeply be bothered and worry about it the whole time? I really do not know what to do about it.