Is it bad to exercise sore muscles?

I went to kickboxing class 2 days ago, some of my muscles are still sore from it. Today I wanted to go to my weight lifting class but wasn’t sure if I’d be able to manage. The front my thighs are probably the sorest, and in the weight class we do squats and such. So I’m not sure if that’ll worsen things or be overly strenuous for me.