I am having some problems with my record player.

So I just bought a few more records to add to my collection, and I find a large chunk of my records which are in mint condition do this thing where when the needle gets closer to the record’s label in the center the hi’s start to sound very distorted, its not my needle because the player I’m using is only a few months old, I’m using just a stardard stereo system with two speakers and no subwoofer, it was made to play CD’s not records so that could be why, I did plug my player into my guitar amp and it did not have the ssame scraatchieness to it. So whats going on?