Why is my TV sound system buzzing?

I checked online and it seems the problem might be a ground loop.

The buzzing stops when I disconnect my CD player from the mains but it returns as soon as I plug it back in even if the mains socket isn’t switched on.

This problem happened quite suddenly. Can anyone explain it in non technical terms and suggest a solution?