Can a device designed to plug into a USB port also plug into a serial or parallel port?

I’m only just learning what all these ports are and what the difference is between them. When I get this question answered, the hope is that I’ll get the difference between one port and the other a bit better.
I know already that with a USB port you can pretty much plug in anything that used to require a parallel or serial port to be plugged in (right?), but can it ever work the other way around?
Sorry if the answer to this question seems infuriatingly obvious to anyone.