Could my usb flash drive be harmful to someone else's pc?

Someone didn’t want me using my usb flash drive in their pc because I have access to the internet. They belive that I could have picked something up on my drive from the internet and may transfer it to their pc. Is this a fact? Could I pick up something harmful and hurt their pc, but not mine?

Oh, I am new to the 21st century – welcome me.