Mold in caulking around the shower?

I have a small amount of mold in the clear caulking around the base of my shower. Tried all kinds of cleans with toothbrush but it’s still there. Do I have to take the whole darn glass shower doors off to put in new caulking or is there something I can use/do to get rid of this problem? Any help out there?