Removing adhesive from bathing suit liner?

I bought a new bathing suit and it had that adhesive removeable pantyliner that women’s bathing suits often have. I removed it but it left a sticky residue. I tried washing the bathing suit – first by hand and then in the washing machine – but the stickiness is still there. I’d really like to wear my new bathing suit but am not sure how to get rid of that gunk without ruining the bathing suit (I try to avoid using harsh soaps or anything like that on bathing suits). Advice?