Are color contacts bad for you?

I really want to get color ocntacts becuase my eye color is just a boring dark brown like everyone else, but im not sure if it would be bad for me becuase without my contacts/glasses i can’t see a thing. one of my eye doctors told me that it wouldn’t be a good idea since my eye sight is already bad enough.