I married young due to pregnancy and have met someone else. What should I do?

I got married when I was 17 years old due to pregnancy. He is not social and always talks to me rudely. He also misbehaves in public. Now I am 37 and nothing has changed. I met a guy three years ago and we fell in love with each other. He is 25 years old now. We want to get married, but my husband will not give me a divorce since it will bring shame to him and his extended family. I have two kids, and 18 year old boy and a 13 year old girl. What should I do?