Will going out with someone who goes out drinking a few times a week work out?

I’ve been asked out by a lot of guys recently, almost all of them a main part of their lives is going out drinking with friends. Now I never go out drinking and I think I’ll be slightly ostracised if I started going out with these people. Almost all of their socialising is done when out drinking with friends.
It looks like most of them only really go to college or work then go out drinking a few times a week. Do you think this will cause strain within a relationship, them going out drinking a few times a week and me not?