If the government can regulate religious practice such as polygamy, logically could they not regulate other religious practice and dress also?

It is a federal crime to have more than one wife or husband, ridiculous as that is if marriage equality is the thing, even if that is part of your religious worship or cultural normality. What would keep the government from somehow skirting the Constitution and preventing people from wearing Kippa, hijab, kofia, kufi, Turban, burqa, abaya, etc, or practicing other aspects of their religion as to prayer, etc? Why is the Constitution for freedom of worship is only yanked from under the feet of polygamist?