Would there be any negative impacts of taking down the concept of free will?

It appears that most people already have some real sense that much of our beliefs, desires, and urges are not something that we chose. Take, for example, how many we view the concept of sexuality. We flat out reject conservative notions that homosexuality is a choice. And in many ways we do the same thing regarding much of our behavior and desires. But what if we were to ask people to consider all of these things together and at the same time?

What if we were to ask people when they chose their parents, the way they were parented, their genes, the country they were born, the time period, their height, their physical strengths and weaknesses, their illnesses, their likes and dislikes, who they were attracted to and not attracted to, what made them angry or happy or sad, etc?

Would this help us in the way that asking when we chose to be straight does? Could it help us be more empathetic? Would it help us re-evaluate the concepts of pride and blame?

And to bring it back to the original question – what could be the possible negatives? Would there be any?