Why is there such high stigma around recreational drone flying?

So I just bought the new DJI Mavic Pro, a roughly $1,000 drone. I’ve been slightly weary in regards to flying it because of the stigma and overall disgust a lot of people have about drones. All I’m doing, along with most drone pilots, is trying to fly this cool copter and get some nice landscape and scenic photos/videos. As far as spying on people it would be very impractical considering that it can be heard hovering 200ft in the air. Also, it has one of the longest battery lives of any drone and it can only fly for 20mins tops. So I don’t understand why I can’t peacefully fly my expensive drone legally over a neighborhood without worrying that someone will use it for target practice.