Would you have trees removed just because they are close your house?

I have a big oak that is shedding limbs and needs to come down. That one I will get done. My tree guy quoted for several and it will save me $800 if I go ahead and have him take one down close to the house now rather than call him out again later should I need to. I love the tree and it’s healthy. If it fell on the house though it would be demolished and could possibly crush my wife and I while we sleep. People have huge trees here in their yards and it’s rare to see them fall on houses. I’m having a hard time deciding this one, what would you do here?