Would you say "I'll leave it, thanks." is an okay reply to my brother in a family group chat of seven people?

It was a reply to my brother in a family group chat of seven people, after he asked us if we all would like to meet up at my brother’s house when he is home from abroad – which is quite out of the way to get to instead of the family home? My brother explained in the group chat that there probably won’t be enough room for everybody – but he’s putting it out there anyway to see who would like to visit. No prob if we can’t, he said.