Would you want to live in a society where nobody cared about what anyone else thought about them?

I often come across advice like: “don’t worry about what other people think”, “just do your own thing”, “march to your own drum”, etc. and I’m curious how generalizable the advice is or how good it is for society.