Do we hear sounds differently from each other?

Food doesn’t taste exactly the same to everyone. We also don’t view beauty the same way either. Or even likes in music.
But most of the time it has to do with preferance. However; I wonder if our hearing is selective as well or is it an actual physical response that make us hear things a different way at times.
The way a baby may delight in hearing his mothers voice over a prettier sounding voice.
To the baby, does her voice sound nicer than it is?

People often tell me that my voice and my sister and my daughter all sound the same. However; In recordings I can tell the difference between all of us. Although my voice always sounds a bit strange to me, I can definetly tell my daughter from my sister. Others have a problem telling us apart over the phone.

So do our ears vibrate differently or is it a lack of attention to detail in sounds that make the difference?