Why is it necessary to wash your hands after going the bathroom?

Is going the bathroom that unsanitary that it is necessary to wash your hands every time afterwards? Or is it just an opportunity to wash your hands since you touch so may things throughout the day that have germs; for example, handling money or touching a door handle. I wash my hand every time, but am curious.