Why are there options to go up or down on an elevator and not just.. one button?

I’ve thought about this a few times but just never asked, but really, have you ever stopped to look at an elevator and be like.. why must I press up or down arrow when I choose which floor to go to when I get on an elevator? Elevator systems retrieve the closest one, but really, it just doesn’t make sense, it makes life more complicated because if you can’t count or have no idea what floor you’re on how do you know which way is up or down or say you’re hanging upside down or heck, if you press up on the third floor and choose to go to the first floor it says it can’t do it because you pressed up and simultaneously the system combusts because you just confused the crap out of it? (that would be a good prank lol)