Why are messy people considered less considerate or more disruptive than neat people?

I am a messy person and I feel as if people think my messy habits are more disruptive than other people’s neat habits. I can understand that my messiness is very disconcerting to a very neat person, but someone’s extreme neatness can be very disconcerting to me as well. Yet, I am considered the disruptive, inconsiderate one even though I am just as undone by someone neatening up my clutter as someone else is by my cluttering up their neatness. What are the collective’s thoughts on this?