Music people: How could you differentiate different kind of 'key' in classical music through listening?

OK I know this can be explained with the form and structure of each respective keys but that is not what I want to know. I want to know how could you know,and how could you explain that a particular music appear in specific key through the music itself(not the music note).

Ex: I see there’s a Symphony No.3 in C minor (Bach),Symphony No.3 in D minor (Bach),Symphony No.3 in A major (Bach),etc.

How could you know each characteristic of that particular music by its key? (Music in A major is fast,energetic,fluctuative,etc. Music in E minor is soft,slow,more connective,etc. If you listen to the same music but from different key) What make it different one from another if you listen from the music with different key?

I know this could be subjective,and might depends on the instrument/s(or maybe the conductor) in in that particular music but please make it as general and explainable as possible.