Why does flat soda water still taste funny?

Call it what you will, soda water, club soda, or seltzer. I am wonder why it still tastes weird when it’s flat. Seemingly there isn’t an carbon dioxide left so it should just taste like plain water. So, what is in it makes it taste the way it does?