What is the difference between these two sentences?

Was is in the past.

The proper comparison would be “I heard that he was singing”. Unfortunately, this has two interpretations. It could mean that someone told you he was singing. The other interpretation is unlikely, since sight is different from hearing. You might see someone and then recognize that he is was paining. It is possible but unlikely that you would hear someone and then realize that he was singing.