How are these cases of symbolic destruction different?

In 2001, Islamic Fundamentalists, the Taliban, declared the ~1500 year old statues of Buddha carved into the Bamiyan Valley cliff face, to be offensive to Islam and needed to be removed and destroyed. They said the statues represented idols and were justified in systematically blowing up the massive carvings. Most of the world, including the Organization of the Islamic Conference States, protested that the carvings were part of Afghan history and, as cultural icons, should be spared. The Taliban refused all payment and relocation offers and destroyed them with explosives.

How are these statues different from the display of the Confederate, or even the Nazi, flag on public or private property? Some citizens feel those are part of their history and are cultural icons and should not be destroyed. .
Where do we draw the line?