Does living in a religiously tolerant society require that public displays of religious fervor become stigmatized?

I find public displays of religious feelings distasteful, even when I share those feelings. Is that because in a multi-religious society, religious fervor can cause disruption or animosity among conflicting religions? Or is something else going on? Or am I the only one who feels that way?