What price will Justices Gorsuch and/or Kavanaugh have to pay?

Sen Chuck Shumer, referencing another SC review of an abortion ruling, said the following-
“I want to tell you Gorsuch. I want to tell you Kavanaugh. You have released the whirlwind and you will pay the price. You won’t know what hit you if you go forward with these awful decisions.
https://www.cnn.com/2020/03/04/politics/schumer-roberts-threats-supreme-court/index.html

Forget about the fact that he did not address them as Justice (Shumer likes to be called Senator BTW)
You can’t fire them. They aren’t elected. I suppose you might impeach them, but you know how that goes.

So just what is that price that they might pay?