"It's all downhill from here": good or bad?

When you hear (or use) this expression, do you take it to mean

(a) “We’re through with the tough part, the climbing and struggling, and now we come to the easy part, where we can just relax and coast.”

or

(b) “Everything just gets worse from now on. The good part is in the past, and we’re facing a decline from which we won’t recover.”?

If you heard your doctor say this, or your financial advisor, or your spouse, would you be relieved or upset?