Why are some people anti-Federal Reserve?

I have a decent understanding of the history of the Fed and what it does, at least from an academic point of view (not a conspiratorial one). For the last year, I’ve seen an increase in people thinking the Fed should be ended and are an evil, corrupt organization. I seem to hear this sentiment more from Libertarians, but not exclusively.

What exactly is their problem with the Fed?