What to do with Credit Card?

I have a CapitalOne card that I’ve opened a little over 2-years ago. Ever since, I’ve been paying off the balance in full. However, I received this card as a method of re-establishing my credit (crazy college youth, you understand); so naturally I started out with a low credit line and this card comes with a $19 annual fee.
But since then, with excellent payment history, my credit scores have gone up considerably.

I’ve managed to get another credit card with the same credit line and no annual fee. And I also pay in full on this new card as well.

So here’s the question. What advice should I do about the annual fee?

I understand if I close this card out, I’m going to hurt my credit score because it’s a 2-year old card – the first actually since my way onto a good credit rating. If I don’t close the card out, I’m faced with paying $19/year. CapitalOne won’t waive the fee. They offer me to apply for a non-annual fee card (which I’ll probably be approved for).

Any suggestions? Thanks in advance.