Any suggestions about nipping panic attack causing anxiety in the bud?

I had two panic attacks in july and august of 2008. They were caused by caffeine, guaranteed. I have had none since. That said, I still get the tiniest tinge of anxiety sometimes, in normal anxious situations. Should I just shrug this off? I will not be taking any medications, as I do not believe in pharmaceuticals of the sort. I can handle the feeling, but it would be nice to get rid of it for good. Any ideas?

Exercise seems to help.