Should I be concerned about frequent mild headaches?

Last week, I had a headache on Monday. I didn’t take any meds and just dealt with it until I went to bed and slept it off. I got another one, not as bad, on Tuesday. Again, no medication. On Saturday, I got another one in the morning and I took some Excedrin. It went away quickly and stayed away. Yesterday I had another one in the afternoon and it actually went away after I exercised. Today, it’s back. All of them have been on both sides of my head.

They aren’t very painful, just annoying, and I don’t have any vision problems, nausea, dizziness, or other symptoms that I’ve noticed. I’ve been going through some stress lately, but that’s nothing new. I’ve had headaches before, but not as frequent as these. I don’t know if weather can affect frequency of headaches, but our stormy one day/sweltering heat the next day weather has been a bit bipolar where I live.

I’m wondering if this is any cause for concern and if I should see a doctor for it. I avoid the doctor because I have no insurance, but I have to do what I have to do. I’m wondering if my wisdom teeth coming in could cause this. I don’t feel them coming in, but I’m 21 and I still have them so…just a thought.

Any insight would be appreciated.

ETA: Oh! No caffeine/alcohol withdrawal either. I did wake up with a nigh sweat last night which has never happened, but I don’t know if the two are connected.