Doesn't the phone work both ways?

Yesterday, I had several family obligations. Over the course of the day, several people commented about how I don’t make it over to visit enough, or that I don’t call enough, or made a big spectacle about me making an “appearance.”
It really bothered me, especially because I could have turned to any one of the people who mentioned it and said “you never call me. You have never even been to my home, despite countless invitations.”

I struggle with agoraphobia, so I do tend to be reclusive. I don’t go out much, and social events tend to wear me out, but I do participate. I like people, I just have anxiety. Despite that, I make 100% of the effort in the relationships with every single person that likes to point out that I don’t attend enough functions.

Do you know people like this?
How can people put the blame on someone while knowing that they have made zero effort, themselves? Is it just a lack of insight?
Would you say something to people like this, have you?