Family members who stress you out; how do you deal with them?

Pull away from them for awhile (if you can)? Be cordial, but, have limited contact?

I’m dealing with a brother who when I talk to him, he only makes me feel worse and drained. Just wondering from your experience what worked for you.