If you and your partner + kids have lived with your parents or in-laws for some time and then moved out, how did it work out?

I am getting to a point (for various reasons that I don’t wish to go into because I am going to get upset again) where my husband and kids and I might be moving out of the home we share with my mom, aunt and grandmother. Obviously, there will be a lot of guilt tripping going on and I, too, don’t really believe in leaving three elderly women to live on their own (another family would move into our apartment, we have the 2nd floor but they’d be strangers). We also have a backyard and get help from them sometimes with kids so we’re torn as to whether or not it’s all a good idea. If you have ever been in a similar situation, will you tell me whether or not it worked out for the best and did the relationship between you and your parents/family that you left improve?