How to pursue living off the grid?

Over the last few years it become a fantasy to live off the grid In either a small house I built myself or decent sized shed converted into a home with no electricity or running water. I can find other ways to bathe and cook. After doing some research I discovered this does not have to be a fantasy. I just don’t know how to go about it. I live in New Jersey and they have a bullshit law for every little thing you try to do. Does anyone know the rules about building stuff in jersey? Lets say I bought a small plot of land in a remote area. Could I just put up a small building without anyone giving trouble if I didn’t make it clear I would be living there? I guess technically I do have to have a address somewhere. This is where it gets technical..