What paperwork do you have to file with the state, city and feds to register a business?

I’m starting a business in June and I need help getting the ball rolling. There is so much to do and I don’t know how to do it all. I’ve been learning as I go. Also, I am unsure of wether or not to incorporate the business.