Computer gurus, can a WordPress site be developed and tested on my local machine before uploading?

I am trying to develop a WordPress site for a prospective client. I am also trying to set up a working development site with my provider, but I am wondering how much I can do to work on it locally as I am trying to learn WordPress at the same time.