What are your thoughts on outsourcing?

All I know about it is that it’s used to save money by letting someone do the work for cheaper? And that it, of course, takes jobs away from the source. Is there more to it? Because this seems like a bad idea for people at the source, but seems like a good idea for the business owner. Simple things like taxes are even being done overseas, what do you think?