How can i permanently delete IE and WMP from my hard drive safely?

Using XP and want to get rid of these two piles of crap for ever , any one here help i do not trust what some forums and sites mention . Install this install that start this start that , sounds to dodgy to me .
Can i just go into C: and find IE and wMP and delete those files , would that work or would xp just want to install them again .