you have two options:
first, stay determined to get your money's "worth" and keep using windows. Good luck. In answer to your question, yes deleting enything will make windows more unstable, using it will make it more unstable, installing/uninstalling anything will make it more unstable, switching it on will make it more unstable.
Secondly, you could get linux. It's free, and so you will still get as much value for money, except you will save a lot of time and effort by using a real operating system.