Windows does have a C# compiler by default. It is located in the `Windows\Microsoft.NET` folder. Not very discoverable, though.
And starting with Windows 10 a metro app called 'Code Writer' seems to be installed by default for coding. (At least it's there in my installation.) I didn't try it though.