Various VPS and dedicated server providers have servers with 32 GB RAM for <100$/month, a windows license should add around $30 (or you might be able to bring your own, if you have one). First example that comes to mind would be Hetzner.
If you want something with lower granularity (e.g. booked by the hour), your going to end up at the typical cloud providers, which of course charge more.