https://buyvm.net for fairly priced hosting with crypto. They're mostly out of stock so check https://buyvmstock.com/ to see what they have.
You can check Lowendtalk for more providers. Keep in mind that for privacy you still need to use a fake alias, and a VPN (one that doesn't keep logs) and both of those things can get your account automatically flagged and rejected on any provider.
And you can't expect the same reliability as with a big provider like Azure, AWS or even OVH or Hetzner.