A few years ago I could vouch for LowEndBox: https://lowendbox.com/. I've not frequented the site in a very long time though, so can longer be sure.

RamNode has some starting at $15/year on their OpenVZ platform. Have been happy enough with that for several years now, although it's quite limited as to what it can do in terms of performance. But as another commentor mentioned, check out LowEndBox. It's where I discovered this.