For GPU instances, Lambda Cloud has A100s for $1.10/hr and A10 instances for $0.60/hr.

https://lambdalabs.com/service/gpu-cloud