What is the best way in terms of price/convenience ratio to run the 70B model on the cloud? Are there any providers offering out-of-the box setups?
on a CPU machine with AVX instructions would be a better bang for your buck than GPU. Depends on if your use case can tolerate the latency