Google has recently announced infrastructure for fine tuning and RLHF on their pre trained foundation models. I imagine all cloud providers will follow suit.

https://cloud.google.com/vertex-ai/docs/generative-ai/models...