You can fine-tune Llama 2 7B/13B/70B on Cerebrium (https://www.cerebrium.ai). Disclosure: I am the founder.

We allow you to change all the hyper parameters such as num_epochs, learning_rate, tokenizer etc and even can submit your own prompt templates. If you want to use the recommended settings you can. It allows you to focus on your data and your hyperparameters rather than worrying about setup and infrastructure.

If you want to write your own code to train, you can do that also - the interface is as if you were developming locally:)