I'm training a 65B model right now, also I believe you can use lora-alpaca to train on this data on a much smaller machine.