The hard part would be to get the money for the needed compute, I presume. Although Karpathy just released a way to train a GPT2 level model for only 120 dollars [0]

[0] https://youtu.be/l8pRSuU81PU?si=NnbI-7CG-Qbm3E46