> clearly don’t have if you’ve looked at lots of gpt4 examples
for example, can you fine tune GPT to play chess at ELO 1600 ?
If you don't know answer, you are in for surprise.
for example, can you fine tune GPT to play chess at ELO 1600 ?
If you don't know answer, you are in for surprise.
It's possible that finetuning would basically be training a new network from scratch and the resulting network would forget everything apart from chess. It would be a really interesting experiment, GPT-2 is probably too small but I think llama-7B might be sufficient.
Most interesting aspect to me is if model can learn not make illegal moves ?
My personal take is that chess isn't all that structured, really. Yes, the ruleset, pieceset, and board are small, but the tactics of the game make it chaotic – seemingly trivial differences in board state can lead to dramatically different consequences.