Pitching in on this with a tangent - how good are LLMs with RTS games these days? As someone without friends into that genre, it’d be pretty cool to play eg. AoE II against a capable computer that play like a real human…
If you meant _playing_ raw based on LLM input - that's probably the wrong tool for the job. The latency for you to react to a mango shot is faster than a billion tok/s lol