You can't train an LLM in real time feasibly. Training and inference are two different things.
OpenAI has a separate service for finetuning ChatGPT and it is not speedy, and that's likely with shenanigans.
OpenAI has a separate service for finetuning ChatGPT and it is not speedy, and that's likely with shenanigans.
There are very different approaches that might behave more like what you want, maybe RWKV.
https://github.com/BlinkDL/RWKV-LM#rwkv-parallelizable-rnn-w... :
> RWKV: Parallelizable RNN with Transformer-level LLM Performance (pronounced as "RwaKuv", from 4 major params: R W K V)
> RWKV is an RNN with Transformer-level LLM performance, which can also be directly trained like a GPT transformer (parallelizable). And it's 100% attention-free. You only need the hidden state at position t to compute the state at position t+1. You can use the "GPT" mode to quickly compute the hidden state for the "RNN" mode.
> So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding (using the final hidden state).
> Our latest version is RWKV-6,