Hacker News Reader

But aren't BERTs tiny compared to a LLM and can be trained cheaply with the help of an LLM?

Suppose you want it to make a decision based on ..say.. 300KBs of somewhat changing information per query.

There's no scenario where you are training BERT online to give you an answer.

Can any model give you a reasonably correct answer on that amount of data?

Yes