Suppose you want it to make a decision based on ..say.. 300KBs of somewhat changing information per query.

There's no scenario where you are training BERT online to give you an answer.