Based on #2, it seems like they only use the LLM when the page changes. I had a prototype of this sort of system working and it was surprisingly fault tolerant.