Hacker News Reader

Can the 30 second embedding time be done beforehand and sent to the browser?

Inference is nice and quick after that.

yes, you could run a 1 time indexing run on the server side, and just ship the embeddings to frontend