Hacker News Reader

Do you have to generate embeddings with openai? I'm assuming this is the quickest and easiest way, but what's the complexity if you do this on your own hardware?

View on HN

Neither of this really requires OpenAI. You can do it with locally-running models via something like https://github.com/mudler/LocalAI

Terrific. I also see that Simon Wilison's LLM tool does it.

https://llm.datasette.io/en/stable/embeddings/cli.html#

Yes, `llm` is a great tool. I believe it uses OpenAI by default but supports installing local models as plugins -- https://simonwillison.net/2023/Jul/12/llm/

Reply on news.ycombinator.com