I’ve been working on a Postgres extension for running local LLM inference “inside” Postgres (inference runs in a background worker, while Postgres stores the jobs, inputs, outputs, and receipts)

https://github.com/joshmeek/otlet