Show HN: Inferenceable – Open-source inference server with Node.js

Hey Hacker News!

I've developed an open-source inference server called Inferenceable with the aim of providing developers with a straightforward solution that can be installed without fussing over dependencies.

Inferenceable, built in Node.js, simplifies the process of building and running complex libraries like llama.cpp, making it accessible to developers of all levels.

It's also pluggable and can be used with your custom strategies.

There are 3 main functions - General text based inference - Image inference - Generate text embeddings

Inferenceable also includes a simple UI which can be customised or deployed as is, pluggable authentication, CSP and rate limiter.

I'm working on adding more authentication strategies, including social logins, and creating additional examples.

Thanks for checking it out, and happy coding!