Great job! Can't imagine amount of hours invested into it. How does the offline version perform in different areas comparing with known LLMs (e.g. ChatGPT 4o, LLama, etc)?
We are running known models like LLama, StableDiffusion etc. So pretty much the same :)
We are not planning on building our own models yet.