Hacker News Reader

Any solutions like this that work with self hosted models?

Depends what you mean by 'work.' You can definitely use them, but GPT-4 is the only model that generates good SQL without lots of training + fine-tuning (and it is very difficult/impossible to come up with Nl <> SQL training sets). So GPT-4 is the only model that works well in terms of accuracy for now.

That being said, I am pretty sure the self hosted models will get there very soon.

Are you looking to deploy a solution with a self-hosted model?

What about datasets like https://huggingface.co/datasets/b-mc2/sql-create-context? An OSS model based on StarCoder was also recently published which is roughly between GPT-3.5 and GPT-4: https://github.com/defog-ai/sqlcoder

Yes, we have use cases that can't leverage GPT-4 for data privacy reasons. I was curious if any self hosted models would suffice and could be integrated.

GPT4 is best right now for all the reasons you likely already know. We are working on self-hosted but for right now it is GPT4. We can let you know when we work on self-hosted, which will no doubt come in the future. feel free to email me at anuj at dataherald dot com or sign up on our site (https://www.dataherald.com/contact) and i will keep you posted.

i should note that our (dataherald's) product only sends schema to the LLM, which is important to note.

Reply on news.ycombinator.com