> They can generate correct SQL queries to answer complex questions about novel datasets.
"Correct" is a big overstatement, unless by "SQL" you mean something extremely basic and ubiquitous.
"Correct" is a big overstatement, unless by "SQL" you mean something extremely basic and ubiquitous.
For many cases this is more than enough to solve some hard problems well enough.
If these LLMs were cheap and easy to train (or is it fine tune?) using your own schema and code base on top of its existing “whole internet” training data… it could almost certainly do more than just provide “basic stuff”.
Of course I think the training for your own personal stuff would need to be “different” somehow so it knows that while most of its training is generalistic the stuff you feed it is special and it needs to apply the generalist training as a means for understanding your personal stuff.
Or something like that. Whatever the case is it would need to be cheap, quick and easy to pick up a generalist LLM and supplement it with the entirety of your own personal corpus.