Eventually at a later point in time! I‘m currently integrating the AI-based generation of queries…
Using meta queries to fill my system prompt with the entire schema of the db in a condensed format.
It was working quite well!
Would love to hear about your approach.
Question is more where to host this "on the cheap" because this is a free service, and I can't just spend hundreds of Dollars/month to keep it running... Do you have any recommendations?
In general I don't think this would eat too many resources, just throw it on a VPS using systemd.