If you're interested in the SQL component of this, we're building a product strictly focused on that at https://www.definite.app/. We let non-technical users ask questions of their SQL database. We do this by:

1. Pulling in your schema information and structuring it in a way LLM's can reason about it

2. Pulling in your prior query history against the database to understand how you actually use your data (e.g. what JOIN's are common, what tables are used most frequently, etc.)

3. Adding context from other tools you may be using (e.g. we can pull in metadata and tests from your dbt project)

We also have a Slackbot you can add to your #urgent-data-requests channel. If you @Definite in a thread, it'll parse out messages that can be converted to SQL tasks and return the answer from your database.

You could certainly build this yourself with (or without) LlamaIndex, but it's still quite a bit of work to set up.