In my experience, LLMs are really good with SQL. If you can structure your data into easily queryable SQL data, your LLM will be able to generate queries to get what it needs really effectively
That's an interesting take! Not quite easy to do with a CLI tool with dozens of commands though. Maybe it would be some kind of always on server the LLM can operate on ... but then that starts to really look like graphql.