Unless it's very "public common", otherwise, the numbers can be used for trustworthy work. In general, I think this is just for "fun play" most of the time.

This is a great point. It's easy to spin up an LLM data analysis demo, but it's really hard to trust the outputs.

I think we've (https://www.definite.app/) done a decent job here. Once the LLM generates results, you can inspect the query all the way back to the source (SQL).

https://www.youtube.com/watch?v=Nu2Tal3hm7s

Yeah I just tried it with numbers I knew a bit and it seems totally made up. The generated chart showed a linear downwards trend while in reality there isn't one and the numbers seem way off.