So I work for one of the consulting firms :)

I can confirm the giant FOMO happening, and LLMs projects are popping up everywhere.

Good news is, the "talk-to-your data" use case you're describing is not the only one that can deliver amazing new tools! There's the "explain-me this", "summarize that", and "next-best-action" use cases that shows great promise!