Why can’t a model explore its environment (given access) and find and use those tools? Why can’t a model fire up a query (sql, http, or whatever) to do the retrieval if it determines it needs more information?
In order to use tools they need to be run as part of a system that grants them access to tools, eg via the reAct pattern. https://til.simonwillison.net/llms/python-react-pattern
Obviously I’m talking about next gen models, like gpt5/6.
As you train a model it should build it's knowledge database at the same time. I guess that's how it work?
When an LLM get trained on next word guessing, can it search the web to improve his results?