Edit: A question from AI/LLM ignorance- Can the source database for an LLM be one-way, in that it does not contain output from itself, or other LLMs? I can imagine a quarantined database used for specific applications that remains curated, but this seems impossible on the open internet.
I think, for public internet data, we can only be reasonably confident for information before the big release of ChatGPT.
If in the hypothetical future the continual learning problem gets solved, the AI could just learn from the real world instead of publications and retain that data.
In that situation, they give the (wrong) answer that sounds the most plausible.
As soon as I tried to make a todomvc it started working great but I wonder how much value that really brings to the table.
It's great for me though. I can finally make a todomvc tailored to my specific needs.
It's in that realm but more complex. I do plan to repeatedly come back and try though. Just so far it hasn't been useful.
On the other hand, they've also surfaced information (later independently confirmed by myself) that I had not been able to find for years. I don't know what to make of it.
Not if you use web search or deep report, you should not use LLMs as knowledge bases, they are language models - they learn language not information, and are just models not replicas of the training set.
This creates financial incentives to pay companies running the new version of search. Your thinking of this as a problem for these companies, when in reality it is a financial incentive.
Chat rooms produce trillions of tokens per day now, interactive tokens, where AI can poke and prod at us, and have its ideas tested in the real world (by us).
Results vary of course. I have some very wonderful synthesizer manuals.
Thats not to say AI is bad. It’s great in many cases. More that I’m worried about what happens when the repositories of new knowledge get hollowed out.
Also my favorite response was this gem from Sonnet:
> TL;DR: Move your monitor cable from the motherboard to the graphics card.