> When we tell AI that we're relying heavily on its answers, it "doubles down" to provide us with more precise, thoughtful, and thorough responses. The AI isn't actually feeling the pressure
If it quacks like a duck...
If it quacks like a duck...
Language is our repository for both intelligence and emotion, it has its own evolution and replicates faster than biology. I don't pin AI abilities to the models, but to the datasets they are trained on, knowledge created by our own hard work and risk taking over millennia
Admitting the essential role of the language corpus in AI over models would change discussion about the speed of AI evolution and its risks. Language is not something we can control, it is emergent from the whole population. But at the same time it looks unlikely to have an exponential growth as knowledge comes with hard work and risks. Iterating in our imagination doesn't produce new knowledge, it is all crystallised feedback and experience from the world. It's also how the scientific method works.
1) [link redacted]
I think before RAG we need to do more legwork with the LLM on the raw text. Here is one of my blog posts that is related:
https://mindmachina.wixsite.com/ai-blog/post/the-promise-of-...
The idea is to create chain-of-thought annotations from your raw texts, that would improve the embedding and retrieval process by making implicit things explicit.
For example "the last letter of this message" would not embed similar to "e", but if it was annotated with CoT, it would work.
I think a lot about the cost of the loop, mostly in terms of time. I don't want the bot to take too long to respond. That's why dream cycles seem like an obvious solution to some of the more heavy work. I guess it would make sense to combine those with your idea -- "given what I know about the user, what should I study?", especially if it has access to an "enhanced" knowledge db like you suggest..
As for intelligence I honestly believe the mind uses whatever tools it sees fit for a task. Sometimes when you think about a problem it is through words, sometimes it is through visuals and sometimes it is just felt.