10 karma · joined November 12, 2020
If it’s particularly not intensive, I wouldn’t be surprised if model architecture moves towards self-specialization or topic-selection with some effective function calling e.g. model used for a while -> automatically call model specializer after a few queries on the topic -> now use the newly returned specialized LLM
I wonder at what magnitude this could improve model efficacy
Serious question: assuming this is true, if an incumbent-challenger like OpenAI wants to win, how do they effectively compete against current services such as Meta and Google product offerings which can be AI enhanced in a snap?
“Needs tool usage” and “found the answer” blocks in your infra, how are these decisions made?
Looking at the demo, it takes a little time to return results, from the search, vector storage and vector db retrieval, which step takes the most time?
[1] https://www.cbc.ca/amp/1.6938242
[2] https://thoughtleadership.rbc.com/proof-point-soaring-constr....