f(x,y,z) = max(|x|, |y|, |z|) - const.
141 karma · joined October 23, 2013
f(x,y,z) = max(|x|, |y|, |z|) - const.
Here are the bits I enjoyed:
LLMs (or GenAI, in general) as (the most?) efficient compression machines.
Creative or new ideas are the gaps or white space of the latent space. They already exist but become harder and harder for humans to find. It’s the perfect job for computers, therefore.
The concept of “true” is defined in the latent space (or compression) itself.
> while “writing a first draft” is intimidating, “reading through all your notes” or moving note cards around on a table, contemplating structure, is not. In fact these tasks are kind of delightful.
Thanks for sharing.
Mathematics is beautiful!
For further reading about his story, I can highly recommend „The Wizard and the Prophet“ by Charles C. Mann [2].
[1] https://en.wikipedia.org/wiki/Norman_Borlaug [2] https://www.goodreads.com/book/show/34959327
[1] https://erikbern.com/2019/04/15/why-software-projects-take-l...
[1] https://ycharts.com/indicators/world_crude_oil_production
[2] https://www.nationmaster.com/country-info/stats/Energy/Oil/R...
A quick way to check if something grows linearly is to put it on a log-scale and to see whether it’s a straight line.
Nice explanation, though. We should talk about logs more often.
From the video in this IBM post [0], I understand that it is a way for the LLM to check what its source and latest date of information is. Based on that, it could, in principle, say “I don’t know”, instead of “hallucinating” an answer. A RAG is a way to implement this feature for LLMs.
[0] https://research.ibm.com/blog/retrieval-augmented-generation...
There are billions of people who are not „successful“ in a societally acceptable way. Being „unsuccessful“ is the norm and „success“ is the exception.
It’s all relative. And difficult to break the cycle.
Possibly links to point 8.
[1] https://www.metaculus.com/home/
[2] https://www.lesswrong.com/posts/ybYBCK9D7MZCcdArB/how-to-mea...