Ask HN: What is the AI that Ray Kurzweil talks about in Lex Friedman?

Found it: https://experiments.withgoogle.com/talk-to-books

He specificaly said it was a product that was probably still available on the market. Sounds really interesting and hard to find, I hope something like this comes out based on LLMs that can be easily fine tuned.

I suspect it’s this model or something similar: https://arxiv.org/abs/1611.01604

Question Answering is a rich area of research in NLP - this is a good place to start: https://paperswithcode.com/task/question-answering

Most modern language models seem to do that to an extent. Even github's co-pilot sort of does this (with code instead of books). The models can even synthesize, which starts getting really impressive. Check out Flamingo from Google, which is a VLM (vision-language model). There, it can answer questions about the content of new images and even incorporate new information.