Yann LeCun on AMI Labs, JEPA, and the AI World of 2030

It is striking that every AI corporation has a press arm. nebius.science is from Nebius Group, which is the non-Russian rebranded Yandex and sells data centers.

My favorite LeCun was when he was talking about LLMs understanding the real world. In the clip he essentially said "If I have a water bottle on this book and I push the book, the water bottle will move as well. A 3 year old can tell you this. But an LLM has no concept of this effect since it's not written explicitly in any books". The clip is then immediately followed by asking this exact question to a number of LLMs and giving exactly the correct answer.

From the interview, I see he still harps on about the limitations of LLMs and harps on about real world AI. I just can't take him seriously because pretty much everything he says is wrong and hypothetical. He still can't point to a single thing that an LLM fails at that require his so called "world models"

He'll just throw some random stuff out there like "we're not at level 5 driving yet" despite having hundreds of millions of miles driven autonomously every day. He just seems to keep holding on to his beliefs (much of them economic) and refuses to adjust his priors.

Please call me when Yann is right about literally anything.

No one has been more wrong and for longer about anything than Yann on LLMs.