Everything you said is parroting data you’ve trained on, two thirds of it is actual copy paste
I still don't buy the "we do the same as LLMs" discourse. Of course one could hypothesize the human brain language center may have some similarities to LLMs, but the differences in resource usage and how those resources are used to train humans and LLMs are remarkable and may indicate otherwise.
And he probably cant quote Shakespeare as well ;)
A 2-3 year old baby could speak in a rural village in 1800, having just seen its cradle (for the first month/s), and its parents' hut for some more months, and maybe parts of the village afterwards.
Hardly "petabytes of training video" to write home about.
What resolution of screen do you think you would need to not distinguish from reality? For me personally i very conservatively estimate it to be on above OOM of 10 4k screens by 10, meaning 100k screens. If a typical 2h 4k is ~50gb uncompressed, that gives us about half a petabyte per 24h (even with eyes closed). Just raw unlabeled vision data.
Probably a baby has a significantly lower resolution, but then again what is the resolution from the skin and other organs?
So yes, petabytes of data within the first days of existence - well, likely before even being born since baby can hear inside the uterus, for example.
And very high signal data, as you’ve stated yourself (nothing to write home about) mainly seeing mom and dad, as well as from a feedback loop POV - a baby never tells you it is hungry subtly.
He didn't parrot a video or sensory inputs though.
Whatever is happening in the brain is more complex as the perf/cost ratio is stupidly better for humans for a lot of tasks in both training and inference*.
*when considering all modalities, o3 can't even do the ARC AGI in vision mode but rather just json representations. So much for omni.
"Just like" an LLM, yeah sure...
Like how the brain was "just like" a hydraulic system (early industrial era), like a clockwork with gears and differentiation (mechanical engineering), "just like" an electric circuit (Edison's time), "just like" a computer CPU (21st century), and so on...
You're just assuming what you should prove