You're arguing about whether it's possible or not. You're saying it's not possible.
It is possible.
It is possible.
AFAIK, that is true.
Whether it's possible to replicate what happens in the brain on a binary system or not is a separate thing entirely. It's also not what LLMs are attempting to do.
Except the brain can be modeled with arbitrary precision - so he's got an uphill battle in either case.
TLDR: Yes, he literally said "binary computer" but from the context it's clear he means more than that.