Not really. He said no one who knows anything about the brain thinks it's a binary system.

AFAIK, that is true.

Whether it's possible to replicate what happens in the brain on a binary system or not is a separate thing entirely. It's also not what LLMs are attempting to do.