Based on Carmacks Tweet: >I am explicitly not working with LLM — there are plenty of smart people doing so. Still, (waving hands vaguely) it does feel like the technology could be used to “argue with itself” and eventually produce a body of knowledge much more coherent than the raw training data.

Source: https://twitter.com/ID_AA_Carmack/status/1630632423351304203...

I would assume they are not

I wouldn’t expect language to be the only modality.