No matter what it is probably easier to inspect a language model while it works, than the language module of a human while he speaks.