It would be really interesting to see how a system like this competes with multimodal transformers. If it's good, systems like GPT-4 and Kosmos-1 won't need to have a built-in vision system.