The paper: https://molmo.allenai.org/paper.pdf

> Our key innovation is a simple but effective data collection strategy that avoids these problems: we ask annotators to describe images in speech

I see this as another example that datasets trump architecture nowadays.

The architecture is not where the innovation is: it is only CLIP embeddings converted to the LLM tokens through MLP with some pooling to reduce the token count.