A colleague and I have been investigating how different LMMs stack up against GPT-4 with vision. We ran seven tests across five LLMs We found strong performance with Qwen-VL and CogVLM, although no LMM (including GPT-4 with vision) passed all of our tests.
I'm excited to see what the next year of LMMs bring!