IDEFICS is an open access visual language model. It's an open source reproduction of Flamingo and similar to GPT-4, it can receive images and text inputs to generate text outputs. The 9B and 60B versions are released
Have you seen evals against InstructBlip, specifically the FLAN-T5xl version?
Secondly, I'm wondering if we could take the dataset and use Flan or OpenAI for the language component and still get a permissible license for commercial usee?