This is text + image -> text but pretty cool and still might be of interest to you:

https://llava-vl.github.io