I would look into VLAs/VLMs if you haven't already.