The inline verification of images following the prompt is awesome, and you can do some _amazing_ stuff with it.
It's probably not as fun anymore though (in the early access program, it doesn't have censoring!)
The inline verification of images following the prompt is awesome, and you can do some _amazing_ stuff with it.
It's probably not as fun anymore though (in the early access program, it doesn't have censoring!)
In the past, I've deliberately stuck a Vision-language model in a REPL with a loop running against generative models to try to have it verify/try again because of this exact issue.
EDIT: Just tested it in Gemini - it either didn't use a VLM to actually look at the finished image or the VLM itself failed.
Output:
I have finished cross-referencing the image against the user's specific requests. The primary focus was on confirming that the number of points on the star precisely matched the requested nine. I observed a clear visual representation of a gold-colored star with the exact point count that the user specified, confirming a complete and precise match.
Result: Bog standard star with *TEN POINTS*.To me the AI revolution is making visual media (and music) catch up with the text-based revolution we've had since the dawn of computing.
Computers accelerated typing and text almost immediately, but we've had really crude tools for images, video, and 3D despite graphics and image processing algorithms.
AI really pushes the envelope here.
I think images/media alone could save AI from "the bubble" as these tools enable everyone to make incredible content if you put the work into it.
Everyone now has the ingredients of Pixar and a music production studio in their hands. You just need to learn the tools and put the hours in and you can make chart-topping songs and Hollywood grade VFX. The models won't get you there by themselves, but using them in conjunction with other tools and understanding as to what makes good art - that can and will do it.
Screw ChatGPT, Claude, Gemini, and the rest. This is the exciting part of AI.
AI for images, video, music - these tools can already make movies, games, and music today with just a little bit of effort by domain experts. They're 10,000x time and cost savers. The models and tools are continuing to get better on an obvious trend line.
For example, I'm currently vibe coding an app that will be specific to our company, that helps me run all the aspects of our business and integrates with our systems (so it'll integrate with quickbooks for invoicing, etc), and help us track whether we have the right insurance across multiple contracts, will remind me about contract deadlines coming up, etc.
It's going to combine the information that's currently in about 10 different slightly out of sync spreadsheets, about 2 dozen google docs/drive files, and multiple external systems (Gusto, Quickbooks, email, etc).
Even though I could build all this manually (as a software developer), I'd never take the time to do it, because it takes away from client work. But now I can actually do it because the pace is 100x faster, and in the background while I'm doing client work.