I assume most people in these comments don't understand 3d modeling, or they are seriously optimistic about THE IDEA of vision assistant AIs, but this demo is not exciting at all. In fact is detrimental to showcase real utility
This is just an early taste of a potentially powerful use case.
I understand the vision API doesn’t have memory, so each screenshot it takes is like an entire new context. If the script/application is able to send WHAT application it’s in, and has some RAG database in the backend to pull knowledge from, this would be incredibly useful.
Of course it’s slow now. If you’re legitimately stuck, a couple seconds for a personalized answer is a perfect trade off. It will get better.
There seems to be a trend in HN in general I’ve noticed of “it’s cool to be optimistic” and I don’t really like it. I mean sure I’m optimistic when it comes to human beings around me but when discussing technology and people who are out there to make money (or not) I don’t feel the need to be overly optimistic. Plus, competition is the very foundation of innovation and harsh honest feedback is a very important piece of the puzzle.