Hacker News Reader

Comment by BoppreH | Hacker News Reader

In their first demo video, to make a 3D render of the photo, the thinking trace gives away the game:

> Interesting! It turns out there's already an existing project here [...] The project is fully built [...]

I'm always astounded how little effort is put into checking the AI answers displayed in these announcements. Back when I paid more attention, I remember OpenAI's and Google's demos constantly showed their AIs giving wrong answers.

View on HN

Since people seem interested in this comment of mine, here's another fun line I noticed in the same video, at the very top of the logs, just before the Step 5 agent found the already-completed project:

> Error: OpenAI API error (403): {"message":"model water18-new is not available for user i-yuliang [trace_id=bfcfdd6bcdc236ca18d009c65cca52e4 code=40004]", "type":"invalid_request_error", "param":null, "code":null}

Here's a still frame for posterity (apologies for the quality, the original video is tiny): https://boppreh.com/room.jpg

Demos are demos and recreating scenarios is to be expected, but oh boy, somebody should review these things before publishing.

I think it's more likely they recorded the video when the project was already done than cheated

Yeah, I agree that's the most likely explanation. My point is that these demo hiccups should not show up in your announcement, it casts doubt on the product for no good reason. It's sloppy.

Reply on news.ycombinator.com