Hacker News Reader

Comment by simlevesque | Hacker News Reader

Click on the link I provided and you'll know why I know. It's not markdown, it shows the code that was ran and the output.

View on HN

Be careful. Output formatting doesn't prove what you think it does. Unless you work inside google and can inspect the computation happening, you do not have any way to know whether it's showing actual execution or only a simulacrum of execution. I've seen LLMs do exactly that and show output that is completely different from what the code actually returns.

You can literally click "Show Code"

Yes. "Show Code", not "Show CPU cycles". There's a difference. Writing code is not the same as running code. It looks to you like it ran the code. But you have no proof that it did. I've seen many times LLM systems from companies that claimed that their LLMs would run code and return the output claiming that they ran some code and returned the output but the output was not what the shown code actually produced when run.

Maybe the only way to be sure is to have it generate (not stable diffuse) an image with the value in there.

You cannot know that anything it shows you was generated by executing the code and isn't merely a simulacrum of execution output. That includes images.

Yes, you can. In my experience, models do not tend to write their own HTML output. They tend to output something like Markdown, or a modified version of it, and they wouldn't be able to write their own HTML that the browser would parse as such.

In my experience, models do not tend to write their own HTML output. They tend to output something like Markdown, or a modified version of it, and they wouldn't be able to write their own HTML that the browser would parse as such.

What, in your view, does sending one markup language instead of another markup language tell you about whether the back-end executed some code or only pretended to?

The front-end display is a representation of what the back-end sends it. Saying "but the back-end doesn't send HTML" is as meaningless as saying that about literally any other SPA website that builds its display from API requests that respond with JSON.

There is being critical of something and then there is being a conspiracy theorist. Code Execution is a well-known feature of Gemini, ChatGPT, etc. and it's always shown in special blocks and it runs inside a sandbox.

Reply on news.ycombinator.com