Hacker News Reader

Yet it can write code better than 99% of humans…

It’s just starting to be trained on svgs, which is a really hard problem

"99% of humans" is a low bar. Maybe you mean "99% of people who earn money by developing software"?

LLMs can't really "see", so I challenge you to draw a pelican on a bike without any visual feedback, just code. Because that is how they are doing it.

Vision tokens for transformers aren't really well solved yet, which is why they can smash a phd math problem and trip over a "count the cats on the chair" problem.

It's not about seeing. It's about identifying the legs of the Pelican and then transferring the concept and mechanics of riding a bicycle + geometry of a body and a bicycle. The entire task has also nothing to do with vision tokens.

> It's about identifying the legs

So, seeing?

seeing isn't necessary to understand what a leg is.

Which I why humans can draw so well with their eyes closed?

If we want to train a model excessively on SVGs it will obviously be able to do this. We have only just started trying to do that

Reply on news.ycombinator.com