Can anyone explain why everyone is so hyper focused on speed? 500 images per second, 100 minutes video in 30 minutes, thousand lines of loc per hour. Who is going to consume all that?
It's also about responsiveness. LLMs produce junior-level quality of code at a rate of hundreds of lines per minute. I need it to produce enough to spot where it's completely wrong as quickly as possible to I can change the prompt.
It's like a edit-compile-run cycle which you also need to be fast or you lose attention.
I was tempted to say it's another _step_ in the edit-compile-run but often the code is so bad I don't even bother compiling.