Hacker News Reader

It’s not a public study though. We’re not going to get trust worthy numbers about labor or token cost.

> This is the one public case study on how large-scale llm-driven code generation actually works out.

Is it, really? I can't imagine how much money in tokens was spent to get something like this + Jarred's and the teams salaries to review/manage this.

The problem is that many negative effects of this kind of thing won't be clear or immediate, so it's not an easy test to make useful. At minimum, this increases the opacity of the box, reducing perceived trustworthiness.