poincareball

Tristan Buckmaster found out the hard way.

Yeah… “unknown”. As if we don’t know any countries seeking to end democracy in Taiwan…

And how are we going to build these things with current limitations on fabrication? There are only a few places in the world building 3nm chips. And they're under serious threat of foreign violence.

It's highly likely that over the next 10 years we find demand and loss of production further constrains supply.

Designing a specific model into silicon sounds like one of the worst possible ideas. No better way to freeze assumptions and limit growth. Software defined solutions dominate for a reason, because adaptability is key.

Models were never the answer. Eventually we'll get past the nonsense of observationally inefficient neural nets.

Evidence actually supports that capabilities are leveling off, and cheaper/faster is not really coming. Just log-linearly more capability at smaller parameter counts as they saturate.

I've been not just unimpressed by Fable, but actively find it to generate negative value.

It hallucinates more, and in more destructive ways, than other models I've worked with and generates truly atrocious jargon and bizarre inhuman explanations that end up cluttering things. The code it writes is terrible too. Overly complex with a lot of technical debt.