And how are we going to build these things with current limitations on fabrication? There are only a few places in the world building 3nm chips. And they're under serious threat of foreign violence.

It's highly likely that over the next 10 years we find demand and loss of production further constrains supply.

Designing a specific model into silicon sounds like one of the worst possible ideas. No better way to freeze assumptions and limit growth. Software defined solutions dominate for a reason, because adaptability is key.

Models were never the answer. Eventually we'll get past the nonsense of observationally inefficient neural nets.