Love this article, right on.
re: “”Start with the harness, because it is what makes everything else usable.””
I have written three harnesses this year (in Common Lisp, Python, and Racket Scheme) and it has been a fantastic learning experience. I have been using neural network tech since I was on a DARPA neural network advisory panel in the 198os, and I am even more excited (by an order of magnitude) than I was back then.
I think Tim has it right, and the hyperscalers serve a function of bootstrapping smaller systems, but they are far from the whole story.