134 karma · joined August 26, 2019
It does seem like the RNode radios are a lot less mature but they seem to be aiming to be less of a toy.
Super reliable.
Rules are a part of how the world works as is the violation of them. Thought problems that deviate so far from reality are more a test of abstract thinking.
Rules implicitly exist for terminal goals (don't kill the grass in the park so people can enjoy it) but get abstracted into actionable decrees that are not necessarily aligned (Becky can't enjoy the grass if she's dead.)
But perhaps it turns out that subnets can be trained independently or swapped with semantically equivalent but qualitatively different ones. The routing network would effectively "Standardize" and could in principle be well enough understood to "hand optimize" the routing network into hardware. Or maybe back propagation has some novel physical analogue that can be exploited in scales we can access. The real question is if Altman is capable of finding the right path in the notoriously dead end filled field of chip design. His backing of helion [1] didn't bode well in my view. But with enough R&D maybe he will flail into something useful trillions is enough for a lot of flailing.
[1] https://youtu.be/3vUPhsFoniw Edit: more derisive link
On the opposite side "chemical force" is amazing and borderline unwatchable.
Radio looks pretty bleak, noise floor is about to get a lot higher.
We don't re-evaluate our astrophysics models when reading a cooking book.
Current training systems extract information on everything from every input. We don't read a cookbook to learn about space, but these models are twiddling weights all over these massive spaghetti balls of logic.
Looking at the data we have, the literal collection of all human knowledge and lamenting not having more is like standing on a ladder sideways.
But it's really starting to feel like pile of ladders is getting tall enough to bootstrap.
And these massive inefficient systems filled with data and churning matrixs will be set in order. And all the ladders laid end to end.
These are crazy times.