So Google is basically admitting PyTorch/XLA on TPUs didn't work — TorchTPU looks like them rebuilding what should have worked day one. Its hard to run production ML on a toolchain engineers can't trust, no matter how fast the silicon is.
22 karma · joined April 16, 2021
Stuff that was prohibitive six months ago is now up for grabs. We keep on working on the infra level now, swithcing models whenever we run out of credits, or want a different result. The question is how do we build context, architecture and ensure the agent is effective and efficient..... wouldn't it be good if we simply used less energy to make these AI calls?
This should be done at a federal level, and the US needs to be the global driving force behind it, ensuring all countries adopt and adhere the same principles. We need the equivalent of the International Atomic Energy Agency to manage this going forward.
Could this be even more dangerous than a nuclear bomb?
A key theme in the book is the relationship between power and technology. Pynchon explores the idea that those who control technology also wield immense power, and that this power can be both destructive and corrupting.
Super befitting to the current discussion around AI.
Drop in the ocean though. Pocket change for Elon.
I would love to learn from more experienced engineers how they manage the changing requirements, the legacy issues, etc. when managing complex applications. I'm not talking about the code quality itself.