Sometimes I like to remind myself we are living in the future. A future that seemed like SciFi when I was a kid in the 70s!
Sadly I don’t think we will ever see Warp Drives, Time Travel or World Peace. But we might get Jet Packs!
We're getting there!
Need local "offline mode" somehow.
"The 160 MFLOPS Cray-1 was succeeded in 1982 by the 800 MFLOPS Cray X-MP, the first Cray multi-processing computer. In 1985, the very advanced Cray-2, capable of 1.9 GFLOPS peak performance
...
By comparison, the processor in a typical 2013 smart device, such as a Google Nexus 10 or HTC One, performs at roughly 1 GFLOPS,[6] while the A13 processor in a 2019 iPhone 11 performs at 154.9 GFLOPS,[7] a mark supercomputers succeeding the Cray-1 would not reach until 1994."
Sustained ? Or just for some ms when the thermals kick in ?
A modern Nvidia GB200 only does about 40 tflop/s in fp64 for instance. You can emulate higher precision/dynamic range arithmetic with multiple passes and manipulations of lower precision/dynamic range arithmetic but without an insane number of instructions it won't meet all the IEEE 754 guarantees for instance.
Certainly if Nvidia wanted to dedicate much more chip area to fp64 they could get a lot higher, but fp64 FMA units alone would be likely >30 times larger than their fp16 cousins and probably 100s of times larger than fp4 versions.
Sadly most of that power is not working for you, most of the time, but working against you, by spying, tracking and manipulating you.
Bet that was not include in your sci-fi dreams in 70s..
In the 70s, science fiction fed me Cold War fears of world-controlling mainframes.