https://www.amazon.com/Between-Human-Machine-Cybernetics-Tec...
I am curious to what extent an analog/digital hybrid can blend the best of both worlds, especially for something where the speed <-> precision tradeoff may somewhat favor speed. Like training neural networks.
That's where Analog comes in. You can shape and calculate microvolt and even nano-volt level signals before upscaling them to millivolts so that the CPU can handle the rest of things.
In general, digital RAM will hold a value more reliably for a longer-period of time than an analog storage device (aka: capacitor). True, RAM is implemented using capacitors (DRAM needs to be "Refreshed" as those capacitors lose value).
Its easy to "refresh" a capacitor if you only care about two states: high and low. If you're analog however and care about microvolts / nanovolts, its impossible to "refresh" capacitors.
After all, what does a capacitor at 5000uV really mean? In digital, you can refresh it back to 6000uV every few seconds. In analog, you don't know if part of the information leaked out or not.
If you are measuring a differential signal with a large high-frequency common-mode component, then it also makes sense to perform the subtraction in analog. Otherwise the inevitable small phase shift between the sampling of the two channels in your ADC will end up coupling the common-mode signal into your difference.
3 Gigasamples / second: http://www.ti.com/lit/ds/symlink/adc07d1520.pdf
The fastest OpAmp I can find is this 18GHz GBP: http://www.ti.com/lit/ds/symlink/ths4303.pdf
At 3 GHz, the OpAmp would only offer a gain of 6 which isn't really enough for much accuracy.
Granted, the OpAmp is like $5 and the ADC is hundreds of dollars (and the ADC is only 7-bit accurate)... but the digital world has gotten scary fast and scary good.
That's why Oscilloscopes, even GHz-Oscilloscopes are being made with digital technology today.
Hell, this crazy product raises eyebrows: http://www.digikey.com/product-detail/en/analog-devices-inc/...
26Giga-samples (Nyquist of 13). I mean, 3-bits sucks, but holy crap is that fast. A 26GHz ADC would be able to perform digital-filter analysis on 2.4GHz Bluetooth and Wifi without any aliasing what-so-ever.