See https://en.wikipedia.org/wiki/Analog_computer

AFAIK analog computers are still the standard in radars for example and it sound like neural networks would benefit from similar hardware.