An alternative might be a matrix of DSP 'cores', instead of switching an analog signal around you would move around an I/Q stream. That might be an interesting path to wander down for a bit.
Edit: IQ analog processing is extremely common in the high performance RF field but tends to be static and not reprogrammable. FPAA's exist on market but are extremely expensive for what you get. The general purpose analog computer was initially developed by Shannon (yes that Shannon) back in the 40s.
https://en.wikipedia.org/wiki/Field-programmable_analog_arra...
There was also a general-purpose, analog computer that people seem to have done similar things with.
http://www.comdyna.com/gp6intro.htm
https://www.scss.tcd.ie/SCSSTreasuresCatalog/hardware/TCD-SC...