Wouldn't you also want to be able to manufacture some sort of GPU?
The annoying part of optical matrix multiplication is the conversion from electronic to optic and back.
Why not use electron-optics for matrix multiplication and use dynodes for amplification.