There’re a handful of ways to introduce electro-optical and all-optical non-linearities into optical neural networks. Here’s a fair survey of the field: https://dl.acm.org/doi/full/10.1145/3607533