Here is an idea. Maybe the most optimized neural network is the brain. Computation to energy consumption ratio.
So essentially the way doing this in silicon is just pointless.
There must be a reason we can do so much while consuming so little, and then again struggling with other tasks.
What is the success if we build a machine that consumes just heaps of energy and then is as bad in maths as us?