> NN for image classification task
You've created your own straw man here.
> "You realize now how computationally intractable this task is on modern hardware?"
Here are the people that prove it isn't computationally intractable : https://blog.openai.com/evolution-strategies/ - but to say they've discovered a new breakthrough method is over-selling the result.