When you want performance the only way is getting close to the hardware. That is why deep learning is usually linux+nvidia. That is why game engines use/used C or even assemble code for critical parts.
Don't expect anything better soon as companies focus on performance per watt and will only develop things in that path.