Nb. There are plenty of specialized architectures for convolutions: Nervana, Habana, Groq, etc.