I just realized there's inevitably going to be dedicated hardware to help speed things up with ai related tasks. The GPU helps significantly but I'd assume something even more suitable could be made.
https://machinelearning.apple.com/research/neural-engine-tra...