> I wonder what would have happened if we poured the same amount of money, talent and hardware into SVMs, random forests, KNN, etc.

From my perspective, that is actually what happened between the mid-90s to 2015. Neural netowrks were dead in that period, but any other ML method was very, very hot.