If that was true, transformers would have been useless for NLP and deep learning for Go.

You can argue the exact opposite: the more you leave to the model to learn by itself, the more likely you are to find a solution that was not accessible to humans and their limited feature engineering capability.