While it is largely obsolete for practical purposes, learning about them is still valuable as they illustrate the natural evolution in the thought process behind the development of transformers.
You learn linked lists in comp sci yet rarely if ever use them. Still, they are a basic concept required to understand trees, DAGs, etc later…
CNNs are still relatively competitive at vision tasks.