I suspect the thing that held back its adoption for end-users (or is still holding it back) is the fragmented ecosystem and so-so open source clients with questionable inter-compatibility, i.e. you can get calls from Windows to Android to work as an end-user, but it's a rocky path.
Hopefully we can one day see the great XMPP renaissance.