> The only UX I care about is the application being responsive and doing what it says it's going to do
UX as a field goes well beyond pretty UIs.
UX designer could drive your example because they looked at the users of the product and realized that like you, they care about a very responsive system.
Detecting that someone finds the product too slow could eventually materialize a backlog item to make page load times twice as fast etc.