It is worse when story tellers come in and hog conversations. It is even worse worse when there are more than one and it is one upmanship on the war stories. Find this unpleasant and tiring. I prefer listening from more people.
I notice other people do this to. And there are even different skill levels to how smooth they can cut into the story tellers.
I was expecting to read "derail" there, but that's not bad either - I mean, it's bad, but in a deranged way ...
On a bad day it will drain my energy to the point where I truly lose most of my ability to function and need significant time to recover.
I figured out that some people are "relators" and some people are "analyzers and askers" and it's usually the latter that is much more fun to talk to. But I know that two "relators" who seem to talk past each other often also seem to enjoy this method.
For at least some of them, that is them relating to the person.