Name magic.
To know a thing's name is to have power over it.
From ancient mythos to modern specialists and especially philosophy, naming things gets a whole lot of focus. It does because it is terrifically useful! Naming, separating, making distinctions, this is an essential part of understanding.
However a whole lot of these kinds of debates don't acknowledge what kind of a debate they are actually happening. Is the subject of debate the limits of where a definition matches and were it doesn't? Is it whether the subject fits within already agreed limits? Is it really about an unspoken assumption that differs between the parties arguing? Many also don't address the quality of the definition. Is it a useful definition that represents defensible differences between "has this name" and "doesn't have this name" or is it an entirely arbitrary classification (say, look at the color spectrum and define areas which are red and which are orange; now zoom in on a boundary between the two, is there any defensible reason why the border should not be moved slightly to add one color to red? No, probably not)
> I've actually read some debates between linguistics that are quite passionately debating whether something is an allophone of the same phoneme
In this example are they really arguing about the something in question or are they arguing about the definition of "allophone" without realizing it. The followup question is "what is the reason why this edge case is relevant?" and "if this edge case isn't relevant, is the term 'allophone' even useful?"