However, the main reason why artists use pads for drawing is purely for the pressure sensitivity, which means we are comparing apples and oranges. As in, 3 axis controllers vs 2 axis. Without that difference, the counterexample would be less striking, and meaningful and objective comparisons can be made. E.g. between mice, joysticks, or handheld thumbpad sticks. For activities which require both rapid movements and accuracy (which could be aiming in an fps or clicking an icon), mice do tend to be objectively superior, on average. I say / concede this as a full time trackball user (due to ergonomic reasons).
My main point being that some things are generalisable, and the no free lunch theorem doesn't mean that each controller is meaningfully best at some niche.
Most people prefer being able to write directly on the screen with a Cintiq or Surface but separate graphics tablets are still popular. A few people learn to draw quite well with a mouse but for most people using a pen works better.
The main thing though is that as much as you are probably irked by people generalising overly much, I'm similarly irked when people go the opposite direction and generalise too little. It tends to come up on many levels, a silly example being /r/fitness's popular opinion about pushups which goes along the lines of "doing a lot of pushups won't make you generally stronger in the least, it just makes you able to do more pushups", which I'd argue is a needless.
Again, I think you have an interesting point which can be considered further. E.g, why are joysticks and yokes more popular (or thought to be superior) for the controls of real planes or sims?. I suspect the fine control, and being able to separate the axes / operate them more independently likely play a big role. Hence, it's likely down to the task, or rather, groupings of similar tasks.
Familiarity may be a factor in using pens but it's a general human trait that a precision grip https://psychologydictionary.org/precision-grip/ works better for certain types of fine detail tasks. It's not just a matter of familiarity with non digital pens.
Perhaps, hand-eye coordianation training that happens in FPS shooters translates to better touchpad usage in normal cases.
(Still, I'm told that trying to competitively play FPS games with it just sucks).