I never thought about that. It's like a "noncentral fallacy" [1] type of argument in a single word!

[1] http://lesswrong.com/lw/e95/the_noncentral_fallacy_the_worst...