Yes, it's not true because what you said is wrong. All a single issue voter has said is that single issue determines their vote. They doesn't say that's the only thing "we" should be concerned about. They don't even say that's the only thing they're concerned about.
Voting is not some kind of distilled expression of pure belief or priorities, it's a practical action subject to tactics, strategy, and trade-offs.