During the I-for-get-which war, the army hired color-blind spotters because the enemy camo turned out to be fooling fully sighted people but was less effective with red-green color blindness. I don't recall if it was texture or contrast issues but they stood out against the trees and shrubbery enough to locate.

So we not only have to worry about invisible spectra, but some filters on visible light may reveal the target as well.