That's true regarding infringement, but trademark dilution can apply to uses that aren't in competition with or relevant to the trademark holder.

http://en.wikipedia.org/wiki/Federal_Trademark_Dilution_Act