A trademark is more precarious than a patent. If you don't defend the trademark in a timely manner, the infringer can make a laches defense. Unchecked infringement - however minor - can also cumulatively damage the distinctiveness of the trademark, making it more difficult to defend against future infringement.