That's the point. The idea of having a "defensive patent" is to avoid having trolls patenting the same thing and then going after small companies with no means to defend themselves in a patent suit. For instance: https://www.x-plane.com/2015/12/patent-troll-update/.

Anyone would be free to use the patent. But trolls can't sue with it.