That hasn't been my experience. When I've done this, I just stopped delivery of all items to my address rather than items addressed to me, specifically. That included all junk mail.
But I agree -- if your goal is to never have mail come to your home, then getting a PO box is the best solution.