Because their crawlers get special treatment and don't see the pay wall so they can index the pages and they don't care to double check because they are getting your ad money anyways.