> full-text search of 20MM PDFs at our traffic levels is expensive to operate
Why not do a free full-text search on the abstract or first couple of pages (or few hundred words)?
This might make the premium search upgrade more subtle but I wonder if it could help the majority (?) of legitimate searches get the hit they expected/hoped for.
... Perhaps this would appease the haters?