Page layout algorithm improvement
googlewebmastercentral.blogspot.com
googlewebmastercentral.blogspot.com
It seems like this change is directly aimed at eliminating that tactic...
If they're virtually rendering the page and looking at how much page area is covered by content from known ad networks (including Google Ads, I trust) then that's one thing. If they're looking for lots of nice, Google-friendly text and just discarding images, Flash, etc, then that's another thing entirely.
As one of the sibling comments here mentions, ad detection is a pretty well-solved problem by now, through size, position and origin matches. The interesting part here I think is how they're actually doing the 'virtual rendering' (and presumably, reflowing it for each of their mentioned typical browser resolutions) to check what's actually 'above the fold'.
that said, i recall there was a headless chrome that someone built - anyone remember where that is?
| I wonder how much the in-house expertise of developing Chrome is contributing to the GoogleBot analysis stuff
If anything, I expect the contribution worked the other way, with the rendering engine being developed purely for search, and then fleshed out into a full browser. There was an interesting post about this a few months ago: http://news.ycombinator.com/item?id=3182579Google's objective here is to reduce the ranking of bad quality ad ridden sites that attempt to serve as middle men between search results and a sale, low quality made for adsense sites. Anything google does to help rank these lower is good in my books.
The point is not that sites with ads at the top should be as high in the results as sites without ads, but that using such a high-level heuristic (as they claim) is a poor way to lower (or raise) the rank of a page.
Google could also do a lot more work to show you WHERE on the page your search occurs. That would do a lot more to address the problem than just lowering the rank of pages where your search is lower on the page.
If your primary business model is free content, ad supported, and rely on google as your search engine, you don't have much of a choice.
Right or wrong, your business model is Google dependent, and you are held hostage. If you don't like that, it's time to find another business model.
(Google being a monopoly is another issue, but no search engine is required to carry your content for discovery (yet, who knows what congress will throw at the wall next year))
There is nothing wrong with restricting the design of a webpage aiming for a good Google ranking: as long as it results in better websites rising in the results, it's a good thing.
I can't count the number of times I've googled something, clicked on a promising result and immediately hit ctrl-f to re-search the resulting page for what I was looking for. Often it is either hard to find or not really there in general. Maybe its a link to somewhere else, or a partial text from another article, or simply 5 pages down due to a horrible layout.
Anything google can do to reduce this terrible UX is worthwhile.
For example, the WordPress TwentyEleven theme as seen in http://browsersize.googlelabs.com/ shows the first article header at the 50% threshold, buried below the generous header and image banner. Would a site based on this theme or a similar design face a penalty?
Will this very negatively impact sites such as Twitter's Hogan JS? http://twitter.github.com/hogan.js/
- Open a new tab, google search "credit cards" and...
...all of your results, but one, are ads (I'm using a 11' MacBook air). My suggestion would be to do a tighter integration of Google's website user experience research into their search engine user experience design.