Thanks for the reply. Would you mind being more specific about what specific aspects of the "automated" tests are "automated"?
E.g., in the CoderWall example, is it propagating of the title tag change to all the pages in the test group that's "automated"?
At least to my ears, "automated" suggests that there are tests that are selected and run completely without human intervention. (Which is hard to imagine in the SEO space.) Is that in any way accurate?