Sigh. Yet another otherwise-smart person who appears completely oblivious to the distinction between design and "making stuff look pretty".
It's pretty clear that's what he meant, so why quibble about definitions? Jason certainly knows about A/B testing, usability, etc. This was a "coat of paint" redesign, and he was surprised that it had no effect on the #s.