The (Un?)Importance of Design
blog.asmartbear.com
blog.asmartbear.com
There is a huge difference between re-flowing content (as ASB seems to have done) and re-designing/structuring a page (something we're working on with a client right now). If you 're-design' a page and metrics don't change, you know you re-flowed and that's sometimes exactly what you're trying to accomplish (re-branding; increasing existing customer trust/happiness).
That said, we see lots of people on the marketing, dev and design sides of businesses who, like ASB, don't seem to grok that design is about communication and not about colors and shapes. This often leads to re-design that doesn't communicate anything different or differently.
Increasing/optimizing conversion rate is rarely about the layout of content; its usually about the content itself, the motivations produced by the content, the avenues provided to users to engage with their new motivation and the flow/paint. Those who say otherwise are believe in green-button-FTW or think users can be tricked into clicking.
Edit: restructured, expanded.
There's still a lot of other stuff to test on a site, only some relates to how it looks. Things like headlines and images/screenshots can have a huge impact. A nice design gives you a good base to work from, but shouldn't be the end. Throwing in the towel and saying "design must not matter" is the wrong way to go.
For example... their new site has way too much text, not enough visuals. Especially the features page. I would add some screenshots and try to use a more descriptive headline. Instead of "Features" or "Gory details" I'd try something like "We make WordPress run like a well oiled machine".
There's a Japanese word that represents the process perfectly, "kaizen". Committing to continuous improvement will end up in results eventually, fancy design or not. Design can definitely be part of the process, but it's not the only thing to work on.
It's pretty clear that's what he meant, so why quibble about definitions? Jason certainly knows about A/B testing, usability, etc. This was a "coat of paint" redesign, and he was surprised that it had no effect on the #s.
Design can mean so many things these days, it's hard to fault the author or give him a hard time, but the remarks he makes at the end of the post are worth reading. To succesfully utilize design, you need buy-in from throughout the company. What I don't like about those remarks is his approach to design that seems to say it's an all or nothing affair. Design is definitely not an all or nothing endeavour, and you can easily incorporate good design principals, without spending too much time or resources on it.
Also, even though the current design may look nicer, it may have also introduced some new issues such as confusing users with all of the detailed automotive illustrations.