I agree, that's also an important part of their hook. But the sort of weird look is I think the main one because it's immediately visually noticeable. People make shoes that look like that now but they didn't before Toms made that look popular.

The reason the weird look works so well with Toms is because of the Greenbeard effect: http://en.wikipedia.org/wiki/Green-beard_effect