Gestural interfaces: A step backwards in usability
jnd.org
jnd.org
That's a silly, elitist statement. No matter how much testing you do in the lab, the ultimate test is in the hands of end users. Lots of dumb WIMP UI ideas, like modal dialogs, MDI windows, and nested menu hierarchies, survived the labs at Xerox, Apple, and Microsoft, but fell out of favor over years of real user experience. On the other side of the coin, lots of now-popular desktop and web UI elements were conceived by run-of-the-mill developers far from any research campus. As the new-car smell wears off touch devices, plenty of touch UI conventions will get drop-tested in the wild, the stupid ones will get discarded, and the good ones will get copied by everyone and become taken for granted. This will happen far faster in the cutthroat app marketplace, under the eyes of millions of customers, than in any HCI lab.
(I don't know anything about mobile browsers, so the statement may well be false for them.)
He's a consultant. He runs a usability lab. That's his business.
Get it?
This is not a pure critique, although it certainly has valid points. It's a drum-up-money speech. You don't drum up money by saying "Yes, it has these problems, but hey, when personal computers were only 3 years old, we all had to swap floppies to move to the second half of our program!"
Being fair and pragmatic doesn't get you massive clicks and money, unless you are very, very skilled at delivering pragmatic advice in a delicious and entertaining package. (And Norman is not.)
EDIT: And neither does it do to undermine your business by admitting that, regardless of these flaws, people love the crap out of the damn things.
Though in some respects, it is unfair to criticize touch technology based on its initial use in phones, because those screens are small. Some of the article's goals aren't practical on a small screen, e.g. GUIs have "discoverable" interfaces because of always-visible menus, but a phone can't do this without seriously reducing usable screen space.
On the other hand, the touch screen of an iPad probably should fix more of these problems. For instance, an iPad app can probably have a discoverable "menu bar" like a Mac app does, and not really hurt usable screen space.
Because of fitts' law, this was far more efficient than standard popup menus: the 'target' for any choice was larger and therefore much easier to hit.
The gestural part was this: If you held the menu button down and immediately started to move the mouse, it would select the choice without bothering to display the pie. Advanced users quickly learned the sequence of zigs and zags required for their most common menu operations and preferred using the pie menus to keyboard shortcuts or standard menus in the window panes.
As the OP points out, this system provided discoverability as well as consistency. The same gesture always produced the same result.
> (The keyboard does not always appear. Despite much experimentation, we are unable to come up with the rules that govern when this will or will not occur.)
So apparently these 'user interface experts' have been unable to figure out what I and everybody else I know managed to understand implicitly without any particular effort: that a long press is a different action to a short press. No wonder they think it is a poor UI - they must be utterly confused all over the place. But honestly, this is a fairly common UI concept in space / button limited devices. I somehow doubt they are really as 'expert' as they suggest if they haven't come across this before.
They only need a few simple things, like long touch or double click. Anybody born after these conventions are introduced will never remember how they learned them, they'll just be second nature. Early adopters may suffer a bit before they stumble on them.
This technique is pervasive throughout Android. You should try long pressing on every UI element - especially the home button and the home screen - to see all the different actions you can do.
I agree that once the different behavior emerges, it might not be that hard to find the source. But I am not sure - the keyboard never appeared for me because I never pressed the menu button for a longer time. Now I tried it and it worked, but I already knew why because of the article.
In the other hand, I use my iPod Touch only very rarely. I think there is supposed to be some kind of tap bar (I know this from reading about PhoneGap), and I managed to bring up a menu once in a game I have installed by tapping around on the screen wildly. I was unable to bring it up a second time, so no, it is not always easy to identify the source of some activity.
do you mean the "menu" hardware button, or the "home" hardware button?
on android 2.0.1, holding the menu button does nothing. long-press only does anything on the home button (-> task switching). holding the menu button just shows me hotkeys for menu items.
"gestures cannot readily be incorporated in menus: So far, nobody has figured out how to inform the person using the app what the alternatives are."
"Accidental activation is common in gestural interfaces, as users happen to touch something they didn't mean to touch. It may not even be obvious what action got you there. If a finger accidentally scrapes an active region, there is almost no way to know why the resulting action took place. The trigger was unintentional and subconscious."
"When a mouse is clicked one pixel outside the icon a user intended to activate, the mouse pointer is visible on the screen so that the user can see that it's a bit off. [On a touch screen] Users frequently touch a control or issue a gestural command but nothing happens because their touch or gesture was a little bit off. Since gestures are invisible, users often don't know that they made these mistakes."
"When users think they did one thing but "really" did something else, they lose their sense of controlling the system because they don't understand the connection between actions and results. The user experience feels random and definitely not empowering."
So much for innovation.