Ubuntu Unity usability testing results and analysis
lists.ubuntu.com
lists.ubuntu.com
I've actually been really surprised at how well the volunteers have taken to using the machines, and how some even seem to prefer them to the tried-and-tested XP installation we've got on other computers in the building.
It helped that we were already using Chrome, Thunderbird and OpenOffice as our standard applications throughout the station - so when I installed the machines, I just stuck big, bold icons for each one on the desktop to make it obvious what to do. Audacity was a new one (we're using Adobe Audition on other machines) but people took to it reasonably well.
Comments I've received have been along the lines of "There's a lot less shit on the desktop than on those other [XP] computers," "It's easier to find what you're doing, and it seems a bit faster too," and so on. For some reason, our XP machines accumulate junk on the desktop, whereas the Ubuntu boxes stay relatively clean!
It works for a lot of our older, less experienced members who find it difficult to find, say, the Thunderbird icon among a pile of old documents and folders on the Windows desktop, or get confused when Start -> Email opens up an empty install of Outlook Express for some reason. It often feels like I spend more time helping people out when something's disappeared, they can't print, they can't find something on a Windows box than actually doing my job, so the Ubuntu machines have been a boost - they seem to just keep trooping on.
Of course, our users are simply booting the machine and opening up some standard applications that also run on Windows, and not going in and changing settings, or anything - I suspect that's where it would fall down in usability.
However, I've tried out recent pre-releases of Unity and GNOME 3 and found them pretty confusing, and I expect a lot of the users who've made positive comments to me about Ubuntu at work would too. It seems like a step backwards to me, with too many unclear mysterious icons, and bits of the UI whizzing on and off the screen while I try to work - and I'm sticking with the LTS at home, and not updating the work machines, either.
If you come to me asking for a reformat job twice in 6 months, you get ubuntu. They never need to ask again after that.
However:
5/11 participants (P2, P3, P5, P9, P10, P11) crashed Unity during their hour of testing. And towards the end of her test, P11 opened a zombie quicklist that stayed on top of everything and didn't respond to clicks.
This ubuntu release is shaping up to be pulseaudio 2.0. I know everyone will just say "use LTS", but somehow debian testing manages to be both more up to date and more stable than normal ubuntu releases. I'm not sure why canonical can't at least match that.
Are you running 11.04 beta2? I've been running it for months now and I LOVE Unity. I installed on my wife's machine, and while she doesn't love it (she really doesn't care one way or another about computers etc etc) she appreciates it in many ways. Though, the best way I can describe my wife's interaction with Unity is she gets less annoyed with it than she does/did with our iMac. True story.
Unity quickly became part of my workflow and improved it greatly. Super-W, Super-# are awesome, Dash is good (not great) and I like that something is built-in to the system that allows me to do basic searching etc (I hope this improves, but initial pass is really quite good). My workflow feels more fluid and solid w/ Unity, and I feel more comfortable, and hence, more productive than when I was in OSX just a short while ago.
And stability is something that is hard for me to gauge as I've been running since January on my test machine and beta1 on my main machine without too much problem. I get some quirks here and there, but nothing drastic. I'm running it on three machines: a mac mini, a lenovo t61p and a lenovo t60p. The t60p is the least responsive (naturally) and that is mostly b/c the ATI drivers are not as good as Nvidia's. The mini and t61p are nvidia and after installing those drivers everything works great.
And to compare, I used a Gnome3 live CD for several days trying to decide if I wanted to install something with Gnome3 (most likely Ubuntu w/ Gnome3 if that was the case, tbh...Ubuntu packaging makes it worth it alone) and while I think Gnome3 is a good release, it can't really compare to Unity. I like where Gnome3 is going, but I don't see it as something that directly competes with Unity at the moment.
I think Unity has a ways to go, but if you compare Unity in 11.04 to, say, OSX when it first came out...by god man, Unity is lightyears ahead in usability an consistency. People tend to forget how rough OSX was for a couple of releases. Apple has their act together now, but it took some time. And I LOVE something like Unity existing on Linux and being FOSS...pushing boundaries...
I've been running Unity for 24 hours now, and I can honestly say it's been the best desktop experience I've had in all my years. Notice I said best "desktop experience", and not "best Linux desktop experience". I have been running Windows since 3.1, Linux since Red Hat 5.2, and OS X since, well, Leopard. Unity is by far the best and most cohesive experience I've had so far. It tops OS X by a wide margin...it has many of the same sort of niceties with window management that actually makes sense (yes, I think OS X window management is horrid). Add to this the fact that it bakes some of my favorite compiz features (grid plugin anyone?) in and I couldn't be happier.
I know there will be some naysayers...many, in all likelihood, but in this daily Linux desktop user's eyes, Unity is a VERY big win for Ubuntu.
Just enabled it. I cannot possibly thank you enough.
Unity is not bad by any stretch, but it feels unfinished to me when I use it. I kept hitting the wrong thing and breaking the flow of whatever task I was doing. I'm sure with some more experience with it I'll quit doing that, but it kept violating my expectations and stealing my attention from more important things.
Gnome 3 was a big change, but felt much tighter and polished. I didn't seem to have to think too much about how to do stuff.
Based on that experience, I think I'd like to use Gnome 3 on Ubuntu long-term.
Also, the statement about Ubuntu being less stable than debian testing. I don't know the GPs specific instance, but Ubuntu has basically made debian a usable desktop.
As I understand it anyway, I wasn't using Ubuntu Desktop by the time the pulseaudio thing happened.
<insert time machine joke>. Beta 2 has been out for a day or so. You could run latest release available for months, but it was not beta 2.
> P1 recovered amazingly well after trying to save "Letter to Mr Smith 08/04/11", and getting the vile response "Error stating file '/home/ubuntu/Documents/Letter to Mr Smith 08/04': No such file or directory"
That's something I'd never consider, what with various directory separators baked into my subconscious.
Just for fun I tried saving a document in Microsoft Office 2007 here with a filename containing slashes. I got a slightly better response: "Ogiltigt filnamn" (Illegal filename). Not as confusing, but still no help at all on what was wrong with it or how to correct it.
I think it's tough to do, but certainly doable. What was outlined in the OP is just basic confusion amongst novices. Something that can easily be improved upon without hurting the experience for 'senior' users. I imagine this is how Mac does it. They throw their software up against the shores of a million and one newbies and iterate until they have a product that they are happy with. Testing is an integral component of UI design & creation, and from the looks of it, Ubuntu is slacking.
This is the difference between products which have undergone long rounds of user testing and ones that haven't. For me this is one of the biggest issues facing Linux based operating systems today, because this is generally not an itch that people working on the project feel like scratching (see: design, documentation, etc.) With commercially backed projects like Ubuntu, it can get there over time, but I would look at a user testing result summary like this and say "we have a LONG way to go" if it was a product that I was leading.
That still leaves me a little ashamed on behalf of the industry. Why should any characters be disallowed?
With silly corporate-ad-campaign-flavored names like "One" and "Me" it's no wonder.
"Calc" is just not a smart name for a spreadsheet application.
> and P7 and P9 thought Ubuntu Software Center was the Recycle Bin.
I understand that, because that is what the icon looks like.
"VisiCalc" was the first one on a PC, "Lotus 1-2-3" became popular later, "Excel" is now the dominant one...
In an office, ask a bookkeeper, sales manager, whomever, "Hey, show me the numbers!", and you're going to see a spreadsheet. If you ask, "Hey, show me the calc!", you'll get a blank look.
Evidence suggests "Numbers" is a perfectly cromulent word.
" Only 2/6 noticed an XChat Gnome notification, despite (1) a notification bubble appearing, (2) the Ubuntu button going blue, (3) the messaging menu envelope going blue, and (4) an emblem appearing on XChat Gnome's launcher. "
I remember about 10 years ago, with the rise of XP and the advent of OS X, expecting Linux desktop to fall ever further behind on a usable & full-featured desktop.
Here we are discussing the usability tests of big UI innovations.
I'd like to thank everyone who got us here! (cough including Redmond cough)
Unity puts everything important on the laptop display in this configuration. That alone is a deal breaker for me.
Note that Ubuntu Classic works perfectly in this setup. My panels go to the external monitor when it's plugged in, and move back to the laptop immediately when it's unplugged.
Unity (as it's currently designed) would pose some serious issues in a dual-display setup even if I could move it to the external monitor. As the launcher is stuck on the left, I'd be constantly overshooting it (laptop display is to the left).
xrandr --output VGA1 --primary
Adapter name may be different on your machine. I have to use it because in my case it always defaults to laptop's monitor.I'm surprised that only 5/10 people tried to open another Firefox window by clicking the launcher icon. Personally, I think clicking the launcher icon not opening a new window is silly, but that's because I'm used to Windows 7 and not OSX.
If anything, this was overtested. There's a lot of redundancy in those results, just as Nielsen would predict. This is not a scientific experiment to determine the effect of a drug, and you do not always need or even necessarily want a 95% confidence interval, as the costs would exceed the benefits here.
Helps so devs can't reply, "Well, that guy was just stupid".
I absolutely HATE the fact that when I click an running application's icon in the taskbar in Windows 7 it only sometimes makes that application active. If the app has multiple windows (sometimes tabs) open, it shows a list for me to choose from. That sucks as it requires more clicks, just show the last used window on click of the taskbar icon,on hover show that list of open windows/tabs. OS X got this right (even though they make all of the windows/tabs for the app come to the front).
I could see myself using this version of Ubuntu. The very first thing that I noticed is that they managed to get rid of the fat-tipped cursor pointer. The os over all looks good and smooth, a lot like a website, I'd just like to see a more dock-like experience with the unity bar (move around, resize etc)
ehhh, I hate the hidden options on the title bar (file, edit, etc) not a big deal, but could be confusing to someone
- Make the launcher always on by default
- Remove the recycle bin icon (I really don't get the point of it)
- Remove the applications icon (redundant with the Ubuntu button). Perhaps add a "System" lense view instead (system settings and all that).
- Add an "expose" icon (super-w). And perhaps hide the workspaces icon by default.
Is it so you can find docs that you "deleted" by accident?
I personally think this is almost definitely going to end up as another Pulseaudo-style debacle that'll jade even more Ubuntu users. This kind of stuff is exactly why I never recommend Linux to friends, even though I personally use it on my day-to-day machine: because it's just not (crashwise) stable enough for Grandma, and Shuttleworth has a very bad habit of making his end-users his beta-testers. Grandma isn't going to loyally log in to Launchpad, report a bug and reboot; she's going to complain to me, and then I'm going to reinstall Windows 7, which for all its faults at least doesn't crash once every two hours.
Seriously, I install LTS for several things: servers and non-techies. Why? b/c I view non-LTS releases as awesome for me, you, people on this site but not for my grandma.
What I've seen Ubuntu do is they have given people who want to be on the bleeding edge a way to be on the bleeding edge every 6 months, and that is freakin' awesome. But if you don't want to be there, and frankly, most people don't, they give you an LTS and 10.04 is a pretty freakin' good OS for people who check their webmail and need a writer/spreadsheet with minimal fuss.
Using this model, it is the best of both worlds.
Ultimately, flexible package management is what keeps me using Gentoo and dabbling with Exherbo, in spite of the fact that I don't really want to tinker with my OS anymore.
https://help.ubuntu.com/community/FirefoxNewVersion
Seems perfectly reasonable, and more importantly, prudent given the LTS nature.
To summarize:
* FF4 is available in a PPA right now - ppa:mozillateam/firefox-stable * 10.04 will continue use FF3.6 in main as long as Mozilla supports it (probably about 6 more months) * Once mozilla stops support for 3.6, 10.04 will switch to the latest stable (if that is FF5, that is what gets installed).
Seems very reasonable. Imagine if you are a huge corporation and you standardized on Ubuntu 10.04. Would you want every package to get updated to the latest and greatest each time it comes out or would you want security updates to those packages? If you want latest and greatest, jump on the 6 month cycle. If you want to get security updates for a known system, stick to the LTS. Even so, for those that WANT to get the latest of select packages, there are ways.
So, if you feel that having the latest and greatest for your users is important, stick to the non-LTS cycle and pick it and go. You can also install 10.10.
Have a look at the EOL dates...you can use 10.10 with full support until April 2012, getting you through 2 more Ubuntu releases and to the next LTS.
If you don't have an OpenGL based video card ( no ARM machine does, they all use a subset of OpenGL called OpenGL ES ) then upon logging in, you get a long dialog explaining that you need to logout and choose classic desktop. And it has an exit button. When you click said exit button, after a bit it loads the classic desktop, however the xsettings manager doesn't get started (or it might, just depends on if it feels like running it seems) and gnome becomes very ugly.
There is no mention of Unity-2D which is a version that is QT based. And it suffers from the same issues, xsettings may or may not launch and then you have a ton of dialogs about apps crashing in the background ( this is with either Gnome "classic" or with Unity-2D ).
Ubuntu made great strides in making the Linux desktop accessible for everyone, but this latest release shows just how much further they need to go.
Keep in mind that at the time the decision to write and use Unity was made, the Gnome 3 desktop was in an absolute mess. A lot of work has happened since then and it would be even better if Mark Shuttleworth could swallow his pride and just scrap the Unity project and work with upstream like before.
I mention the ARM bit at the beginning of my statement if only out of frustration due to the fact that our company provided Ubuntu developers with over 50 machines that are in either a desktop configuration or netbook yet it still doesn't run anywhere close to where it should on them.
Anyone?
http://chemicaloliver.net/linux/ubuntu-unity-on-eeepc/ and http://www.greenhughes.com/content/samsung-nb30-touchscreen-... look quite different.
Then, once the drivers were in place, I switched to Unity and was initially really wowed by the way it looked. I really like the idea behind the side menu but right now it is a bit finicky. Sometimes it will partially open when I move my mouse to the edge and other times it works just fine. I absolutely hate the launcher menu (might not be the right term - app drawer or whatever else might be more fitting) simply because it makes it a chore to find applications.
I've also found Unity relatively unstable. I've had it simply lock up and I haven't found a way to get around it other than resetting my computer.
Even stuff like the way moving a window to the edge of the screen and it taking up a portion works seems inconsistent. I can sometimes get 1/3, sometimes 1/2 and sometimes 2/3 but I honestly haven't spent enough time trying to figure out why it works in different ways. Nor do I feel I really should have to... UI should be relatively intuitive.
Anyway, I think Unity is promising but it is really rough right now... really rough.
I think that Unity is great! Really encapsulates the spirit of a netbook - a small, versatile and fun communications device. I have an asus 1005pe - which I can also highly recommend.
If you press them very quickly, say 'super+D', then it will take to desktop and open dash as well. To be safe, you have press 'super', wait till numbers appear on the icons in launcher and then press 'D'
Really?? You are surprised that the test group didn't somehow magically discover an edge case in a feature they didn't know existed and has no discovery mechanism?
It happens to me 90% of the time I use super+d.
The solution is to call it the Windows key as 95%+ of Ubuntu users will know it as that and have a Windows keyboard.
I'm pretty sure Ubuntu adoption rate isn't affected in the least regardless of whether you call it the Super key or Windows key, or Logo key, or any of the other names it's gotten over the years. "Normal people" don't ever use that key anyways.
2. It's not about adoption. It's about usability. Everyone will know what you mean if you call it 'the Windows key'. The same is not true if you call it 'the Super key'.
While I'm sure I'm in a minority, it is always something to consider when writing shortcuts to consider that people may not have a key available.
I haven't tried recently but last attempt I believe alt+f2 did not work as a "run" dialog