Don't Waste Time on User Onboarding
greaterdanorequalto.com
greaterdanorequalto.com
My solution is, just as the article suggests:
> Okay, so your service is immensely easier to navigate since you ran it past a battery of theoretical users. Now cut half of it out.
Perhaps that applies no matter how big the app gets, perhaps a simple UX that hides the power tools until they’re called for is the one true way. On the other hand, virtually every time I’ve faced a user saying “$App should perform $Task”, it already does. Sometimes the app doesn’t have a particular feature, but the virtual assistant of the OS does.
What’s the best way of helping those users discover those features?
Before onboarding our cohort retention was 2%...after 1 week.
This means that after a week only 2% of our users came back to use the app.
After a basic onboarding we jumped to 10%. We're now at about 14-15% (just via improving the app).
About 50% of our users completely skip the onboarding altogether.
I think I'm going to experiment with a video instead of a tour to see the difference.
How is this different than when you had no onboarding? (serious question) Did you make other changes that made the onboarding process less important to end users?
I'd consider Polar a success of "adding onboarding when ready." I just don't want people to consider onboarding as the first and only tool to reach for when trying to fix your Trial-to-Paid Conversion issues. There are a lot of other useful tasks you could - and frequently should - be working on as well.
Presumably the user group you've self selected into also has a retention rate that is 20x lower than those that don't skip the on-boarding.
Of course none of that matters because it makes another tiny, self-selected group considerably more money.
Keep it simple and only use onboarding if your app is truly novel.
Personal anecdote:
We were evaluating Cisco AppDynamics last year as we were in the market for an APM product and, unfortunately, we are a huge Cisco shop. They wanted to hold our hand and walk us through everything, and the product was certainly in a state where I can't blame them - the agent sucked to deploy, they had a nice little UI to configure things during install but after that it was all editing XML. Sure, I could automate it all with Ansible - but you could tell they knew the UX sucked and they just wanted you to get through the onboarding quick and hope you didn't notice.
We ended up purchasing Dynatrace instead, I started a trial with no intervention from sales reps. They made their happy onboarding path a "game" (they have "quests" in the UI to guide you through the various parts of the product) but otherwise threw you right in with no handholding. The agent was stupid simple to deploy (here's a manifest to deploy to OpenShift, here's a .msi to install on Windows) and it picked everything up automatically and started working. Figured everything else out by just playing with the tool, with the docs as an aide.
// End anecdote
I think onboarding has a place, but it shouldn't hold a user hostage. I really liked Dynatrace's approach, especially as the "quests" were covering different components of the product and could be tackled in any order - they also weren't guided tours but instead directed me to investigate other parts of the tool and perform certain actions, even providing a carrot (free credit) for completing them.
There was never an enterprise licensed software that didn't involve multiple meetings. The software was the same software we had already integrated in the development environment, we just needed licenses for production. Didn't matter that we'd been using the software for ages, they still wanted to set up hours of meetings before sending us an invoice.
That said, traditional onboardings have their place, for example to introduce new features. Even if you skip them or click through and only skim it, you might still pick up enough of a heading or illustration to make it easier to figure out why things are different.
Exactly one, actually..
RoomieMatch.com. Shoutout if you're reading, dude/dudette.
Many companies also have a one-size-fits-all approach to onboarding, where they send the same messages to all users, regardless of their in-product actions. Instead, it's better to trigger relevant messages if the user has taken a specific action and hasn't taken the next step to achieve Y result.
You can always send onboarding sequence to users who haven't taken any actions at all.
It should also be noted that for some established companies, a lot of their onboarding isn't necessarily to educate you but to force you to take certain actions that their testing has shown will make you active. For example, Pinterest forces you to follow certain topics when you sign up.
Then you have someone review and annotate the videos. Where did people get stuck? Where did they back up? Where did they give up? Put together a highlights reel and have the developers and managers watch it. It's usually obvious by that point what's wrong.
The problem comes in the fact that it's really hard to identify what X and Y are - there's some voodoo involved in properly attributing actual reasons for not converting a trial.
This is why I like the idea of going immediately paid with a very-long money-back guarantee, though that comes with its own optimization problems.
In your example, the Y% of people you might lose if your trial is too short may very well turn out to be higher paying and/or lower churn customers. What you suggest in your post is the marketing equivalent of sales and support ignoring the colloquial small fry, without realizing that the latter might be sitting on company boards and referring large clients.
Also, if they bookmark the service until they can set aside a time to sign up and evaluate (which as an occasional buyer of SaaS products, I can anecdotally report that some do), you'd have no way to reach out to them and build a relationship unless they contacted you.
By contrast, if you have a free tier, and/or make it clear from the outset that when your trial expires you'll be able to do new ones when the product hits major milestones, then you have the end-user's email, you're building a relationship, you can interview the end-user to understand why they didn't convert, you can try to rescue trials that didn't move forward with a sale for a reason or another, etc.
I think the best advice for me was "Add sample data to avoid an empty nest." I just realized that my product has this problem, so I'm going to be adding some sample data for new users. I think I'll also have a toggle switch so you can easily hide all the samples. (It would be annoying if you had manually delete everything.)
Concierge setup is also a great idea, and I've recently been offering that to new customers.
I respectfully disagree with that view and I say that as someone who has implemented a product with sample data during the onboarding process.
Users don't care about your data. They care about their data. The easier you make it for the user to input their own data and get some value out of it...even if its something trivial...the faster they'll be able to relate their problem to your products ability to solve it.
In general though: most onboarding I've disliked, too slow, but some with "click here to do this, or elsewhere to end the tutorial" have been good.
So instead of "0 photos" and a blank page, it could say "Get started by [uploading some photos]".
I really like this approach because the use case for products like these varies from one client to another. Just throwing in some demo data that's always the same wouldn't really help everyone.
What users actually want is a quick way to work with their own data.
A specialized "first launch wizard" that makes entering inital data really quick and painless is often a better choice.
It can also make sense to allow trying the product out with existing data, but for this I would offer a "demo" mode where you get bootstrap data, can play around with it, and have a big banner on top that allows launching the real thing.
This depends on the product of course, but I prefer those two options above.
Learn by doing, not by learning.
But yeah, many people only get a first run. You have to obsess over it, because if that doesn't work for you, it can be like pulling teeth to get people to come back.
If we're talking about an application that requires a lot of outside knowledge (e.g. GIS (Geographic Information Systems (mapping)), accounting, video editing), you're not going to be able to "teach" the user what they need to know in the UI or some short videos.
In one case on-boarding is a symptom of a bad UI, in the other it's more-or-less useless.
"They don't reach me, I reach them."
The ads are blocked until then.
I don't find out about them then, and my savings and 401K continue to grow unabated. Maybe I'm missing out on cool stuff, but assuming I never found out I was missing out, then my life isn't impacted negatively regardless. I don't really know what an "influencer" is; is it the internet equivalent to the ShamWow or OxiClean guys?
I have 0 tolerance for people or companies actively telling me what I should buy or like, and distrust anyone who does so.
I like hearing about cool stuff, I like sharing it with friends. I like style, looking fashionable, and being apprised of trends. I don't plan to die with savings.
You wouldn't trust me, because I often tell my friends about things they should know about; not because I have anything to gain, but because we all do this in all of my social circles. If I hear about a nootropic they might like, I tell them. If they know of a bar I should try, they tell me.
I like a lot of ads because I like knowing what's going on in the world. Even in a post-capitalist Star Trek world, I'd want people who made stuff to tell me.
Neither way of living is wrong.
I tend to by generic/commodity items over brands, but there are some notable exceptions.
I pick my groceries by checking the grocery ads and seeing what's on sale.
I don't think I've ever clicked on a search ad or a mobile ad except accidentally.
Concerts and stuff I learn about through ads.
It's kind of an eclectic list, I guess, but ads do seem to serve some purpose. I'm just hard to reach via them unless I'm going looking for something.
Not trying to put words in your mouth, but are you offended that the company spent money on a promoted tweet? That it was an overreach on their part?
Blocking the company stops the tweet appearing everywhere I see tweets. That's on my home computer, laptop, Chromebook, office computer, my phone, etc. It continues to block the ads from that company if/when Twitter work out ways around ad-blockers. And it makes me feel like I'm proactively looking after my account.
I use ad blockers as well.
are you offended that the company spent money on a promoted tweet?
I just find that Twitter promotes the same tweets over and over again, so if you don't block them it gets very repetitive. If I was actually offended I'd reply first so they had to pay for an engagement as well as the promotion.
I don't care about the business model of the whole internet. It is obviously a house of cards. A business model based on bad UX? I hope it collapses.
No, I don't know what will replace it. I don't care, as long as it doesn't involve ads.
I really don't care if the ads are innocuous or labeled or relevant. I don't ever want to see an unsolicited nudge to spend money on something. Ever. I can't be any more clear than this. I hope there are more like me every day.
I don't care if your ad is clever, relevant, organically sourced, environmentally friendly, necessary for financing your product, something I actually want, need, or didn't know I wanted yet.
The internet is plagued with this cancer everywhere you go, no matter what you do. Somehow it's become acceptable that every second of our attention and time is competed for by corporations trying to sell us things.
I simply do not want to see ads, ever.
I see it as exactly at odds with what I'm trying to do with my life and my attention. I do not consent to have my time and attention taken from me in this way.
Yes, I am a free rider on much of the internet today, such as it is. That the entire internet is based on this absurd proposition is a symptom of its rapid growth and industries going after the lowest hanging fruit. I am confident that the internet will find another way forward.
It's never "just" an ad. Like the way you see an ad in a newspaper. It's the spyware that comes with it and the fact that tons of them are animated!
And yes, I consider it spyware and virus-like behaviour to track me wherever I go and I will actively do what I can to stop it. Even if it means you don't get paid... you chose that seedy medium to make money, not me. It's not my job to validate your business model.
By all means block me. I will go elsewhere.
Browsing the internet without an ad blocker is actually impossible for me now... whenever I rebuild a machine I have those few hours or so before I get the ad blocker installed where the internet is a horrific assault on the senses with everything trying to steal my attention away from the thing I am there to see and slowing down the page load (significantly in some cases)
I still remember when plenty of the internet was running fine from hobbyists and whatnot without resorting to ads and tracking... it costs practically zero to run a website (granted, at scale it's a whole other ball-game but how many people have that problem?)
The internet would survive fine without ads. It would have a different mix of behemoths and hobbyists sites but it would survive just fine.
That being said... I do remember trying to punch the monkey to win :D
Edit: added stuff for clarity
Ads wouldn't be there unless they work for the advertiser.
How else would people learn about it? Turns out, if you don't talk about it, very few will come...
I think this is why HN has a lot more goodwill towards self promotion (Show HN style posts) than a lot of other communities (reddit notably, depending on the sub). Entrepreneurs know that advertisement is a necessary part of any business.
I think we mostly appreciate the need for the so-called "getting the word out there", but it ought to be done in way that's appropriate. There's a balance to be made between the potential value of a product, and the amount of attention you're trying to steal. Most people think the products they make are more valuable than they really are.
What about a set of sponsor logos at the bottom of a webpage that let you visit the companies?
If you're just getting folks on facebook to promote your products in the hope of some minor dispensation or something (a popular gimic these days). That's easily identifiable and blockable.
For example if you read a tutorial on how to build a weather station and the author provides referral links to a component on Amazon, I'm happy to use those links.
Referral systems are open to abuse though, like the myriad of ultra specific comparison websites with tenuous "expert" reviews.
There's no reason that most ads couldn't fit this model, but due to greed and laziness they mostly don't.
A lot of those referral links do have logging (seeing who visited / hoe many people have) and tracking (general location, some demographics). Is that okay to you?
I'm fine with a site owner knowing their demographic. That's potentially useful for other things, eg should you invest in localisation? Otherwise unless you have a vpn, your IP is going to be visible anyway.
It probably depends on the referral site. For example, do Amazon have any reason to sell my data to anyone else? It's most valuable to them and they already have a decade+ of purchase and browsing history.
I still think this a preferable situation to targeted ads which try to guess what I want.
Ads aren't just the business model of the internet. They've been subsidizing human interaction since ancient times.
That makes perfect sense!
Sure, some of it can be puff-pieces for the company and they are quite clearly just bullshit but it's easy to leave and go elsewhere if they take the piss.
A banner at the top of a blog post saying "this content was kindly sponsored by <insert company relevant to the content>" is a great idea and more should do it.
But they don't!
They use ad networks that track the ever-living shit out of every move you make.
That's the issue for me!
I mean if your product fills a unique niche it should be really easy to rank high. Get your first few customers like that, then because your product is revolutionary, word of mouth will do the rest.
A real-world example: Monzo, a modern bank in the UK. They only very recently started using advertising, but got their first million customers with nothing but word of mouth. Their secret? Simply making a product that's light-years ahead of what the existing banks provide.
Your product is not revolutionary? Oh then I don't know (actually I do - make a revolutionary product - switch industries if necessary), but you're not entitled to waste my time, attention & privacy with ads just so your business can survive. Being profitable is not a right, I couldn't care less if you go out of business.
All those things are acceptable to most people who block ads, IMO.
If someone doesn’t want ads in their life and Twitter provides a tool to block them, why wouldn’t that person use the tool?
I'll pay for them on the long run. For me, the CPC cost will make it worth.
There are also other ideas, like launching an affiliate program, app marketplaces.
Look at where the traffic is in your niche.
Wofkflow breaking UI changes are always hard and there's always someone whose use case [you're breaking](https://xkcd.com/1172). Then again, you can't please everyone and it might hurt to stick with older decisions.
Onboarding itself is extremely valuable. No application is so self explanatory that everyone gets it without a guide. When should you onboard then? I'd say when you're sure that you're not doing any major changes within the next few months.
All UIs can and should be iterated upon and it helps if you have a timeline on when you're upgrading which views and components and it'll help you decide when to launch the initial onboarsing process.
As a user, I find them extremely annoying. They stop me from achieving what I want to achieve and I try to get rid of them as quickly as possible. I also find them as the hallmark of a bad UI -- if you have to tell me how to use your product, then it's not well designed.
VIM users, licensed drivers, and pilots would disagree. Powerful tools require training. If you're pushing an app that I'm already familiar with before I've ever used it, then you are obviously not innovating.
"Onboarding" is something that happens quickly and right at the start -- OP links to blogs about building those screens that block the whole UI and point out some buttons. It's something that isn't meant to be all-encompassing. It's something to point out things you wouldn't expect. (That last bit is why I dislike them so much.)
"Training" is something that isn't expected to be fast often continuous from the start. It's meant to be fairly encompassing, as in you should be pretty well versed in something once it's finished -- not an expert, but some experience and understanding of the whole. Training is meant to include things that aren't obvious/you wouldn't expect (e.g. steer into a skid), but is (and I would argue primarily) about building a foundation for the UI and for further training and learning. Training also includes practice.
Yes, vim has a learning curve and breaks what has become the current UI paradigm. However, I'd argue that unless you're just using vim occasionally, you need to be "trained" on it, not "onboarded". That "training" starts with getting the user to understand the UI paradigm, which isn't expected to be quick. By the end of vimtutor, for instance, the modal paradigm and the ability to chain commands together should be clear and practiced.
Driver's licenses take at least 6 months and both a written and practicle test to get initially. Commercial licenses require training from accredited institutions. There is no expectation that this will happen quickly. Driver's training includes practice study (e.g. driving with a licensed person present). Driver's training also included a study of the UI (e.g. signs of similar styling convey similar information, for example green is an information highway sign, white, tall rectangle is a speed limit, and yellow is important such as exit only lane) which is partially tested in the written exam.
Ditto for powerful tools, you're not expected to be told "this unmarked button does this" and be left to your own devices.
These aren't things you could ever "onboard" someone to do. They require actual training.
> If you're pushing an app that I'm already familiar with before I've ever used it, then you are obviously not innovating.
That's very judgemental -- innovation doesn't mean confusing the user. Did Google's original/classic UI mean that it wasn't innovative?
There are applications that I would argue require "training", even if of an informal type. This doesn't mean that someone couldn't poke around in the application and get something done, but they probably won't be able to exploit the application to its fullest. Two example: GIS tools (i.e. require knowledge _about_ GIS, _about_ projects, _about_ UI and spatial concepts) and Video/Photo editing software (i.e. channels, color spaces, types of transforms, &c). Again, you can open QGIS and GIMP and do something meaningful on your first time, but that doesn't mean you won't feel lost or that it'll be easy.
Learning vim can be done quite safely by trial and error, then googling for how to do specific things when interested. The other two, not so much.
So unless you’re product has a risk of death or severe injury then I will agree that it shouldn’t need training.
About planes. Unlike cars, they don’t have a standard cockpit layout which leads to lots of bad design In my opinion.
The difference I think it's the novelty of the new environment and a sense of accomplishment that it rarely is a chore. So go ahead and on-board if the user gets to see something very cool.
If you e.g. design a software for electronic circuit design, good user on-boarding will allow you to highlight specifically why your product shines in comparison to other products.
Another objection: some “products” are specifically meant to work for power users and a increased software complexity can increase the working speed and power you give to the user at the cost of making it harder for new users (e.g. vim for text editing).
Of course if your product is the equivalent of a egg timer, it should be 100% self explainatory. And even if you do a electronic circuit design software it is always good to keep things self explainatory where you can.
But sometimes you have to explain things in order to equip your users with a new, innovative and powerful concept they might never heard about before. Removing that concept to avoid complexity could them be akin to changing your target group. You can fl this, but it needs to fit the concept.
Oh and sometimes you can just do both. Give your app an expert mode.
Most of the onboarding I've seen clearly has some real thought put into it, but it still feels modal.
They usually involve widgets that pop up and must be dismissed. Often they pretend to not be modal by not covering the screen, but I assume I have to chase them down and make them go away.
At my job we made the product more complex and in rushing to release it, we didn't include an onboarding process like the old one. The new product ended up winning the AB test in conversion.
As a follow up, I did a 3 way AB test that included the original product without the onboarding process.
What I found out was that the original product without the onboarding process performed just as well as the new one. It was the onboarding hurting our conversion.
We originally thought those extra steps helped the user make a decision but it just made the product seem more complicated and lead to analysis paralysis.
I work with a product where the end user is ... shockingly luddite. I suppose everyone feels that way but these end users are very very easily intimidated even with little changes.
Accordingly it doesn't matter how much I think something is simple, it matters what they do and what they're intimidated by. I could make the best super cool web app ever, but if they don't use it / effectively it doesn't matter and becomes a headache for everyone.
His teardowns are particularly valuable to see how others do things and what does and doesn't work. Plus they're entertaining.
I'm fact the article gives a lists several things you should do to onboard customers.