And how 'easy' is it? How do you handle changing inventory? Running out of materials? Are you ADA compliant? How many languages do you support? And so on.
Go ahead, try to mock up an ordering app for a coffee shop that gets different pastries in each day, have an ever changing offering of beans, and each customer has a very particular set of desires for how their coffee is made. Make it work for the Spanish woman, the blind child, the teenager in a wheelchair. Get it to answer "which pastries don't have eggs in them?"
Because most people would rather deal with people than with machines, and thus replacing all human workers with machines would be bad for business.
Here's an example I see every week: Automated cashiers already exist - they're called self-checkout scanners. In the supermarket where I shop, the lines are always shorter (or empty) at these machines because most people prefer the checkout lanes where there are human cashiers. (I prefer the machines, but I'm definitely not a representative member of the population.)
Another example: It's nice to go to a place like Starbucks and get greeted by a friendly person who remembers you and knows what you want. Being recognized by a machine doesn't have the same feeling.
And lots of people go to financial advisers because they're unsure of what they should be doing and want reassurance. I don't think machines are very good at being reassuring yet.
Some day when all the items are RFID tagged and I can just walk right through the scanner--that will be an amazing day.
I think we're more likely, though, to just do all of our shopping online and have it same-day-delivered before then.
http://www.tesco.com/scan-as-you-shop/ is one example
You're right, automation is scary. As a blogger, I always thought it would be cool to have as much automated tasks as possible, especially in those dark corners of content. I'm okay with admitting that I was wrong. You as a person can come up with a lot better solutions, not to mention that it's hard to teach emotion to machines.
Sorry if I got the wrong message, this kind of just blew out of my brain.
So: relax. Automation is coming. In many areas, it has already arrived, and now it's just a matter of time for the effects to percolate through the system and for it to become commonplace.
Also don't forget that this is partially a political issue, as automating these things requires changes in legislature (see e.g. self-driving cars). The political ship turns slowly, so have a bit of patience.