Apple iOS 13.1 Personal automation via Shortcuts
support.apple.com
support.apple.com
With this update, Personal Automations for me at least opens up many possibilities by removing so many limitations. Such as now when connecting to CarPlay you can automatically trigger workflows like opening Waze in background for alerts, getting directions to your next even that has a location, asking if I have kids in the car, if I say yes, play kid friendly podcast station, if not play my other station, and so on.
There are still so much unmet potential. Core apps like Apple Podcast have so few actions compared to third party options, which is very odd. And then other third party apps that would so love to have certain actions offer none at all.
So hopefully with the Personal Automation people will use it more, and with that use, Apple will offer more actions for their core apps causing more people to use it and then eventually more third party apps to offer actions, and then hopefully Apple offering a dedicated app store section for them for true mass appeal. Of and of course having it available on macOS (replacing Automator) would be wonderful since writing more complicated scripts is much easier on the Mac.
As you point out, there's unmet potential. So many times I go to create a shortcut, "surely they have an action for $FOO, it would be one of the first things I'd implement", and...no. But it's getting there. Maybe not this year, but I hold hope that Apple will keep at it and in the next year or two this feature will start to open up.
I can see why Apple would want to step cautiously with consumer-based automation, but I was really expecting that all of these new automation triggers would fire without needing any manual approval, or at least that there would be a way to configure them to do so.
I have read that you can use a HomePod, Apple TV, or always-plugged-in iPad as a home hub, and my understanding is the triggers offered here will run in a fully automated fashion. I hope to explore that at some point.
Still, I'm very happy to see the progress in Shortcuts, and I expect it will only get better.
https://support.apple.com/guide/shortcuts/enable-or-disable-...
All of the ones on the "cannot be run automatically" list are things that a bad actor could do if they had your phone, like wait for a certain time of day, or move your phone to a specific location, or bring it in range of a particular bluetooth or wifi device.
But then, NFC is on the "can be run automatically" list, meaning that a bad actor could touch your phone to a NFC tag to trigger an action, so that doesn't make much sense. The rest of the items on the "can be run automatically" list are all ones that require your phone to be unlocked (I think).
Very odd choice by Apple for something that will be used by relatively few people and would greatly increase the usability of the feature
Passive automations based on location, bluetooth, wifi, etc. stand a good chance of many accidental triggers. Connections are flaky, location accuracy is flaky; without some form of throttling mechanism or way to better control accidental firings, it should remain manual.
Hopefully they'll have the notifications there, if they don't already.
Apple could do something like that. Probably a bit more sophisticated.
Try home assistant. Open source. Integrates with nearly everything, including apple homekit stuff.
Say for example someone setting one up on someone else's phone (without their knowledge) to run every X minutes and using it to track someone's location, without them ever knowing about it.
I'm not entirely sure that's the real reason behind these notifications, but it does seem plausible.
It would be nice if these automations could run automatically but perhaps, notify the user that said automation has run and allow them to easily disable the automation.
Location accuracy isn't always the greatest, particularly indoors; in-and-out connections to wifi/bluetooth are possible when you're on the fringe of its range.
These issues need to be addressed in some form before _true_ automation is given to them.
"The shortcut 'Foo' wants to run. Do you want to allow it?
- Never
- Not this time
- Run once
- Always"
Put an icon next to each shortcut showing whether it's always (or never) allowed, and it seems like the problem would be largely solved without asking much from the end user.
What you want to do is periodically (at a random time each time) ask the user if they still want it to do the privacy sensitive action still. This way, it vastly increases the chances of detection if the action was added by a third party.
They could also do what Gmail and possibly others do when forwarding is added. An obnoxious red colored warning at top of Gmail for 7 days about new forwarding. iOS could do that in some fashion.
• "Wi-Fi" and "Bluetooth" connection triggers are extremely susceptible to bouncing on and off with variable radio conditions
• "Arrive", "Leave", and "Before I Leave" are all susceptible to bouncing in and out; they combine a fuzzy location of variable precision with a point and radius
By requiring a user interaction, it makes sure that bouncing never causes the shortcut to trigger more often than desired. Apple certainly tries to debounce the event automatically, but that comes with other side effects: the trigger can be delayed significantly and unpredictably.
(As for why "Time of Day" requires a user interaction, I have yet to hear a satisfying explanation. I want my Cron!)
Obviously you're not going to be able to write a GPS specific enough to detect which room you're in, but that's expected.
Sometimes GPS thinks I'm in my neighbor's front yard across the street, or in my neighbor's backyard behind me, even if I'm in my bedroom.
If I stop at my neighbor's house on the way home, it could trigger an action in my house, for example.
Although I'm firmly in the iPhone camp for privacy and other reasons now, I miss the automation provided by Tasker and the Android OS.
I used to have many useful location + time based profiles. For instance, I had a profile for if I was at home and it was between 9pm and 7am, Do not disturb mode would be turned on (which still allowed 'emergency' calls) and i would switch to a dimmer screen brightness profile. If I was at work, my media volume would be put to 0, phone would change to vibrate, etc.
The point is, many repetitive tasks were easily automated on Android and it required ZERO interaction from my end. No shortcut button press or anything. Smart phones should make our lives easier.
It was yesterday, sure. But what I haven't heard is, "but it's still missing...". All I've heard so far is, "what took so long? Android...". Which I suppose is a valid complaint, but I thought there might be more.
Take a look at how many apps support Tasker vs Shortcuts:
https://docs.google.com/spreadsheets/d/19q_jvRRM4htT6-9QTX6m... https://airtable.com/shrNcsx3n8uUajpsW/tblv8ai4KM1YZ4LgH/viw...
Now consider how much older Tasker is than Shortcuts.
Imposing a universal standard across your platform is a very effective model.
For fun, I created the Martin Luther Insulter shortcut[0]. Say, "Hey Siri, have Martin Luther insult me", and it fetches the list of insulting quotes from Martin Luther's books via GitHub, then reads the insult back to you in a dark, slow raspy voice.
[0]: https://shareshortcuts.com/shortcuts/725-martin-luther-insul...
Example: https://cvws.icloud-content.com/B/AZc9tIA45EozUwn3Zs0zZEJSUY...
I'm racking my brain for something that would benefit me, but nothing comes to mind... but I feel like I'm just lacking creativity here.
Of course, everything shortcuts can do can be done manually, but for some I think it can be worth it to automate or reduce the workload of a lot of menial tasks
Another I have is "Hey Siri, heading home" which texts my wife my ETA and starts my last played podcast.
https://www.macstories.net/stories/beyond-the-tablet/8/#cont...
https://www.icloud.com/shortcuts/5f95b87eba6544929fb2a40b72c...
- "gas prices" pull up the gasbuddy website, regex the first element and get siri to read it aloud.
- "going home" Uses maps to obtain how long it takes to get home from my current location, sets the volume to 70% to get siri to dictate it, and sends the ETA and a nice message to my +1 that i'll be home soon. Version 2 will be to prompt me when I actually leave the GPS of my office around 5-7pm and send it after verbal confirmation. (Barring if there's a pop up that has been mentioned)
- "Share Location" this is one of the ones available in gallery that let's you send people your current location. I hope they make 'Share ETA' available but I don't see that option in maps yet. That would let people know when i'm arriving at their house.
This is fun enough that I'm hoping to buy some NFC stickers and get some homekit devices to play with.
As for Personal Automation, I've heard others text their spouse every day as they leave work. Now they can do that automatically with an ETA.
I say "Siri, record my weight" and the iPad response "Sure, how much do you weigh?" I say the number and it gets appended to a Google Docs spreadsheet with the current date.
The next step that I never finished was to have Google Docs generate a graph and mail it to me every month.
Now I can run Terraform automatically when I get home to provision some tea! /s
* Sets dark mode * Sets reduce white point * Runs a shortcut I made asking me a few questions
The questions are:
1. Will you get ready for bed? Sleep affects your next day. (I have to click yes/no) 2. Will you go brush your teeth after this? (The first step. I have to click yes/no) 3. It gives me a list of things I may want to do to wind down: a walk (based on steps), tidying, reading a book 4. Then it prompts me to look at a small diary/todo I made in the morning and comment on it. And then look at my screen time stats.
I find this helpful. And since I always want to reduce white point, this means I will automatically want to click the notification to run it.
I hopefully eventually they will have AND and OR conditions in automations. Eg if between 8:30 and 11:30 AND I open instagram, open my todo list.
https://99percentinvisible.org/episode/episode-31-the-feltro...
https://apps.apple.com/us/app/reporter-app/id779697486
I'm not suggesting you replace your steps, I just think you're more likely than average to enjoy them. If not, no worries :)
Plus it's an incentive to run the shortcut. I want darkness, and run the questions as a side effect.
Well that's disappointing. It isn't automation if you have to have a human involved.
We could go all the way up that chain till we get to the point that anything at all is not automated. But that seems ridiculous.
Not sure if this is simply a feature Spotify decided not to implement, or if they can't implement it due to Apple Watch restrictions.
I have similar questions with the Hulu Apple TV app. Results for content in Hulu aren't always included in Apple TV wide search, while content from other apps is.
Apple has done a lot of good things, but they went a little over the top with creating such a strict walled garden. (Another example is their blocking of 3rd party billing system - that's a clear example of Apple hurting the user experience to boost their profits)
I'm unclear if Apple needs to add support or if the third party needs to offer it in a specific format. I do often see Hulu, Netflix, and other third parties show up. Often they pop up before Apple. But other services like Hoopla and Kanopy don't show up. To be fair, searching across services is a mess all around. Third party websites have popped up, but seem to be missing a lot of data or stop working after a few months.
> offline support (when the watch isn't in bluetooth range of the phone) wasn't available with Spotify.
https://9to5mac.com/2019/06/09/watchos-6-spotify/
That seems to be up for debate. This article calls out other apps that do this without issue...but it may not be fair to compare it to Overcast, which doesn't have any contractual restrictions on storing it locally in an encrypted format or any other hoops Spotify might need to address.
https://developer.apple.com/videos/play/wwdc2019/716/
Spotify can implement the feature any time they like.
Similarly, Hulu has long been able to provide the search metadata needed to integrate into Apple's universal search system, if they choose to do so.
I remember reading a story where Spotify either bought or sued an app that allowed streaming to the Apple Watch (it may have been something specific like via LTE with no phone involved). Here's an article from June harping on Spotify not allowing offline playback on the Apple Watch [1]. Spotify launched https://www.timetoplayfair.com and sued Apple in the EU because they can't work with Siri and Apple's Home pod.
On the other side, Netflix disables Airplay requesting you use the app on that device. I'm sure this is to enforce their per-device limits at different subscription tiers.
So it could be Apple not offering APIs, inaction on their part, or strategically not allowing that feature.
Spotify has no room to complain.
Now that cellular music streaming has been added in this year's WatchOS update, we'll have to wait and see if they will update their app to support that feature.
Try creating a shortcut in the Shortcuts app to play something in Spotify. Then search for "Run a Shortcut" when you're wiring up the personal automation, and then tap the word "Shortcut" in "Run Shortcut" to pick your Spotify shortcut.
The proper fix here should be that all the shortcuts should be direct actions.
how ?
I wrote an automation yesterday that simply says
When Connected to Carplay Media > Pause.
So far, it seems to do the trick. Doesn't require manual intervention.
when beorg is opened, pull this repo in working copy.
maybe also: when carplay connects, stop playing music.It's a hack, but it works pretty well.
There's also a lot of work been done in iOS 13 to reduce the number of steps required to do a thing. There's info about that here: https://www.macstories.net/stories/ios-and-ipados-13-the-mac...
Unfortunately, the transit skill can only tell you the travel duration, but doesn’t take into account departure times.
It will tell me that I need 20 minutes by train, but it’s impossible to tell at what time the train will depart.
I am having so many ideas for scripting my iPhone. Totally sold.
Been using automation tools on my Mac for quite some time. Tools like Keyboard Maestro, Alfred App, shell scripts, Python scripts, snippet expander like aText or Dash App. Now we get a tiny bit of this on iOS. Right direction.
https://www.iphonetricks.org/the-ios-reduce-white-point-feat...
Willie, remove all the colored chalk from the classrooms!
By default, our "smartphones" are attention-capturing entertainment devices. Disabling notifications is one step towards regaining control and putting apps in their place -- which is to say, tools I will leverage with intention, on my schedule. Disabling colors is another step in that same direction. It's not removing chalk from the classroom, it's temporarily closing the window to mute the ice-cream truck during exams. The whole point of the triple-tap shortcut is to make it trivial to toggle modes, so I am the only one who gets to decide whether I'm in the library or the arcade.
(context: I work on Shortcuts)
WiFi - https://www.icloud.com/shortcuts/a92a26177fae4bafb9c8a7b369e...
Bluetooth - https://www.icloud.com/shortcuts/7b367448c4a04b1483af4af004a...
For anyone else having issues allowing untrusted shortcuts. The toggle in the settings only appears after running any shortcut for the first time. This is an iOS bug apparently.
And you can create a shortcut that will turn off wifi/bluetooth if you put shortcuts on your homescreen or homerow and make that shortcut one of the first 4 you can access it with force touch.
I just want a shortcut that turns off and on vibration when in silent mode.
My one complaint with shortcuts is that the apps have to expose an interface of "actions" which so far is very limited for tons of apps. I want to create a shortcut to the "user & passwords" store under "Settings", but I can't because it isn't exposed as an action.
Which can also be used as a cheap RPC mechanism.