If your connection strings are set in .cscfg config files, remember that they are editable through the Management Portal and you can swap them to HTTP.
Edit: Maybe not such a great idea. It looks like this relies on Storage under the hood as well. Now my instances are recycling.
Later: It appears doing so actually corrupted the instance and required a redeploy, which is of course not currently possible. Awesome.