> you didn't have to ask users for permissions to access contacts, sms, SD card and other data
This isn't true. Android 6.0 introduced runtime permissions, where permissions could be granted in the context of the application. Previously, the permissions still had to be granted, but they were granted before the application was installed.