This doesn't seem to be an option for me (Android 5.0.2). Settings->Apps->Maps->Permissions get me a screen that lists the permissions, but there is no way to change them. Am I missing something?