I disagree. The permission should be allowed/denied by the end user. There's no reason why a third party has to have say in that.
It's the App Store reviewer that considered the permission prompt to be unclear, and thus rejected the app from the platform.