It's fascinating how so many apps can be rendered useless by the simple mistake of tapping "Deny" instead of "Allow."
All that said, I think Apple is making the right choice by favoring privacy and security even if it's at the expense of a completely frictionless user experience.
I agree with you that I doubt many people have any idea that stuff is there.
It might be that the fuzzy edges of Apples approval system can be beneficial if some good judgement is used.