I disagree with your concept of consent. You clearly accepted Apple's ToS when you configured your phone. I'm sure buried somewhere in there is a line about this. You also consented by simply buying their product. When it comes to Apple or Google's ecosystem you aren't ordering off the menu, you're eating at the buffet.

The solution seems very clear and simple to me. If you want finer grain control of your device, don't buy an Apple or Android device. There are plenty of alternatives.