Least amount of user data or not, reports like these are alarming: https://www.scss.tcd.ie/doug.leith/apple_google.pdf
It seems that even with maximum security settings, Apple will always know where I am, who is nearby, what mobile networks I use, and what computer networks I use.
Espionage and sabotage aside, that's the kind of information the US government has used to decide whether someone, or an entire location full of random people, should be the target of a drone strike.
I don't worry about being killed by a drone strike, but the fact that this data is collected from everyone everywhere is worrying, and in my opinion it means Apple and Google are complicit in killings like these.