Losing a smartphone isn't going to ruin me, but it sure would piss me off to have to fork out £500 or whatever because it gets jacked. Similarly, someone could break into my house and clean it out. Not going to ruin me, but I'd rather not have to replace everything.
The whole point of insurance is collective risk-spreading. Yes, this means that the majority (by value) of people with insurance will have 'wasted' money, in the sense that they purchase insurance without claiming. But that's not what they're purchasing – they're trading off a small, certain cost for the elimination of a large, uncertain cost. That's a purchase of 'certainty' or 'stability' – and it's what they get.
In other words, since you have no reliable way to understand risk and likelihood of a particular event happening, it's not possible to decide if you are at a higher risk than average.