I would argue that if you are not safe you are not free.
The vast majority of App Store users are non-technical and therefore open to scams, viruses and malware. The walled garden may take some freedoms away from the highly-technical but it pays back freedom in spades to 'normal' people. (plus the highly technical can always choose to leave the walled garden if the want to either by jailbreaking or by buying an open device).
We geeks have only ourselves to blame — if we won't police ourselves someone else will have to police us. We gave these freedoms away by using our talents to cheat and scam our customers.
We're not the first to need it of course, if it wan't for Victorian scammers using suspect weights & measures and adulterating flour with dust and the like there's be no need for Trading Standards Officers.
Trading Standards Officers give us all the freedom to buy food & drink safely and I don't believe anyone would truly see us return to a world without them.