But you do lose a lot of functionality. Especially on the iPhone as there is no real way to add apps without it.
Good for semi-anonymous browsing for instance, also because fingerprinting of the browser looks the same as a bunch of other iOS devices.