Good point, I hadn't considered that. Made the comment mainly because we had an incident a few weeks back where a client saw a bunch of stuff in a production version that was definitely never supposed to see the light of day and put us in a very awkward position.
Yeah, I remember a HN post a couple of weeks ago about FB where they do A/B testing with their users in the app.