My understanding of Crossfit is that its purpose is to isolate fitness adaptations from exercise-specific skill adaptations, to produce a well-rounded athlete who can perform almost any exercise at a competent level with minimal skills training.
In other words, if you run a 5k for every workout, and your 5k time goes down, how do you know whether it went down because your fitness improved, or because your running technique improved? How do you know if that improvement will transfer over to, say, swimming, or basketball?
Crossfit tries to answer this question by having the athlete perform various unrelated exercises, in circuits, for time, and varying the exercise selection each day. But the problem is, if you never (or infrequently) do the same circuit twice, how do you know you've progressed at all?
Contrast that with a powerlifting program that would have you increasing the weight on the bar by a certain percentage each workout. Yes, your improvements will be partly due to improved form and technique, but there's also no question that you're getting physically stronger as well. No attempt is made to separate the two phenomena, as they are inherently intertwined.
Perhaps different Crossfit gyms take different approaches to programming, though. I suppose the quality of the programming could really depend on the training philosophy and experience of a particular Crossfit coach. But I don't get the impression that the concepts of measurable results and progressive programming are really part of the core philosophy of Crossfit.
Of course, many of the CrossFit exercises are technically challenging and most people aren't going to feel comfortable teaching themselves. That $150-200 a month isn't just for the equipment. At a good gym, it's for quality coaching.
The problem with most exercise plans, professional and amateur alike is that there is no concept of measurement. CrossFit has that built in.
e.g., how do I compare a 5 min AMRAP ("as many _ as possible") of something which I can't lift at RX to a later attempt where I might lift more (but slower), or less (but without stopping)?
Similarly, how do I meaningfully compare the performance of the same lift (e.g. deadlift) in an AMRAP situation with doing a set amount in as long as it takes? (I'm slow.)
I don't mean to imply that Crossfit is less than awesome. It makes me feel amazing, and I love it. I just have had a really hard time _quantifying_ my performance.
In terms of metcon, I mostly compare myself against Rx, since I scale most things. So, this week I'm doing pullups with an assistance band one level harder than the one I'd been using for months beforehand. It feels wonderful. If I scale thrusters to 65lb from 95, when in the past I've had to scale to 55 from 95, that's also clear progress for me.
BrandX typically will tell you the goal of a particular MetCon. For example, they'll say that you should be able to do Fran in 5-7 minutes. If you're below that time, increase the weight up to RX. If you're above that time, decrease the weight. Your goal should always be to complete the WOD in approximately the same amount of time as top athletes, you're just doing it with less weight.
Lots of good information in the BrandX forums around scaling and measurement.