That's not entirely true for T-Mobile, actually. You still connect to 3G towers even after throttling, but you are slowed down to "2G" speeds. In practice, the 2G speeds are much slower than EDGE, but slightly faster than GPRS.
I've experienced this on T-Mobile, and the connection is still usable, though slower. The AT&T throttle sounds unusable.