Yes, some consulting firms do charge a premium for their brand†. But all consulting firms charge a premium for shouldering project, scheduling, and employee retention risk on behalf of their clients; those factors alone, before you even factor specialization into the picture, seem likely to be worth more than $50/hr.
I think you may be falling into the same trap Jason Cohen fell into (which would be weird, because, aren't you a consultant?).
† On the other hand, note that some big shops, particularly in the big 4, offer huge discounts on consulting rates that they make up on audit works.