I think the actual holy grail would be billing everyone a small amount per road-minute spent in the zone, not a large amount for entering. If you enter and immediately park in a garage, you're not causing congestion. If you circle the block endlessly, you are.
(Separately, we should bill for street-parking-minute spent, but that's a separate issue.)