I think this would result in a worse off situation because by allowing users with X karma to remove comments and prevent other users from commenting, it is effectively censoring them.
I think the point I was trying to make was that by turning it around it would require "less" active participation from the users and by default everyone gets a chance, but the really bad comments would still get removed I think. Anyway we shall see how it works out!