Were download rankings combined with one-way "membership" considered? (One-way "membership": once a gem/user qualifies based on recent downloads, they're permanently required in perpetuity.)

This seems to be like it would mitigate the on/off problem of using a variable metric while also being biased to the currently relevant gems/users.