Hacker News Reader

The user id can be used to seed the random number algorithm to achieve that.

Hmmm but if you change the distribution, this won't be deterministic anymore unless the randomness only applies to new users entering the test setup.

Which is necessary. You don’t want to compare two wildly different users. This is why you need to define criteria for eligibility.