If one user creates all of the trials and successes, they can bias the experiment.
As an alternative to incr on trials and successes, it may be useful to maintain redis sets and check the set length for each control/variant. This can also allow us to keep a user who succeeds with one variant pinned to that variant in future experiences.
If one user creates all of the trials and successes, they can bias the experiment.
As an alternative to incr on trials and successes, it may be useful to maintain redis sets and check the set length for each control/variant. This can also allow us to keep a user who succeeds with one variant pinned to that variant in future experiences.