- Mentioned In
- T207717: Personalized first day: build Variation C
T212799: Personalized first day: determine the survey's effect on editor activation rate
T206380: Personalized first day: experiments (Variation A)
- Mentioned Here
- T212799: Personalized first day: determine the survey's effect on editor activation rate
I've discussed this with both the Product Analytics team as well as @MMiller_WMF and we've decided that the experiment with Variation C will depend on the outcome of our A/B test of Variation A, specifically how the survey affects editor activation rate (which is measured in T212799).
- If our analysis find that there is no significant difference in activation rate between Variation A and the control group, then we run a one-month experiment comparing Variation A against Variation C. If we find after that month that Variant A is worse than Variant C, then we run a subsequent test of Variant C against a control group.
- If our analysis finds that Variant A resulted in a significant reduction in activation rate, then we run a one-month A/B test of Variation C against a control group.