Description
Description
Status | Subtype | Assigned | Task | ||
---|---|---|---|---|---|
Resolved | None | T254724 Experiment: homepage content suggestions in the KaiOS app | |||
Resolved | nshahquinn-wmf | T283770 Analyze results of the KaiOS app homepage content suggestions experiment |
Event Timeline
Comment Actions
The initial analysis is done:
- Users in the control group had an average session length of 2 min, 15 s. In the trending article group, this increased by 15% (t-test p ≪ 0.001).
- Users in the control group had an average of 1.7 sessions. In the experiment group, this increased by 2% (Mann-Whitney U test p = 0.003)
I've been working on fitting more sophisticated hierarchical models as well. That isn't fully done, but I expect to pick it up next quarter (T285777).
My full analysis notebook is at on GitHub in wikimedia-research/2021-KaiOS-app-homepage-content-suggestions.