Page MenuHomePhabricator

Plan continuation of KaiOS homepage content suggestions experiment
Closed, ResolvedPublic

Description

The initial analysis of the experiment is complete (T283770).

We intend to continue the analysis with the following:

  • expanding it to include users in India once Jio releases the app
  • continue fitting and interpreting more sophisticated hierarchical models for session count and session length.
  • writing up a full report

We need to do the following:

  • arrange (both legally and technically) for longer retention of the experiment data; our dataset starts on 6 May, so the last day before it starts getting deleted is 3 August.
  • set up reminders for data storage and deletion
  • decide whether we want to test any additional treatments before shutting the experiment down
  • plan the work to present the findings, do the final analysis, and write the final report
  • extend the experiment configuration as necessary (experiment currently ends on 31 January 2022)

Event Timeline

nshahquinn-wmf created this task.
nshahquinn-wmf moved this task from Backlog to Analyst on the Inuka-Team board.
nshahquinn-wmf moved this task from Triage to Upcoming Quarter on the Product-Analytics board.

With the new 270-day data retention exception, we can keep the earliest experiment data until 31 January 2022. That is the date when we will have to revisit our current arrangements for the experiments, if we are still not done.

Now that I have finally filed T294073, T289729, and T294143, this is done!