Page MenuHomePhabricator

Newcomer tasks: instrumentation
Open, Needs TriagePublic


We will need to instrument the newcomer tasks feature to facilitate a controlled experiment and to answer our high-level research questions about the feature.

An important element is to assemble our written measurement plan. We will go through these steps in this order:

  • @nettrom_WMF starts a draft in a Google Doc.
  • @MMiller_WMF collaborate to refine the draft.
  • @JTannerWMF circulates this draft to various approvers to begin to inform them and receive initial feedback.
  • At the same time, the team starts to comment on the draft and @nettrom_WMF and @MMiller_WMF will incorporate changes. We will set a cutoff date when all changes should be complete.
  • Implementation begins. Engineers may begin implementation before this step if there is sufficient confidence about parts of the plan.
  • @JTannerWMF completes the approval process.

Event Timeline

A note from a conversation with @nettrom_WMF -- in analyzing the newcomer tasks impact, we may want to look at non-reverted edits, as opposed to just edits. The feature directly causes edits, but the question is whether they are valuable edits for the wiki.

kostajh moved this task from Inbox to Q1 2019-20 on the Growth-Team board.Aug 19 2019, 12:12 PM

Seems like something for us to sort out in Q1 but @MMiller_WMF feel free to move.