Page MenuHomePhabricator

Create a method for '7-day retention' without Participants filter
Closed, ResolvedPublic1 Estimated Story Points

Description

Implementation requirement

  • Use the page IDs to find the users that have edited those pages within the timeframe of the event. (Method should already exist)
  • Then, with this list of users, find the New Editors and calculate the 7-day retention based on the operation that already exists and works inside GrantMetrics

Details

7-day retention is an existing metric in Grant Metrics, but currently it works only when the user has defined a Participants list. For Event Metrics, we'd like to have this figure with or without Participants.

Definition of metric

  • 7-day retention The % of New Editors (see definition below) who make at least one edit, in any Wikimedia project (in any namespace), between 7 days after the event and the time that the report is run.
  • New Editors are a subset of "Participants" defined as a new accounts created, including users who registered up to 14 days before the event up until the end of the event period, on any wiki (for more on Participants and New Editors, see T208546).

Where this metric appears

  • Event Summary reports (T205561, T206692)
  • Event Summary page
    • On the redesigned Event Summary page, 7-day retention is classified as a "Participation" metric (as opposed to Contribution or Impact)

Event Timeline

@Mooeypoo, I went ahead and created the 7-day retention ticket we talked about. I put the basic info in, for your reference. Please go ahead and work your Implementation magic.

@jmatazzoni When you say "without participants", do you mean in the case that only a category is specified? Because the tool can't generate any metrics unless a participant list is provided, right?

@jmatazzoni When you say "without participants", do you mean in the case that only a category is specified? Because the tool can't generate any metrics unless a participant list is provided, right?

The plan is to break the reliance on a participant list, whether by including Categories or Worklist.

@jmatazzoni When you say "without participants", do you mean in the case that only a category is specified? Because the tool can't generate any metrics unless a participant list is provided, right?

The plan is to break the reliance on a participant list, whether by including Categories or Worklist.

Hmm, I think this ticket won't be workable until there is a decision about whether we are using categories or worklist. To calculate 7-day-retention, you need a list of users in some way. Right now it comes from the participants list. Depending on whether we go with categories or worklist, it will change the way the list of users is calculated.
Unless this ticket is for making the current implementation independent of where the user ids come from. In that case we should clarify that in the ticket.

Here's how I understand it: The page IDs will be used to find the users that have edited those pages within the timeframe of the event. Then, with this list of users, we can do what we need to find the 7-day retention.

Got it. That makes sense. I think the ticket can be clarified to make that clear. Will leave that to Moriel.

jmatazzoni updated the task description. (Show Details)
jmatazzoni updated the task description. (Show Details)
MusikAnimal claimed this task.

I think this can be resolved. No work was needed to make this apply to events without participants. Example https://eventmetrics-dev.wmflabs.org/programs/76/events/370