Page MenuHomePhabricator

Metrics to track - Event Invitations
Open, Needs TriagePublic

Description

NOTE: This ticket summarizes the notes between Ilana & Irene about data to track for Event Invitations
  • Tool usage
    • How many Invitation Lists are generated per month? (and break down by wiki)
    • How many organizers have generated more than one Invitation List? [calculate in months 1-3 only as a gut check]
    • What % of invitation list editors joined the event (event registration only)?
  • Other
    • Who are the top 50 most invited editors per wiki in the last 6 months, and how many invitations did they receive?
  • Discuss further, but not a priority for MVP:
    • What % of active editors on a wiki have received an invitation (month by month and/or in the last 6 months)?
    • [Stretch Goal due to data dependencies] What % of the editors in an invitation list are actually invited by the organizer? Note that this is only possible when we have messaging support, most likely.
    • [Guard rail] What are the opt-out rates (via Preferences)?
      • Note: Opt out will be worked on as a feature immediately after the MVP release
    • Latency
      • This would probably not be reported on indefinitely, and it may not need to be reported by Product Analytics. Could be a combination of engineering + QA looking it combined with user feedback.

Event Timeline

ifried renamed this task from Metrics we would like to track to Metrics to track - Event Invitations.May 17 2024, 7:44 PM

What % of invitation list editors joined the event (event registration only)?

Is this an accurate measure for effectiveness since not everyone on the list may be invited? But it may be difficult to measure the percentage of invited editors who register since we are not tracking what editors out of all the editors on the list were sent invitations. Perhaps we can track if an editor in the invitation list received a talk page message from the organizer (but i guess it wouldn't be enough)
@ifried @Iflorez

@gonyeahialam We marked this under "Tool usage" rather than "Effectiveness" because we do not think it is an accurate measure of effectiveness. Note that we do not have a category for "Effectiveness" in the measurement plan right now. We can probably only begin measuring effectiveness when we know who the organizer invited -- and this will only come when we implement support for messaging, which is a post-MVP feature. In the meantime, I don't think it would be worth the effort to try to analyze talk page messages, especially since many organizers may choose to invite editors via wikimail.

So, with that being said, do you think this metric is useful for helping measure tool usage with the data we will have available for the MVP, or no?

ifried updated the task description. (Show Details)
ifried updated the task description. (Show Details)

@cmelo Hello! We discussed in a team meeting that we should already be able to track tool usage data when the MVP is released, but I wanted to confirm in this ticket. Thanks in advance!