Page MenuHomePhabricator

WE 1.2: Generate snapshot of how/if construction activation has fluctuated since February 2024
Closed, ResolvedPublic

Description

This task involves the work of evaluating how/if constructive activation has fluctuated in the time since February 2024.

This task builds on previous evaluations we've done in T370726 and T360829.

We are prioritizing this work in service of learning the extent to which the discrete interventions teams working on WE 1.2 have deployed have impacted the broader constructive activation we are aligned in trying to move.

This work is a compliment/follow-up to the impact assessment we created in February.

Decision(s) to be made

  • 1. What – if any – adjustments will teams working on the WE 1.2 KR make to increase the likelihood that we deliver on the impact targets we set in T371726#10215981:
  • Mobile web: 10% relative increase (y-o-y)
    • Note: naturally, we expect CA to increase by 6.5% y-o-y, per T370726
  • Mobile apps: 25% relative increase (y-o-y)

Constructive activation

Defined as: The percentage of newcomers making at least one edit to an article in the main namespace of a Wikipedia project on a mobile device within 24 hours of registration (also on a mobile device) and that edit not being reverted within 48 hours of being published.

Requirements

  • For mobile web and iOS:
    • Generate graphs showing how constructive activation has varied from February 2024 through February 2025

Event Timeline

MNeisler triaged this task as Medium priority.Mar 21 2025, 7:37 PM
MNeisler edited projects, added: Product-Analytics (Kanban); removed: Product-Analytics.
MNeisler moved this task from Next 2 weeks to Doing on the Product-Analytics (Kanban) board.

Potential follow-up investigation
How do the mobile web constructive activation rates vary by OS (iOS and Android)?

Context...

  • @KStoller-WMF raised this question in response to learning that @SonjaPerry encountered an IP block while attempting to edit on mobile.
  • Kirsten then came to to wonder:
    • A) might the block Sonja encountered be a result of iCloud Private Relay and
    • B) if the block can be explained by this iOS-specific feature, to what extent – if any – might this feature be impacting constructive activation rates?

Summary of current task status:
I completed an analysis of how constructive activation rates on mobile devices have fluctuated from February 2024 through February 2025. Findings are summarized in this slide deck, which was shared at the WE 1.2 steering committee meeting on 27 March.

Some current insights:

  • There have been no significant changes in overall constructive activation rates on mobile between February 2024 and February 2025.
  • On mobile web, monthly constructive activation rates have continued to average around 17%. Constructive activation rates in both February 2024 and February 2025 were 17.7%.
  • On mobile apps (iOS and Android combined), monthly constructive activation rates have continued to average around 2%. From February 2024 through February 2025, constructive activation rates increased slightly from 2.1% to 2.4%.

Follow-up investigations:

  • Segment constructive activation on Mobile Web by device (See T389457#10701557)
  • Visualize the constructive activation funnel to understand the proportion of users that transition through each step of the constructive activation funnel. This will be done in T385906.

Code repo

Summary of current task status:
I completed an analysis of how constructive activation rates on mobile devices have fluctuated from February 2024 through February 2025. Findings are summarized in this slide deck, which was shared at the WE 1.2 steering committee meeting on 27 March.

Excellent, @MNeisler – thank you. I think we can resolve this task after having 1) presented these findings and 2) ensuring there are tickets for each of the follow-up investigations we'll be doing in response (T385906 + T392743)