Page MenuHomePhabricator

Conduct Analysis on iOS Full Page Editor
Closed, ResolvedPublic

Description

How will we know we are successful?

The new features and improvements must prove how it contributes to the KR 1.1 of the Annual Plan:
Increase unreverted mobile contributions in the main article namespace on Wikipedias by 10%, averaged across a representative set of wikis.

Additionally, we estimate we can increase the average monthly edit count per editor from 4.9 to at least 5.5, bringing it closer to Android's 6.7 monthly average, and significantly higher than mobile web's monthly average edit rate of 4.2 edits per editor.

Validation

  • KR: 2% decrease in edit abandonment (editattemptstep data)
  • KR: Engagement with full page editing is comparable to Android (mediawiki_history data)
  • KR: Increase in unique user edit rate (mediawiki_history data)
  • Guardrail: Passes review from accessibility users

Qual:

No reports of reasonably fixable bugs with the native editor through the app store or our support email in a 30 day period post release

Measurement Plan
AB test if we see a higher rate of edits per person that engage with the new editor

Target Quant Regions and Languages

  • Spanish, French and Portuguese speakers in the Americas (North, South and Central) and Caribbean
  • Chinese speakers in North America

Target Qualitative Audience

  • Low Bandwidth Readers
  • Blind and Low Vision Users / Accessibility Experts
  • Moderators

Date range for 15-analysis: February 29 - March 14

Event Timeline

HNordeenWMF raised the priority of this task from Low to Medium.Mar 20 2024, 2:24 PM
HNordeenWMF updated the task description. (Show Details)

Preliminary analysis is done, answered curiosity questions where I could. Note there are multiple tickets with KR questions so I tried to cover all bases. Added a link in notes of Curiosities slide breaking down questions I was not able to answer. Leaving this open in case there is followup on those.
Deck.