Page MenuHomePhabricator

Investigate the content of mobile edits
Open, MediumPublic

Description

As the Audiences department prepares to work on major improves to mobile editing, many teams are working to understand the high-level patterns of mobile editing (the success rate of edit attempts, the retention of new mobile editors, the revert rate for mobile edits, editors' proportion of mobile edits, and so on).

However, we'd also like to develop a deeper understanding of the content of mobile edits. Questions we'd like to answer include:

  • What types of edits do mobile editors generally make? What's the breakdown between copyedits, factual changes to existing content, and additions to new content?
  • How big are mobile edits? What's the size distribution among different edit types (e.g. copyediting one paragraph versus copyediting an entire 20 paragraph article)? How many sections of a page do mobile edits generally change?
  • How often do mobile editors write on talk pages? How often do they receive responses?
  • What's the quality of mobile edits? Overall, is it higher or lower than desktop edits? If it differs, what are the main reasons for that difference? For example, is it that edits contain more factual errors or is it that they're just more poorly formatted?
  • What can we learn about users' motivations by studying their edit patterns? For example, can we segment mobile editors by types, size, and pattern of edits made?
  • Do the results of any of the above differ significantly by key characteristics such as:
    • Editor used (mobile wikitext editor, mobile visual editor, iOS app editor...)
    • Geographic location
    • Project

Note that these questions are meant to give a general sense of the area we like to understand better: obviously, it won't be possible to answer all of these questions (both because of time and data limitations), and there may be other similar questions that are worth answering. Much of this project is about exploring the data and identifying the most promising avenues for investigation.

Event Timeline

nshahquinn-wmf renamed this task from Explore high-level patterns in mobile editing to Report on high-level patterns in mobile editing.Aug 15 2018, 10:13 AM
nshahquinn-wmf raised the priority of this task from Low to High.
nshahquinn-wmf updated the task description. (Show Details)

A number of stakeholders, including @Deskana and @DannyH, have identified this as a key priority for the next few months, so I'm raising the priority and starting a conversation about who in the Product Analytics team can take this on.

nshahquinn-wmf raised the priority of this task from High to Needs Triage.Aug 15 2018, 10:16 AM
nshahquinn-wmf triaged this task as High priority.
nshahquinn-wmf moved this task from Backlog to Triage on the Product-Analytics board.

A lot of this work is already being done by individual teams working on mobile-related projects (for example, T202132), so I'm rescoping this to be about a more self-contained, longer-term project to analyze the content and quality of mobile edits.

nshahquinn-wmf renamed this task from Report on high-level patterns in mobile editing to Investigate the content of mobile edits.Aug 29 2018, 12:20 AM
nshahquinn-wmf updated the task description. (Show Details)
nshahquinn-wmf lowered the priority of this task from High to Medium.Sep 20 2018, 8:25 PM