Page MenuHomePhabricator

Visual Editor: Data - Documentation
Open, HighPublic

Description

Background

This task is intended to capture what data wiring is needed to answer if this feature met its goals.

Measurement Goals

See epic

Link to Finalized Designs

https://www.figma.com/design/ZhMT1jiTjWfDhKB713cDfX/Visual-Editor-Hand-off?node-id=742-140&t=hJUMmGL9CiNYZZBk-0

Tasks
  • @ PM Add measurement goals to task [See EPIC]
  • @ PM Add link to final designs
  • @Analyst Create schema Doc
  • @Analyst Create validation task after Beta release
  • @Analyst Move ticket to “Needs engineering sync” for engineers to estimate & implement instrumentation
  • @Engineers Instrument according to deck

Event Timeline

We can currently measure edit success rate (and the inverse abandon rate) using data in event.editattemptstep however we are missing revision_id values for Android edits which will prevent us from being able to answer question about newcomer edits. See https://phabricator.wikimedia.org/T432388 task for engineering to investigate.

Baseline Edit Completion Rate: Data
Date range: 2026-06-01 - 2026-06-30

PlatformCount Edit StartsCount Edit Success% Edit Success
Android73891710124813.7%
iOS2996404852216.2%

Data Availability

Data Available CurrentlyQuestion:Data Source
YesDoes the introduction of this option result in higher abandonment rate of edits?event.editattemptstep
iOS Yes, Android NoDo we see more ‘newcomers’ becoming successful editors?JOIN event.editattemptstep and wmf.mediawiki_history (requires revision_id value)
TBDWhat % of people who are sent to web to edit come back to the app again afterwards?TBD
TBDAttribution of the edit - how will we track that the person who made this edit originated from the app?TBD

Edit attribution:
Init by app_install_id - edit starts in app - savesuccess event with revision_id should include app_install_id and possible flag 'visual edit edit' -
we will only be able to get counts of edit starts and SUCCESSFUL EDITS. User leaves to VE may be an added action OR user who misses any next step is abandon/leave to VE

Tsevener subscribed.

FYI, bug mentioned above has been split off into T432664: [BUG] Android and iOS edit 'saveSuccess' events missing `revision_id` value in event.editattemptstep, so we will investigate and fix as a part of that task.

Apps Visual Editor Handoff Instrumentation T431812

Dependencies where we still need to map how we will be joining our app data in event.editattempstep with MobileWeb/Visual Editor data generated by users coming from the apps are noted throughout deck, to be updated when we have more info.

SNowick_WMF updated the task description. (Show Details)
SNowick_WMF updated the task description. (Show Details)
SNowick_WMF renamed this task from Visual Editor: Data - Instrumentation to Visual Editor: Data - Documentation.Fri, Aug 21, 11:14 PM