Page MenuHomePhabricator

Dashboard: VE edit session health
Open, Needs TriagePublic

Description

Edit Check is evolving to a place where people are likely to encounter multiple Edit Checks within a single edit session.

Ideally, the people encountering Edit Checks find them supportive to the extent that they are motived to act on them and publish the change(s) they arrived to [edit ] intending to make.

With the above said, it's important to acknowledge that presenting Edit Checks to people means "asking" them to take actions they might not have otherwise taken. By extension, Edit Check could potentially cause people acting in good faith to perceive editing Wikipedia to be more involved than they expected and abandon the edit(s) they started.

With this task, we want to create a dashboard that will enable members of the Editing Team to monitor – historically and in real-time – several metrics that will enable us to understand how Edit Check is impacting how people do and do not edit in VE.

Story

As a member of the Editing Team responsible for ensuring the visual editor supports people in publishing edits i) they are motivated to make and ii) projects value, I need to be able to see and explore a range of metrics that, taken together, help me understand the extent to which VE editing experiences are "healthy" so that I can decide what – if any – action to prioritize taking if/when we perceive it not to be.

Requirements

To be draft in collaboration with @MNeisler.

Metrics for consideration

The metrics below are ideas. The metrics we ended up prioritizing will be documented in the === Requirements section above.

  • Edit completion rate
  • Edit abandonment rate
  • Time to save