Page MenuHomePhabricator

Create Superset dashboard to see how edit suggestions are performing (overall and by type)
Closed, ResolvedPublic

Description

This task involves the work of introducing a view where, for now, members of the Editing Team can see how suggestions are performing overall and by type.

Decision(s) to be made

  • 1. What new Suggestions will we prioritize introducing?
  • 2. What Suggestions will we refine further?
  • 3. What Suggestions will we disable?

Stories

As a member of the Editing Team motivated to introduce Edit Suggestions that volunteers find compelling and constructive, I'd like there to be a single place where I can see how different Suggestions are performing, so that I can decide 1) what new Suggestions to introduce, 2) what suggestions to refine further, 3) what suggestions to deactivate

NOTE: this view will serve as the foundation for what I imagine we will eventually want to make available on-wiki so that experienced volunteers can monitor how the system is performing in a way that is similar to Special:AbuseFilter

Requirements

Create a Superset dashboard that contains/enables the following...

  • Count of edit sessions initiated with one of following URL parameters: &ecenable=suggestions or &ecenable=suggestions,experimental See: T409206
  • Count of edit sessions ≥1 suggestion is presented within
  • Count of edit suggestions shown (by type and overall), across all &ecenable=suggestions or &ecenable=suggestions,experimental
    • Where "type" here could mean things like Tone suggestions (T404602), TextMatch Suggestions (T407286), etc.
  • Count of edit suggestions accepted (by type and overall), across all &ecenable=suggestions or &ecenable=suggestions,experimental
  • Count of edit suggestions decelined (by type and overall), across all &ecenable=suggestions or &ecenable=suggestions,experimental

Done

  • Superset dashboard is available that enables us to see/explore the metrics listed in Requirements above

https://superset.wikimedia.org/superset/dashboard/49aebb3f-75ec-4a84-9e54-60c2266183c4/

Related Objects

Event Timeline

ppelberg renamed this task from Introduce a view to see how edit suggestions are performing (overall and by type) to Create Superset dashboard to see how edit suggestions are performing (overall and by type).Oct 14 2025, 7:29 PM
ppelberg updated the task description. (Show Details)
ppelberg moved this task from Inbox to Ready to Be Worked On on the Editing-team (Kanban Board) board.
ppelberg added subscribers: DLynch, Sdkb, Quiddity.
ppelberg added a subscriber: MNeisler.

Change #1204691 had a related patch set uploaded (by DLynch; author: DLynch):

[mediawiki/extensions/VisualEditor@master] Editcheck: flag suggestions when logging actions

https://gerrit.wikimedia.org/r/1204691

Change #1204691 merged by jenkins-bot:

[mediawiki/extensions/VisualEditor@master] Editcheck: flag suggestions when logging actions

https://gerrit.wikimedia.org/r/1204691

Change #1204957 had a related patch set uploaded (by DLynch; author: DLynch):

[mediawiki/extensions/VisualEditor@wmf/1.46.0-wmf.2] Editcheck: flag suggestions when logging actions

https://gerrit.wikimedia.org/r/1204957

Change #1204957 merged by jenkins-bot:

[mediawiki/extensions/VisualEditor@wmf/1.46.0-wmf.2] Editcheck: flag suggestions when logging actions

https://gerrit.wikimedia.org/r/1204957

Mentioned in SAL (#wikimedia-operations) [2025-11-13T21:13:15Z] <bvibber@deploy2002> Started scap sync-world: Backport for [[gerrit:1204928|StickyHeaders: scroll-margin-top fixes (T409349)]], [[gerrit:1204700|Reduce number of bucketsizes for MediaViewer (labs, group0) (T372165)]], [[gerrit:1204957|Editcheck: flag suggestions when logging actions (T407170)]]

Mentioned in SAL (#wikimedia-operations) [2025-11-13T21:15:26Z] <bvibber@deploy2002> bvibber, kemayo: Backport for [[gerrit:1204928|StickyHeaders: scroll-margin-top fixes (T409349)]], [[gerrit:1204700|Reduce number of bucketsizes for MediaViewer (labs, group0) (T372165)]], [[gerrit:1204957|Editcheck: flag suggestions when logging actions (T407170)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Mentioned in SAL (#wikimedia-operations) [2025-11-13T21:22:13Z] <bvibber@deploy2002> Finished scap sync-world: Backport for [[gerrit:1204928|StickyHeaders: scroll-margin-top fixes (T409349)]], [[gerrit:1204700|Reduce number of bucketsizes for MediaViewer (labs, group0) (T372165)]], [[gerrit:1204957|Editcheck: flag suggestions when logging actions (T407170)]] (duration: 08m 58s)

ppelberg updated the task description. (Show Details)