Page MenuHomePhabricator

Create dashboard for viewing edits Edit Check was activated within
Open, HighPublic

Description

This ticket involves the work of creating a centralized place where volunteers and staff can review the edits Edit Check is being shown within, across wikis.

Story

  • As a volunteer interested in the Edit Check project or member of the Editing Team, I'd value there being a centralized place where I can A) see how many edits Edit Check was activated within and B) review the individual edits people end up publishing so that I can (a non-exhaustive list):
    • Decide whether I think adjustments ought to be made to how Edit Check is configured.
      • E.g. might the heuristic that determines whether the reference check is activated need to be made more/less permissive?
    • Learn how people are engaging with the prompts Edit Check is presenting them and decide whether adjustments ought to be made to them.
      • E.g. are the majority of people declining to add references? If so, might we need to reconsider how that prompt is shown? Are the majority of people adding reference? If so, what kinds of references are they adding? Might we need to offer additional guidance about what is considered a useful reference in the context of Wikipedia ahead of T276857 being ready?

Requirements

User Experience

  1. Create an off-wiki site (e.g. hosted on Toolforge) that displays a real-time count [i] of the following:
    1. The number of edits the reference check (editcheck-reference-activated T342462) was activated within, shown as:
      1. A per-project, per-day count. Read: an aggregated count of the number of edits an edit check was activated within.
      2. A per-day count. Read: an aggregated count of the number of edits an edit check was activated within, across all projects, on a given day.
    2. The number of edits that Edit Check could theoretically be shown within (editcheck-references T324733), shown as:
      1. A per-project, per-day count.
      2. A per-day count
  2. The aggregate counts "1.A.a." and "1.B.a." describe ought to be clickable/tappable
    1. When people tap/click the count "1.A.a." describes (the number of edits Edit Check was activated within on a given day, on a given wiki), people ought to arrive at Special:RecentChanges pre-filtered using the editcheck-references-activated tag (e.g. ha:editcheck-references-activated)
    2. When people tap/click the count "1.B.a" describes (the number of edits that Edit Check could theoretically be shown within), people ought to arrive at Special:RecentChanges pre-filtered using the editcheck-references tag (e.g. ha:Special:RecentChanges)

Meta

  1. The counts "User Experience: 1." describes ought to:
    1. Appear for the last 30 days
    2. Automatically update, in as close to real-time as possible
  2. The page "User Experience" ought to be able to scale to accommodate a future where multiple checks are deployed

References

Related

Event Timeline

This is actually up on toolforge finally: https://eccheck.toolforge.org/

Now it's on there, I'll need to make sure the update scripts actually run properly on the toolforge infrastructure when I'm not manually watching them. I also see a side-effect of the toolforge server being on a different timezone than me which makes some things not align how I thought they would, so I'll tweak some boundaries.

LMK when it is stable, so that I can include it to our public documentation.

Adding @KStoller-WMF for ref as one of the suggested features for Community Configuration was enabling access to analytics for to help with decision-making on product feature configuration.
Separately, would it make sense to standardise and centralise analytics UIs like this which may relate to work being done by Data Products ?