Page MenuHomePhabricator

Tag edits in which ≥1 Paste Check was shown
Closed, ResolvedPublic

Description

This task involves the work of deciding:

  1. If we'll tag edits Paste Check was activated within
  2. How we'll tag these edits, if we decide to move forward with doing so

Stories

As the person responsible for evaluating the impact of Paste Check, I need to be able to identify edits in which Paste Check was shown so that I can determine the impact of Paste Check's presence/absence on edit quality

Requirements

  1. editcheck-paste-shown: this tag would be applied to any ''published'' edit in which ≥1 Paste Check was shown.
  1. editcheck-paste: this tag would be applied to any ''published'' edit that includes unmodified* pasted text (regardless of its source and type)
  2. editcheck-paste-HTML: this tag would be applied to any ''published'' edit that includes unmodified* text pasted from HTML (T376306).

Open question(s)

  • 1. Which (if any) of the tags above will be hidden to start?
    • None. See Requirements above.

References

@matej_suchanek helpfully raised the need for us to address this question. on meta via the Community Wishlist.

Event Timeline

ppelberg added a subscriber: nayoub.

Per what @MNeisler and I talked about offline today, we're thinking that initially we'll introduce two Paste Check-specific edit tags:

  1. editcheck-paste: this tag would be applied to any ''published'' edit that includes ''unmodified'' [i] text pasted from HTML (T376306).
  2. editcheck-paste-shown: this tag would be applied to any ''published'' edit in which ≥1 Paste Check was shown.

Emphasis on "unmodified" as the Editing Team will need to investigate the extent to which it is currently possible for VE to detect whether pasted text has been modified at save-time.

NOTE: we are seeking volunteer input on this proposed approach on-wiki: mw:Talk:Edit check#Paste Check

In service of us being able to evaluate Paste Check's false negative rate (read: cases when Paste Check did NOT activate when it, perhaps, should have), @MNeisler and I are proposing the introduction of a third tag and a revision to the editcheck-paste proposal shared in T379843#11041431.

The above would amount to the following set of tags:

  1. editcheck-paste: this tag would be applied to any ''published'' edit that includes unmodified* pasted text (regardless of its source and type)
  2. editcheck-paste-HTML: this tag would be applied to any ''published'' edit that includes unmodified* text pasted from HTML (T376306).
  3. editcheck-paste-shown: this tag would be applied to any ''published'' edit in which ≥1 Paste Check was shown.

*Emphasis on "unmodified" as the Editing Team will need to investigate the extent to which it is currently possible for VE to detect whether pasted text has been modified at save-time.

ppelberg updated the task description. (Show Details)

Per what we discussed offline, we're going to start with two tags that follow existing pattern:

  • tag for when paste check would've been shown (based on current configuration)
  • tag for when paste check was //actually/ shown

We'll revisit idea of "unmodified" tag and distinguishing between different types of paste sources in tasks I'll later link.

Per what we discussed offline, we're going to start with two tags that follow existing pattern:

  • tag for when paste check would've been shown (based on current configuration)
  • tag for when paste check was //actually/ shown

We'll revisit idea of "unmodified" tag and distinguishing between different types of paste sources in tasks I'll later link.

In light of today's offline discussion, we're changing course...

To start, we will only be introducing one Paste Check-related edit tag: editcheck-paste-shown. This tag will get appended to all edits in which Paste Check was actually shown during an edit session.

And while evaluating the impact of Paste Check via a controlled experiment (T399669) still depends on us being able to identify edits that involve someone pasting content into a VE edit session, we will track this information via the visual editor feature use schema.

With the above said, the Editing Team still perceives a need/desire amongst patrollers/reviewers to be able to identify edits that include pasted content. Although, we'll revisit if/how to make this information available in T402465.


Thinking...

  1. We're able to gather the data we need to analyze the impact of Paste Check through alternative means
  2. The meaning of the tag is vulnerable to being misunderstood
  3. "1." could cause unhealthy interactions between experienced volunteers and newcomers acting in good faith
  4. The nature of the tag itself could come at the expense of editor privacy
    • As such, we ought to proceed with such a step when we think there is a strong enough need for doing so
ppelberg renamed this task from Decide how – if at all – to tag edits Paste Check was activated within to Tag edits in which ≥1 Paste Check was shown.Aug 22 2025, 7:46 PM
ppelberg moved this task from Inbox to Ready to Be Worked On on the Editing-team (Kanban Board) board.

Change #1184904 had a related patch set uploaded (by DLynch; author: DLynch):

[mediawiki/extensions/VisualEditor@master] Edit check: refactor tracking of shown checks

https://gerrit.wikimedia.org/r/1184904

Change #1184905 had a related patch set uploaded (by DLynch; author: DLynch):

[mediawiki/extensions/VisualEditor@master] Paste check: add editcheck-paste-shown tag

https://gerrit.wikimedia.org/r/1184905

Patches assume that https://www.mediawiki.org/wiki/Help:Edit_check#Paste_check will be created by the time this tag becomes relevant to anyone.

Change #1184904 merged by jenkins-bot:

[mediawiki/extensions/VisualEditor@master] Edit check: refactor tracking of shown checks

https://gerrit.wikimedia.org/r/1184904

Change #1184905 merged by jenkins-bot:

[mediawiki/extensions/VisualEditor@master] Paste check: add editcheck-paste-shown tag

https://gerrit.wikimedia.org/r/1184905

ppelberg added a project: Editing QA.
ppelberg moved this task from Inbox to High Priority on the Editing QA board.