Page MenuHomePhabricator

Conduct pre-deployment QA (Paste Check)
Closed, ResolvedPublic

Description

In T399669, we will be running an A/B test to evaluate the impact of presenting newcomers with Paste Check.

Before beginning this A/B test, we want to verify the experience is behaving in the ways we expect it to. We're going to use this ticket or organize this QA effort.

Requirements

On mobile and desktop...
Case #1

  1. Visit https://en.wikipedia.beta.wmcloud.org/w/index.php?title=Cats&veaction=edit&ecenable=2
  2. Paste a minimum of ≥50 characters of text from Google Docs, Libre Office, or Microsoft Word
  3. Verify Paste Check does NOT appear

Case #2

  1. Visit https://en.wikipedia.beta.wmcloud.org/w/index.php?title=Cats&veaction=edit&ecenable=2
  2. Paste a minimum of ≥50 characters of text from a source that is NOT from Google Docs, Libre Office, Microsoft Word,
  3. Verify Paste Check appears and all aspects of the experience works as expected and in a way you find to be intuitive. This includes, and is not limited to...
    • Electing to keep the text you pasted
    • Electing to remove the text you pasted
    • Publishing an edit and ensuring editcheck-paste-shown has been appended to the edit
  4. Document the issues that surface during "1-4" in the section below
NOTE: it will be important to test how Paste Check performs alongside Reference Check as well.

Issues

Desktop
Mobile
  1. The URL https://en.wikipedia.beta.wmcloud.org/w/index.php?title=Cats&veaction=edit&ecenable=2 was not opening on mobile, https://gerrit.wikimedia.org/r/c/VisualEditor/VisualEditor/+/1190790
  2. I think this is an old issue with mobile: possibly this one: T210555? But, after pasting some content from an external website somewhere that's not at the top of the page, the page scrolls up to the top of the page, I cannot scroll down to the check, every time the check is in view, it jumps back up again. You need to somehow scroll past the check and after that, scroll back up to access the check.
Both
  1. "Thank you for removing this text" was appearing instead of "Thank you for removing the pasted text" which was the finalized copy in the T400518 under proposed copies.
  • looks like it still is according to Esther's comment on T400518
  1. Paste check seems to get activated again even after it's declined - Per conversation with David Lynch this is expected.
  1. When I paste some content from external source that is also tone violating. If I don't move my cursor away from that paragraph (so, no Tone check get's triggered) but rather click on "Publish Changes", in the Pre-Save mode I see "Reference Check" and "Tone Check", but then when I click the back button I only see the "Paste Check".

Screenshot 2025-09-24 at 3.36.20 PM.png (798×2 px, 335 KB)
Screenshot 2025-09-24 at 3.36.33 PM.png (552×3 px, 237 KB)

Interestingly, when I repeat the steps for the second time, I do see both paste check and tone check in mid-edit check section. @DLynch : Is this expected?

Event Timeline

ppelberg moved this task from Inbox to QA on the Editing-team (Kanban Board) board.
ppelberg moved this task from Inbox to High Priority on the Editing QA board.
Ryasmeen updated the task description. (Show Details)

Issue #3 : When I paste some content from external source that is also tone violating. If I don't move my cursor away from that paragraph (so, no Tone check get's triggered) but rather click on "Publish Changes", in the Pre-Save mode I see "Reference Check" and "Tone Check", but then when I click the back button I only see the "Paste Check".

This seems to be fixed now.

Resolving as Paste Check a/b test was deployed to 22 Wikipedias on 8 October.