Page MenuHomePhabricator
Create Task
Maniphest T430878

Publish Suggestion Mode controlled experiment findings on-wiki
Open, HighPublic
Actions

Description

This task involves the work of publishing the Suggestion Mode controlled experiment findings on-wiki.

Purpose

  1. Close the loop on the initial Suggestion Mode controlled experiment with interested by sharing what we did (and did not) learn from it
  2. Set the stage for making volunteers aware of the second experiment that will show an indication on to logged-in articles when edit suggestions are available "within" the articles they are reading (T430712)

Audiences

  • Experienced volunteers who have been trying Suggestion Mode and are curious to learn what (if any) effect it's having on newcomers
  • Experienced volunteers who are often on the "receiving end" of newcomer edits and eager to learn how (if at all) Suggestion Mode may or may not impact the wiki work they do

Announcement drafts

Editing Scratch (Product) → Active drafts

References

Related Objects
Search...

StatusSubtypeAssignedTask
 OpenNoneT360489 [EPIC] Offer edit suggestions as a service
 OpenNoneT414853 [MILESTONE] Deploy Suggestion Mode as a default-on feature.
 OpenQuiddityT430878 Publish Suggestion Mode controlled experiment findings on-wiki
 ResolvedppelbergT404600 [MILESTONE] Run controlled experiment of Suggestion Mode MVP
 ResolvedmedeliusT379444 Update Vector 2022 to support disabling right rail for certain editor workflows
 OpenNoneT378775 Estimate impact of hiding Tools and Appearance menus by default while editing
 ResolvedAnneTT417218 Support editing team on API for disabling the right rail for certain editor workflows
 ResolvedDLynchT412330 [SPIKE] Investigate technical feasibility of surfacing "Add a link" suggestions within Suggestion Mode
 ResolvedppelbergT412332 [SPIKE] Investigate technical feasibility of surfacing "Add an image" suggestions within Suggestion Mode
 DuplicateNoneT412367 Suggestions: Review copies to highlight their impact
 DuplicateNoneT412381 Suggestion Mode: Find other possible entry points (read mode, after publish, etc.)
 ResolvedDLynchT412878 [Suggestion] Detect heading levels that don't follow semantic order
 ResolvedppelbergT413453 Host a 2nd community conversation about suggestion mode
 OpenFeatureNoneT414539 Allow suggestions to be suppressed programmatically
 ResolvedppelbergT404604 Design Suggestion "card" component MVP
 DuplicateBUG REPORTNoneT415130 Suggestion Mode external link check - exclude Sources section in English
 ResolvedppelbergT415320 [MILESTONE] Deploy Suggestion Mode MVP as a beta feature (all Wikipedias)
 ResolvedppelbergT399611 [MILESTONE] Deploy Suggestion Mode MVP as a beta feature (en.wiki)
 ResolvednayoubT401020 Define the Suggestion Mode user experience (MVP)
 ResolvedppelbergT402242 Define suggestions to include in Suggestion Mode MVP
 ResolvedDLynchT404602 [SPIKE] Investigate feasibility of running Tone Check in Suggestion Mode
 ResolvedQuiddityT414626 Update mw:Edit check/Deployment Status to include currently available Checks/Suggestions
 ResolvedppelbergT404603 Create final copy and illustration for VE Suggestion Mode beta feature
 ResolvedppelbergT404470 [MILESTONE] Offer Suggestion Mode via URL parameter
 ResolvedDLynchT399612 Create VE Suggestion Mode MVP
 ResolvedDLynchT401342 Tone check forcing itself selected interferes with other checks
 DuplicateNoneT404599 [SPIKE] Decide what – if any – features will we remove from Suggestion Mode MVP
 ResolvedppelbergT397379 Identify initial set of suggestions to surface within Suggestion Mode
ResolvedBUG REPORTDLynchT413279 Convert Reference Suggestion - restrict to references that are just a link
 ResolvedBUG REPORTEsandersT413277 External link check should ignore links to Sister Projects
 OpenNoneT414898 Facilitate conversion of external links to references in External Link Check
 ResolvedbmartinezcalvoT406808 Conduct usability study of Suggestion Mode MVP (newcomers)
 ResolvedppelbergT407168 Gather qualitative feedback about Suggestion Mode MVP (Sr. Contributors)
 ResolvedQuiddityT409604 Invite volunteers to a community conversation about edit suggestions/signals
 ResolvedDLynchT407170 Create Superset dashboard to see how edit suggestions are performing (overall and by type)
 ResolvedmedeliusT407286 Log sub-types of textmatch checks to VEFU
 ResolvedmedeliusT409206 Add instrumentation to detect when someone starts an edit session with suggestions enabled
 ResolvedDLynchT408890 Write script that will cause Suggestion Mode to be enabled by default
 ResolvedppelbergT409605 Record and share a demo of the TextMatch work in progress
 ResolvedmedeliusT410955 Implement editcheck config option to specify minimum edit count
 ResolvedppelbergT411149 Publish Suggestion Mode project page
 ResolvedEsandersT411380 Experimental DisambiguationEditCheck doesn't work in suggestion mode
 ResolvedmedeliusT413419 Append a tag to edits in which ≥1 expanded Edit Suggestion was visible in the browser viewport
 ResolvedmedeliusT412334 Add instrumentation to measure suggestion visibility within VisualEditor
 ResolvedzoeT413420 [Suggestion] Detect when a variety of English is being used that does not align with article's tag
 ResolvedzoeT413763 Implement a "variety of english" edit check using the new TextMatchEditCheck implementation
 DeclinedzoeT414191 Add link filter to TextMatchEditCheck?
 ResolvedQuiddityT414627 Implement a volunteer-written wordlist to base the initial Engvar Edit Suggestion on
 ResolvedDLynchT414694 TextMatchEditCheck doesn't reflect ignoreLeadSection on individual match configurations
 ResolvedmedeliusT411662 Consider splitting up Edit Check config
 ResolvedzoeT413421 [Suggestion] Detect if an internal link appears >1x in the same section
 OpenzoeT415381 Bug: DuplicateLinkEditCheck - in a long section the widget appears in the wrong place
 ResolvedDLynchT416049 Duplicate Links: reduce the scope of the check to only find duplicates within a single paragraph
 ResolvedBUG REPORTEsandersT413276 External link check should not be shown within subsections of the excluded sections
 ResolvedQuiddityT414854 Announce availability of Suggestion Mode beta feature (en.wiki)
 ResolvedFeaturemedeliusT409476 Allow EditChecks to be check-only or suggestion-only
 ResolvedBUG REPORTmedeliusT407849 EditCheck doesn't detect a sfn template and shows message about absent source
 ResolvedDLynchT415226 Inserted templates and preexisting templates have very different structures
 ResolvedEsandersT415504 EditCheck: Create beta feature preference
 ResolvedDLynchT415936 Implement v1 of Suggestion feedback flow
 ResolvedppelbergT414987 Review/update copy and internationalisation (i18n) of all check/suggestion types
 ResolvedppelbergT415849 Define Edit Suggestion card copy for en.wiki Beta Feature release
 ResolvedppelbergT415323 Create a community configurable way to include links within Edit Check/Suggestion Cards
 DuplicateNoneT415321 Suggestions: Review/update copies of all suggestions types
 ResolvedppelbergT417112 Conduct holistic QA of Suggestion Mode MVP release
 ResolvedEsandersT417113 Scroll position lost when tapping an Edit Suggestion (mobile)
 ResolvedQuiddityT417731 Announce availability of Suggestion Mode beta feature (all Wikipedias)
 ResolvedbmartinezcalvoT415926 Conduct usability study: Mobile edit toolbar improvements
 ResolvedBUG REPORTEsandersT74949 [Suggestion] Detect bold in headings
 OpenppelbergT415304 [Suggestion mode] Differentiate copy for suggestions and checks
 OpenNoneT416055 [SPIKE] How might we lower the likelihood that Suggestions cause/escalate edit wars
 ResolvedDLynchT416517 Update the Edit_check/Configuration page
 ResolvedDLynchT416535 Append a tag to published edits in which someone acts on an Edit Suggestion
 ResolvedRyasmeenT416511 TextMatchEditCheck: Add support for links in matchItem descriptions
 OpenNoneT417468 [SPIKE] Decide how to handle cases where citation suggestions appear for quotes
 DuplicateNoneT417813 Publish Suggestion Mode controlled experiment plan
 ResolvedEsandersT417114 "Experimental Check" warning appears within Suggestion Mode (beta feature)
 OpenNoneT417960 Edit Checks become lost when navigating back to "Mid-Edit" moment from "Pre-Save"
 ResolvedEsandersT417942 Help panel and Edit Check pagination conflict
 DeclinedNoneT418390 Determining treatment group exposure rates for Suggestion Mode MVP
 ResolvedppelbergT418530 [SPIKE] Decide whether the Suggestion Mode MVP controlled experiment will run on Test Kitchen
 OpenMNeislerT398369 [Suggestion Mode] Publish Measurement Plan
 ResolvedEsandersT418404 EditCheck: On mobile, a check should only become "active" when it is visible
 DuplicateNoneT419064 "Add image caption" suggestion appears even when a template is present
 ResolvedppelbergT419066 [Suggestion Mode] Report on leading indicators
 ResolvedDLynchT419487 Image Caption Needed: adjust suggestion card copy
 ResolvedDLynchT420245 Implement Suggestion Mode Toggle (v0.1)
 ResolvedEsandersT420268 Implement Suggestion Mode Toggle (v0.2)
 ResolvedmedeliusT420381 Enable filtering by wiki within the "Edit check: suggestions" superset dashboard
 Resolved• SLong-WMFT420249 Log Check generation errors to the server
 ResolvedmedeliusT419447 Instrument performance monitoring for Edit Checks and Suggestions
 ResolvedQuiddityT420664 Identify participating wikis for Suggestion Mode MVP A/B experiment
 ResolvedQuiddityT420667 [Suggestion Mode] Announce proposed start of controlled experiment
 ResolvedmedeliusT421189 Start Suggestion Mode experiment in TestKitchen
 ResolvedEsandersT422032 Update normal-enabled-flagged button colours in OOUI
 ResolvedEsandersT422031 Implement large/small buttons in OOUI
 OpenBUG REPORTmedeliusT423740 Instrumentation to measure checks/suggestions shown within VisualEditor broken on mobile
 ResolvedDLynchT421764 "View suggestions" button on mobile: display the bottom sheet after scrolling
 ResolvedmpopovT422736 Define and implement any missing metrics needed for Suggestion Mode controlled experiment
 ResolvedmedeliusT422740 Implement Suggestion Mode instrumentation spec in Test Kitchen
 ResolvedppelbergT425595 [EPIC] Resolve outstanding UX issues/improvements post-experiment start
 InvalidNoneT425594 Suggest card not shown when tapping "View suggestions"
 ResolvedppelbergT414518 Suggestion Mode: Ensure first suggestion discoverability when entering Edit mode regardless of viewport position
 ResolvedbmartinezcalvoT415933 Conduct usability study: First suggestion discoverability when entering Edit mode regardless of viewport position
 ResolvedmedeliusT422979 Ensure first suggestion discoverability when it's outside the current section being edited on mobile
 ResolvedppelbergT422229 Context menu goes blank and locks up when removing duplicate link
 ResolvedEsandersT426236 Mobile VE: Page scrolls to wrong position after using 'Edit full page' from lead section
 ResolvedBUG REPORTEsandersT426237 SuggestionMode: Exiting out of ReferenceCheck shows the virtual keyboard
 ResolvedEsandersT426240 Slow down "View suggestions" animation
 InvalidNoneT426284 [SPIKE] Investigate why "View suggestions" not appearing
 DuplicateNoneT433898 Conduct pre-mortem prior to enabling Suggestion Mode by default

Event Timeline

ppelberg created this task.Jul 1 2026, 9:01 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 1 2026, 9:01 PM
ppelberg mentioned this in T404600: [MILESTONE] Run controlled experiment of Suggestion Mode MVP.Jul 1 2026, 9:02 PM
ppelberg added a subtask: T404600: [MILESTONE] Run controlled experiment of Suggestion Mode MVP.
ppelberg added a parent task: T414853: [MILESTONE] Deploy Suggestion Mode as a default-on feature..
Maintenance_bot added a project: VisualEditor.Jul 1 2026, 9:29 PM
ppelberg closed subtask T404600: [MILESTONE] Run controlled experiment of Suggestion Mode MVP as Resolved.Jul 24 2026, 6:57 PM
ppelberg assigned this task to Quiddity.Jul 24 2026, 9:13 PM
ppelberg triaged this task as High priority.
ppelberg edited projects, added: Editing-team (FY2026-27 Q1 sprint 3); removed: Editing-team.
ppelberg updated the task description. (Show Details)
ppelberg moved this task from Incoming to Release Prep on the Editing-team (FY2026-27 Q1 sprint 3) board.
ppelberg moved this task from Release Prep to Blocked on the Editing-team (FY2026-27 Q1 sprint 3) board.Jul 24 2026, 10:09 PM

Update
Ok. I've drafted an update for publishing on-wiki.

Next steps:

  1. Review draft with Megan and Julie, most likely the week of 3 August 2026.
  2. Work with Nick to define how/where we'll announce the availability of these findings so volunteers around the movement are aware of them
ppelberg created subtask T433898: Conduct pre-mortem prior to enabling Suggestion Mode by default.Aug 3 2026, 10:20 PM
ppelberg moved this task from Incoming to Release Prep on the Editing-team (FY2026-27 Q1 sprint 5) board.Wed, Aug 19, 4:45 PM
ppelberg edited projects, added: Editing-team (FY2026-27 Q1 sprint 5); removed: Editing-team (FY2026-27 Q1 sprint 3).
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits