This task tracks the work involved with deploying the initial set of LLM-generated MoS edit suggestions in an experimental state within Suggestion Mode at Phase 1 wikis. Which, in this case, is en.wiki.

Stories

As an experienced editor at en.wiki who has Suggestion Mode enabled, I want to see edit suggestions surfaced within the articles I'm editing so that I can quickly discover concrete, and actionable improvements without having to scan the entire page myself.
As WMF staff responsible for the Edit Suggestion pipeline, I want to understand how experienced volunteers are engaging with the LLM-generated suggestions, so that I can assess the quality/reliability of this initial set and ultimately decide, whether this suggestion generation method seems reliable enough to show to newcomers

Decision(s) to be made

1. Learn whether experienced volunteers at en.wiki think the experimental suggestions are sufficiently reliable to be shown to newcomers so that we can decide: Will we invest the effort to scale this initial set of LLM-generated MoS suggestions across languages via T431376?

Deployment timeline

Target date	Description	Task(s)	Status
Thursday, 6 Aug 2026	Deploy LLM-generated MoS suggestions as `experimental` to experienced en.wiki editors

Open question(s)

1. How might we enable volunteers to customize the language that appears within each LLM-generated suggestion card?
2. How will we evaluate whether these volunteers are sufficiently useful and reliable to scale these suggestions to more people (both on en.wiki and at other projects)?

Related Objects
Search...

Status	Assigned	Task
Open	None	T431377 [MILESTONE] Launch controlled experiment of LLM-generated MoS Suggestions
Open	None	T431376 [Milestone] Deploy LLM-generated MoS suggestions as experimental (Phase 2)
Open	None	T428311 [Milestone] Deploy LLM-generated MoS suggestions as experimental (Phase 1)
Resolved	OKarakaya-WMF	T427794 Editing Suggestions - api
Open	ppelberg	T428492 Define actions that can be taken by model-generated suggestions
Open	DLynch	T428641 Build PoC for integrating initial set of MoS LLM-generated suggestions into Suggestion Mode as `experimental`
Resolved	OKarakaya-WMF	T428740 LLM Generated Editing Suggestions - API changes.
Open	DLynch	T430720 LLM generated suggestions: attach the suggestion UUID to more events
Open	None	T429058 Introduce a way to enable "experimental" suggestions
Open	None	T432155 Experimental suggestions: Update the design of the card
Open	None	T432666 Implement calls to action for experimental LLM-generated MoS suggestions
Open	OKarakaya-WMF	T430030 Editing Suggestions - Update static descriptions.

Event Timeline

ppelberg created this task.Jun 5 2026, 10:50 PM

Restricted Application added a subscriber: • Aklapper. · View Herald TranscriptJun 5 2026, 10:50 PM

ppelberg updated the task description. (Show Details)Jun 5 2026, 10:52 PM

isarantopoulos updated the task description. (Show Details)Jun 7 2026, 2:38 PM

i am claming this task

isarantopoulos removed AROHI_SINGH as the assignee of this task.Jun 7 2026, 3:07 PM

isarantopoulos removed a subscriber: AROHI_SINGH.

achou added a parent task: T409863: Q2 FY2025-26 Goal: Generate a list of edit suggestions using machine learning.Jun 8 2026, 8:18 AM

achou added a subtask: T427794: Editing Suggestions - api.

DLynch created subtask T428492: Define actions that can be taken by model-generated suggestions.Jun 8 2026, 6:14 PM

OKarakaya-WMF closed subtask T427794: Editing Suggestions - api as Resolved.Jun 9 2026, 10:08 AM

ppelberg updated the task description. (Show Details)Jun 9 2026, 3:38 PM

ppelberg updated the task description. (Show Details)Jun 9 2026, 3:40 PM

ppelberg created subtask T428641: Build PoC for integrating initial set of MoS LLM-generated suggestions into Suggestion Mode as `experimental`.Jun 9 2026, 3:57 PM

Change #1299651 had a related patch set uploaded (by DLynch; author: DLynch):

[mediawiki/extensions/VisualEditor@master] New edit check: LLM suggestions

https://gerrit.wikimedia.org/r/1299651

gerritbot added a project: Patch-For-Review.Jun 9 2026, 11:24 PM

Hey @ppelberg , thank you for creating this task.
Could you help me to understand how we target experienced editors?
Can any user (experienced or not) enable editing suggestions (or llm generated editing suggestions) ? or is experimental mode only for experienced users.
Is this specific to LLM generated suggestions or does it apply to all suggestions?
Will some users already know the articles with LLM generated editing suggestions?

Thank you!

Hey @ppelberg ,

I have a question around how we plan to run this experiment and how the new batch of suggestions should look like.
We will generate a new set of suggestions soon.

How many suggestions should we create and which articles we should target depends on how we run the experiment.

Option1: We show suggestions to users only when they click edit and we don't inform the experienced users in advance.
- In this case we need to generate more suggestions to increase the chance of the suggestions being seen.
- We can also target articles that are frequently edited with a certain threshold. This should help with increasing the chance of suggestions being seen and we prefer not to suggest edits for articles that get many edits.
Option2: We let users know which pages have edits in advance.
- In this case, we don't need to pick articles by their edit count.
- Low amount of suggestions would be enough similar to what we currently have in the api.

I think we go with option1 but I wanted to share some thoughts and make it clear.

So does option 1 is a part of Suggestion Mode and option 2 a part of something like newcomer's dashboard? Could they be enabled both? (in the future, not in this experiment)

Hey @Wellverywell , good suggestion!
I think it's feasible to have them in the newcomer's dashboard in the future.

ppelberg renamed this task from Deploy LLM-generated MoS suggestions as experimental to [Milestone] Deploy LLM-generated MoS suggestions as experimental.Wed, Jul 1, 7:04 PM

Maintenance_bot added a project: VisualEditor.Wed, Jul 1, 7:29 PM

ppelberg added a subtask: T429058: Introduce a way to enable "experimental" suggestions.Tue, Jul 7, 5:48 AM

ppelberg renamed this task from [Milestone] Deploy LLM-generated MoS suggestions as experimental to [Milestone] Deploy LLM-generated MoS suggestions as experimental (en.wiki).Tue, Jul 7, 6:00 AM

ppelberg renamed this task from [Milestone] Deploy LLM-generated MoS suggestions as experimental (en.wiki) to [Milestone] Deploy LLM-generated MoS suggestions as experimental (Phase 1).

ppelberg updated the task description. (Show Details)

ppelberg updated the task description. (Show Details)Tue, Jul 7, 6:03 AM

ppelberg updated the task description. (Show Details)Tue, Jul 7, 6:13 AM

ppelberg updated the task description. (Show Details)Tue, Jul 7, 6:21 AM

ppelberg added a parent task: T431376: [Milestone] Deploy LLM-generated MoS suggestions as experimental (Phase 2).Tue, Jul 7, 6:25 AM

ppelberg removed a parent task: T409863: Q2 FY2025-26 Goal: Generate a list of edit suggestions using machine learning.

ppelberg mentioned this in T431377: [MILESTONE] Launch controlled experiment of LLM-generated MoS Suggestions.Tue, Jul 7, 6:31 AM

ppelberg added a parent task: T431377: [MILESTONE] Launch controlled experiment of LLM-generated MoS Suggestions.

ppelberg removed a parent task: T431377: [MILESTONE] Launch controlled experiment of LLM-generated MoS Suggestions.

ppelberg added a subtask: T432155: Experimental suggestions: Update the design of the card.Fri, Jul 17, 4:44 AM

ppelberg created subtask T432666: Implement calls to action for experimental LLM-generated MoS suggestions.Mon, Jul 20, 11:21 PM

ppelberg added a subtask: T430030: Editing Suggestions - Update static descriptions..Mon, Jul 20, 11:27 PM