Page MenuHomePhabricator

[EPIC] Generate and present edit suggestions at scale
Open, Needs TriagePublic

Description

This ticket is meant to gather the work required to build a system that generates actionable edit suggestions that can be presented in an open-ended set of moments/places within the interface. Think: Newcomer homepage, read mode, visual editor, WikiProjects, events, etc.

Stories

NOTE: @ppelberg you might want to write a variation of these stories through the lens of the people/teams building the experiences the current stories describe and what format(s) they would need 1) suggestions to be in and 2) methods these suggestions would need to be delivered in to power them.
  • As a campaign, WikiProject, event, etc. organizer, I'd like to generate a manageable overview on-wiki of actionable edits from defined article set (e.g. manually, articles that belong to certain categories, etc.) so that I can easily identify "low hanging fruit" suggestion to present to participants and track our progress on completing them
  • As an engaged reader who is in the midst of reading an article on Wikipedia, I'd value knowing if there are improvements I can consider making that are a) a fit for the limited (if any) experience I have editing Wikipedia and b) small/light, specific, actionable, and structured/constrained enough for me to feel like they won't "pull me out" of the reading/learning I'm doing, so that I can engage more deeply with the material I am curious about/interested in with the added benefit of feeling proud for contributing to the resource (Wikipedia) I value
    • Talk to @KStoller-WMF ("Add a link" in read mode experiment, non-editing participation, etc.), @ovasileva, TBD...
  • As a new account holder who is motivated to edit/contribute to Wikipedia and is viewing suggested edits on the Newcomer homepage, I'd value being able to browse a broad range of compelling edit suggestions [i], so that when I feel moved to edit Wikipedia I can be relatively certain that I can quickly and easily find something to do that will align with what I'm interested in and motivated by in that particular moment
    • Think about the "Add reference" Suggested Edit and the extent to which the feedback some volunteers at es.wiki shared about the task has to do with the suggestion not pointing people to the specific part of an article that needs a reference.
  • As someone who curiously clicked/tapped edit an article I'm reading, I'd value being able to easily see edits aligned with my interest and experience that I could consider making, so that I can engage more deeply with the material I am curious about/interested in with the added benefit of feeling proud for contributing to the resource (Wikipedia) I value

Components

A WIP list of the various components to the user experience...

  • Showing / hiding suggestions
  • Treatment: how "suggestions" are visually presented
    • Rationale: why this suggestion
    • Actions: what choices the suggestion presents to you
  • Navigation: moving between suggestions
  • State: various states a suggestion can take on
  • Source: who/what is making the suggestion (a volunteer, a machine, etc.)

Data/Evidence

References

Screenshot 2025-10-28 at 15.57.39.png (1×1 px, 205 KB)

image.png (1×3 px, 1 MB)

  • WikiFix: uses LLMs to find inconsistencies in Wikipedia. //via @Pablo
  • Noam Brown on X/Twitter showing how they prompt ChatGPT to identify potential errors within the Wikipedia articles they're reading:

Screenshot 2025-10-06 at 16.28.05.png (1×1 px, 583 KB)

  • SuggestBot via @nettrom_WMF
    • Seeks to help Wikipedia contributors find articles to edit.
  • WikiProject X
    • At one point, @nettrom_WMF + @Harej were thinking about extending SuggestBot to offer WikiProject-spcific suggestions
  • https://bambots.brucemyers.com/cwb/bycat/Africa.html via @CMyrick-WMF
  • T404467: Design exploration: Collaborative tracking against a worklist via @ifried
    • The suggestions we (Editing et al) end up creating to populate suggestion mode with could, very well, be used to help volunteers/organizers create lists of immediately actionable edits
  • Automate the discovery of structured improvement tasks for Vital Knowledge articles via @SEgt-WMF
  • Wish: Apply AI to article improvement suggestions on the homepage: "A much better AI system than the previous one that recommends articles for improvement would help editors going through this, including new and veteran users."
  • WikiVault (ko, en) by @Ykhwong: an integrated AI machine translation, researching, and writing tool called WikiVault. The tool currently has three main functions.
    • Translation: Using AI to provide more accurate translations
    • Writing: Using AI to quickly draft articles
    • Quick running: Quickly access AI features on any screen using shortcut keys
  • "AI that helps editors address problems with Wikipedia is welcome (if it works). We already use it, in various places, to varying degrees of success, and to relatively little pushback. ." | via @asilvering (source)
  • "A next-level deployment would be for AI to read the sources of the article, summarize those, and then compare its summary to the written article, and post suggestions for changes on the talk page. A next-next-level deployment would be for AI to suggest new sources for the articles, or to read and summarize sources that aren't in the article, and then post edit suggestions to the talk page. AFAIK AI isn't ready for this level yet, but the first two suggestions above could probably be done today with reasonable accuracy using large and small language models. I hope the WMF keeps developing, experimenting, testing, and iterating on these approaches." | via @Levivich (source)
  • "This is what we want. AI that supports editors. The human makes the decisions, the AI can only propose improvements but is incapable of doing anything." | via @Polygnotus (source)
  • "A few months ago I obtained an AI generated list of typos on Wikipedia. I went through much of it manually, fixed a bunch of typos, made some suggestions for additional searches for AWB typo fixing, but ignored a whole bunch of AI errors that were either wrong or Americanisations." | WereSpielChequers describing how they're using AI to identify ways to improve existing Wikipedia content.
  • For volunteers to be motivated to author Check suggestions, they'll need evidence that doing so results in people seeing said Checks and ultimately, acting upon them
  • We ought to be open-minded about what can potentially cause a suggestion to be shown? E.g. do suggestions need to be gated behind someone explicitly asking for them to be revealed? Might suggestions be shown in an existing or yet-to-be-introduced moment (e.g. post-save)?
  • What do we mean by "Suggestions" in this context? More broadly, we need to become clear about the vocabulary around this system.
    • At least two internal meanings: 1) "Show me Checks applied to content I didn't write.", 2) "Show me low priority Checks for content I did write.", and 3) The moment in which the Check is shown (mid-Edit, Pre-Save, etc.)
      • Need to avert confusion with Growth's existing work on Suggested Edits.
  • To what extent does it need to be clear who authored the Check? //An AI, a volunteer, Wikipedia/the platform..."/
  • Screenshot showing how @Polygnotus uses a userscript while viewing Wikipedia to identify ways to improve the Wikipedia articles they are viewing:
    • image.png (923×1 px, 388 KB)
  • Screenshot 2025-05-15 at 11.24.02.png (280×712 px, 51 KB)
  • WP:AutoWikiBrowser
  • 11 April 2025 via @DLynch: “Suggestion mode” — existing edit checks applied to the entire article, not just your own changes.
    • image.png (594×719 px, 194 KB)

i. "Compelling edit suggestions" = aligned with my experience level, availability (read: time), and access (read: device(s))

Related Objects

View Standalone Graph
This task is connected to more than 200 other tasks. Only direct parents and subtasks are shown here. Use View Standalone Graph to show more of the graph.
StatusSubtypeAssignedTask
OpenNone
OpenFeatureNone
ResolvedKStoller-WMF
OpenNone
OpenNone
OpenNone
OpenNone
OpenNone
OpenNone
Resolveddchen
OpenNone
Resolvedppelberg
OpenNone
OpenNone
OpenNone
OpenNone
OpenNone
OpenNone
OpenDLynch
OpenNone
OpenNone
OpenNone
OpenNone
OpenNone
StalledFeatureNone
OpenNone
OpenNone

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes

Change #1162037 had a related patch set uploaded (by DLynch; author: DLynch):

[mediawiki/extensions/VisualEditor@master] WIP suggestions mode

https://gerrit.wikimedia.org/r/1162037

ppelberg updated the task description. (Show Details)
ppelberg added a subscriber: ifried.
ppelberg renamed this task from [EPIC] Offer people edit suggestions within VE to [EPIC] Generate edit suggestions at scale.Sep 19 2025, 6:01 PM
ppelberg updated the task description. (Show Details)
ppelberg renamed this task from [EPIC] Generate edit suggestions at scale to [EPIC] Generate and present edit suggestions at scale.Sep 19 2025, 9:10 PM

@ppelberg, related work may also be:

  • T404467: The Connection team may do a design exploration for this work in this quarter or next quarter. The basic idea is that people often like creating, sharing, and working off of worklists, since it can give a scope of work that is both clear and specific. Relates to research findings that people also like to work on very specific, niche stuff rather than general topics in some cases. The particular application we're thinking for this work is for collaborative contributions, so organizers can set worklists for events or individual editors can set worklists for personal challenges. But I can see this work connecting to some of the work you have shared in this ticket.
  • T405754: You can talk to @SEgt-WMF to learn more about this one, which is also related!
ppelberg updated the task description. (Show Details)
ppelberg added a subscriber: EBlackorby-WMF.
ppelberg updated the task description. (Show Details)
ppelberg added a subscriber: Sj.

Suggestion idea:

  • Show the reading level/length alongside sections so that volunteers can at least consider whether the content could benefit from being written more concisely/simply
ppelberg updated the task description. (Show Details)
ppelberg added a subscriber: Samwalton9-WMF.
ppelberg updated the task description. (Show Details)