User story

As a Product Manager, I want to be sure we follow up with communities after we have completed work to improve Structured Tasks based on community feedback.

As a Product Manager, I want Growth pilot wikis to have all Growth features enabled, because receiving pilot wiki feedback on Growth features is the main reason we work closely with pilot wikis and product ambassadors.

Details

After the deployment of Structured tasks, we received feedback from various communities regarding how recent changes patrollers were feeling overwhelmed by an increase of edits to check, how some edits were of poor quality or poor relevance. The feedback was gathered at https://www.mediawiki.org/wiki/Growth/Personalized_first_day/Structured_tasks/Community_feedback and some tasks were added to: Patroller Focus epic T315732, which addresses several requested improvements along with work to make some changes based on community feedback.

Actions taken

We based our work on the feedback received. Several points of improvement have been addressed:

• Actions taken to address patrollers fatigue:
  • By default, newcomers can complete up to 25 "add a link" tasks per day. If patrollers are overburdened, each community can now use Special:EditGrowthConfig to lower this number.

• Actions taken to increase the quality of edits:
  • "Edit quality" is not a well-defined concept. We initiated a discussion and summarized the findings at https://www.mediawiki.org/wiki/Growth/Communities/Quality_of_edits
  • We increased the confidence score on link suggestions, so it's more likely the suggestions are relevant and links that will be appreciated by readers. T316079
  • We now prioritize articles that are considered "underlinked" T330535
  • The number of suggested links per article has been lowered to 3. T301095 This can be changed at Special:EditGrowthConfig. Communities can also exclude links from articles containing certain templates or categories.
  • We completed work to ensure lists and disambiguation pages don't receive image suggestions. T316794 & T320656
  • We worked with other WMF teams to improve how Suggested Edits (like "add a link") are populated: Suggested Edits are now receiving topic predictions via the new Language-Agnostic Topic Classification. This change affects non-English Wikipedia wikis. It will ensure newcomers receive a greater diversity of task recommendations. Before, as this feature was a test, English Wikipedia was used to select topics. The change is gradual as lists of topics are refreshed when they become empty. The Research team will evaluate the impact in a few months. T328276
  • We conducted newcomer task analysis to better understand if newcomers got "stuck" doing easy tasks like "add a link". T311888 And then we released "Leveling up" features to ensure newcomers progressed to more meaningful tasks after success with structured tasks like "add a link". T317813

Acceptance Criteria:

• Start a discussion on Arabic Wikipedia: Summarize the improvements made since the "add a link" task was disabled, along with the newcomer benefits of this task. Suggest an approach for enabling this task that might be accepted (Lower task limit? Lower maximum number of links per task? More template or category limitations added to EditGrowthConfig? ).
• Respond to questions and concerns in the discussion
• Summarize discussion in English for the Growth team