Page MenuHomePhabricator

Community discussion about "add a link" with Arabic Wikipedia
Closed, ResolvedPublic

Description

User story

As a Product Manager, I want to be sure we follow up with communities after we have completed work to improve Structured Tasks based on community feedback.

As a Product Manager, I want Growth pilot wikis to have all Growth features enabled, because receiving pilot wiki feedback on Growth features is the main reason we work closely with pilot wikis and product ambassadors.

Details

After the deployment of Structured tasks, we received feedback from various communities regarding how recent changes patrollers were feeling overwhelmed by an increase of edits to check, how some edits were of poor quality or poor relevance. The feedback was gathered at https://www.mediawiki.org/wiki/Growth/Personalized_first_day/Structured_tasks/Community_feedback and some tasks were added to: Patroller Focus epic T315732, which addresses several requested improvements along with work to make some changes based on community feedback.

Actions taken

We based our work on the feedback received. Several points of improvement have been addressed:

  • Actions taken to address patrollers fatigue:
    • By default, newcomers can complete up to 25 "add a link" tasks per day. If patrollers are overburdened, each community can now use Special:EditGrowthConfig to lower this number.
  • Actions taken to increase the quality of edits:
    • "Edit quality" is not a well-defined concept. We initiated a discussion and summarized the findings at https://www.mediawiki.org/wiki/Growth/Communities/Quality_of_edits
    • We increased the confidence score on link suggestions, so it's more likely the suggestions are relevant and links that will be appreciated by readers. T316079
    • We now prioritize articles that are considered "underlinked" T330535
    • The number of suggested links per article has been lowered to 3. T301095 This can be changed at Special:EditGrowthConfig. Communities can also exclude links from articles containing certain templates or categories.
    • We completed work to ensure lists and disambiguation pages don't receive image suggestions. T316794 & T320656
    • We worked with other WMF teams to improve how Suggested Edits (like "add a link") are populated: Suggested Edits are now receiving topic predictions via the new Language-Agnostic Topic Classification. This change affects non-English Wikipedia wikis. It will ensure newcomers receive a greater diversity of task recommendations. Before, as this feature was a test, English Wikipedia was used to select topics. The change is gradual as lists of topics are refreshed when they become empty. The Research team will evaluate the impact in a few months. T328276
    • We conducted newcomer task analysis to better understand if newcomers got "stuck" doing easy tasks like "add a link". T311888 And then we released "Leveling up" features to ensure newcomers progressed to more meaningful tasks after success with structured tasks like "add a link". T317813

Acceptance Criteria:

  • Start a discussion on Arabic Wikipedia: Summarize the improvements made since the "add a link" task was disabled, along with the newcomer benefits of this task. Suggest an approach for enabling this task that might be accepted (Lower task limit? Lower maximum number of links per task? More template or category limitations added to EditGrowthConfig? ).
  • Respond to questions and concerns in the discussion
  • Summarize discussion in English for the Growth team

Event Timeline

KStoller-WMF set Due Date to May 31 2023, 7:00 AM.
KStoller-WMF updated the task description. (Show Details)

@Dyolf77_WMF / @KStoller-WMF: Hi, the Due Date set for this open task passed a while ago.
Could you please either update or reset the Due Date (by clicking Edit Task), or set the status of this task to resolved in case this task is done? Thanks!

KStoller-WMF changed the task status from Open to In Progress.Jul 25 2023, 4:52 PM
KStoller-WMF updated the task description. (Show Details)

@Dyolf77_WMF & @Trizek-WMF - I have added more details including links to the associated Phab tasks where we made the improvements discussed. There might be other improvements I'm missing, for example, I'm not sure if T322813: Add moderator-focused description of Newcomer tasks, so we can update `Newcomer task` tags is worth mentioning... so please feel free to fact check this list. Thanks!

@Dyolf77_WMF & @Trizek-WMF - I have added more details including links to the associated Phab tasks where we made the improvements discussed. There might be other improvements I'm missing, for example, I'm not sure if T322813: Add moderator-focused description of Newcomer tasks, so we can update `Newcomer task` tags is worth mentioning... so please feel free to fact check this list. Thanks!

Thanks!

FYI @Dyolf77_WMF: I've revalidated add a link suggestions for arwiki as a part of T316079: Bump threshold for confidence score on link recommendation service suggestions. I figured that only ~28% of suggestions met the confidence threshold of 0.6 we have defined. I refreshed all suggestions to fix that; there are now slightly less articles in the task pool, but the suggestions should be more reliable. If you have any questions, please feel free to let me know.

FYI @Dyolf77_WMF: I've revalidated add a link suggestions for arwiki as a part of T316079: Bump threshold for confidence score on link recommendation service suggestions. I figured that only ~28% of suggestions met the confidence threshold of 0.6 we have defined. I refreshed all suggestions to fix that; there are now slightly less articles in the task pool, but the suggestions should be more reliable. If you have any questions, please feel free to let me know.

Thanks, @Urbanecm_WMF
Good to know about this improvement.

Arabic Wikipedia admins are resistant to re-enabling the task. As a Growth pilot wiki we would prefer the task enabled, but we will respect the wishes of the community and leave it disabled. I'm going to resolve this task.