Page MenuHomePhabricator
Create Task
Maniphest T322910

Add a link: Deploy prioritization of underlinked articles feature
Closed, ResolvedPublic
Actions

Description

The work in T301096: Add a link: prioritize suggestions of underlinked articles allows us to configure a underlinkedWeight property for the link recommendation task type. By default, articles to be used for link recommendation tasks are selected at random; when underlinkedWeight is set, articles with few links (compared to the number of words in the article) are selected with a higher probability. (The exact formaly is given at T301096#8388234.)

We want to progressively roll out the new functionality to different wikis. Per @KStoller-WMF's comment in T301096#8387455, we should first deploy to pilot wikis, wait for / gather feedback, then rollout to all wikis.

In case of problems, the old functionality can be restored simply by removing the underlinkedWeight key from the Growth configuration page (MediaWiki:NewcomerTasks.json).

Acceptance Criteria

  • Prioritization of underlinked articles is enabled on testwiki and the four pilot wikis (arwiki, bnwiki, cswiki, eswiki).
  • Feedback is gathered from the pilot wikis (and no issues are identified).
  • Prioritization of underlinked articles is enabled by default.

Related Objects
Search...

Event Timeline

kostajh created this task.Nov 11 2022, 10:10 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptNov 11 2022, 10:10 AM
kostajh added a parent task: T315732: [EPIC] Structured Tasks: Patroller Focus.Nov 11 2022, 10:11 AM
kostajh mentioned this in T301096: Add a link: prioritize suggestions of underlinked articles.
kostajh triaged this task as Medium priority.Nov 14 2022, 1:04 PM
kostajh moved this task from Incoming to Ready for Development on the Growth-Team (Sprint 0 (Growth Team)) board.
Tgr subscribed.Nov 16 2022, 2:30 AM

We can do this after the train deploy on Thursday (or before, but it will have no effect until then).

Trizek-WMF subscribed.Nov 16 2022, 4:15 PM
Tgr changed the task status from Open to In Progress.Nov 18 2022, 7:08 AM
Tgr claimed this task.
Tgr moved this task from Ready for Development to In Progress on the Growth-Team (Sprint 0 (Growth Team)) board.
MShilova_WMF added a project: Add-Link.Dec 15 2022, 3:09 PM
Tgr updated the task description. (Show Details)Jan 3 2023, 9:13 PM
Tgr added a comment.Jan 3 2023, 10:47 PM

Note that this happened today, not in November as suggested in the previous comment.

Tgr added a comment.Jan 4 2023, 2:32 AM

The formula used is (1-(links/words))^4, with the assumption that there are always more words than links. This did not work: words are counted in wikitext, while links are counted via MediaWiki link tracking which includes links from templates. So on short articles with navigation templates, links/words is a large number, and since we are using an even power for smoothing, we end up with a very large weight, resulting in not particularly useful suggestions.

Also for word count we use the text.word_count field, which is apparently some kind of cleaned text with no templates, tables etc so articles like this one with lots of links in tables cause the same issue.

Disabled for now, will retry after making sure links/words can't make the weight go over 1.

KStoller-WMF added a comment.Jan 4 2023, 3:17 AM

Interesting, thanks for explanation and quickly disabling!

Tgr added a comment.Jan 4 2023, 10:40 PM

Re-enabled after a fix, seems to be working well. (I did not update the configuration on arwiki as link recommendations are disabled there anyway.)

Tgr updated the task description. (Show Details)Jan 4 2023, 10:40 PM
Tgr moved this task from In Progress to Blocked / Needs work on the Growth-Team (Sprint 0 (Growth Team)) board.
IZapico-WMF subscribed.Jan 6 2023, 6:01 PM
gerritbot added a comment.Mar 8 2023, 6:32 AM

Change 895376 had a related patch set uploaded (by Gergő Tisza; author: Gergő Tisza):

[mediawiki/extensions/GrowthExperiments@master] Add link: Enable prioritizing underlinked tasks by default

https://gerrit.wikimedia.org/r/895376

gerritbot added a project: Patch-For-Review.Mar 8 2023, 6:32 AM
Tgr closed this task as Resolved.Mar 8 2023, 6:35 AM

Evaluation happened in T301096#8645360 and there is T330535: Add a link: prioritize suggestions of underlinked articles: scale to all wikis for scaling so I think we can close this.

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL