Page MenuHomePhabricator

ruwiki - incorrect add link suggestions
Open, Needs TriagePublic

Description

Note: The examples are not specific to ruwiki - I have few examples from other language wikis where add link suggestions present similar problems.

(1) Couple of examples when add link suggests a link to a movie

https://ru.wikipedia.org/wiki/Десятичный_логарифм
ru_wiki_link_movie.png (680×2 px, 247 KB)
- the suggestions is made (in the context of Math article) from a common word "obvious" to the article about the TV series that has that word in its title: https://ru.wikipedia.org/wiki/Очевидное (https://en.wikipedia.org/wiki/Transparent_(TV_series))
https://ru.wikipedia.org/wiki/Рейдерство_(бизнес)
Screen Shot 2021-08-05 at 2.21.46 PM.png (822×1 px, 237 KB)
- the add link suggestion is made for a common word "billions" to the TV series https://ru.wikipedia.org/wiki/Миллиарды (https://en.wikipedia.org/wiki/Billions_(TV_series))

(2) The last name of Rich Buckler has a suggested link to https://ru.wikipedia.org/wiki/Баклер (https://en.wikipedia.org/wiki/Buckler)
https://ru.wikipedia.org/wiki/Кошмар_на_улице_Вязов_(комиксы)

Screen Shot 2022-03-23 at 5.41.37 PM.png (770×1 px, 239 KB)

(3) The screenshot shows two problems

Screen Shot 2022-03-07 at 2.24.45 PM.png (466×997 px, 137 KB)

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald Transcript
kostajh moved this task from Inbox to Needs Discussion on the Growth-Team board.
kostajh added subscribers: kevinbazira, kostajh.

Thank you for these examples!

(1) Couple of examples when add link suggests a link to a movie
the suggestions is made (in the context of Math article) from a common word "obvious" to the article about the TV series that has that word in its title: https://ru.wikipedia.org/wiki/Очевидное (https://en.wikipedia.org/wiki/Transparent_(TV_series))

Note that the probability score for the "Transparent" recommendation is 0.55: curl -X GET "https://api.wikimedia.org/service/linkrecommendation/v1/linkrecommendations/wikipedia/ru/%D0%94%D0%B5%D1%81%D1%8F%D1%82%D0%B8%D1%87%D0%BD%D1%8B%D0%B9%20%D0%BB%D0%BE%D0%B3%D0%B0%D1%80%D0%B8%D1%84%D0%BC?revision=117073328&threshold=0.5&max_recommendations=15" -H "accept: application/json"

{
      "context_after": " обобщение",
      "context_before": "уществует ",
      "link_index": 0,
      "link_target": "Очевидное",
      "link_text": "очевидное",
      "match_index": 0,
      "score": 0.5510401129722595,
      "wikitext_offset": 1878
    },

One thing the community could do if add link is re-enabled (cc @Trizek-WMF) is to increase the probability threshold to something like 0.6 or 0.7 (the probability score for the second example in the task description is 0.67).

Another idea is to do the work in T276518: Add a link: set user expectation on algorithm strength to see if that helps guide users to make better decisions on accepting/rejecting links.

(3) The screenshot shows two problems
the add link suggestion is in the Source section

That section isn't listed in the excludedSections part of: https://ru.wikipedia.org/wiki/MediaWiki:NewcomerTasks.json

Thanks for creating the issue!

That section isn't listed in the excludedSections part of: https://ru.wikipedia.org/wiki/MediaWiki:NewcomerTasks.json

Fixed! :)

Note that these changes don't take effect immediately. We can regenerate the task when all configuration changes are done.