Page MenuHomePhabricator

Community-defined Translation Collections: Default/Vital Articles
Closed, ResolvedPublic

Assigned To
Authored By
PWaigi-WMF
Sep 12 2024, 9:22 AM

Description

As the team explored T368718, we identified other opportunities where communities and projects could increase their content coverage through the Content Translation tool. Scenarios such as:

  • where no campaigns/ events are running, as these tend to be time-bound and happen "on demand".
  • where there's a new language project that has moved from the incubator and editors would need guidance on which articles to prioritize.

We believe it would be beneficial to present Vital Articles / List of articles every Wikipedia should have as an additional filter chip for editors to get suggestions.

  • This filter would be made available under the Collections section since these lists are determined by communities through a pre-set criteria.

Product Assumptions:

  • Though we don't anticipate any community pushback, we want to ensure that these types of lists can be disabled upon request.

Derived Requirement

Introduce a "Vital Articles" filter chip under the Collections section in the Content Translation tool, allowing editors to access translation suggestions based on community-curated lists of essential articles. Ensure the feature can be disabled upon community request.

Test Steps

Test Case 1: Verify display of "Vital Articles" filter chip

  1. Open the Content Translation tool.
  2. Navigate to the Adjust Suggestions view.
  3. Locate the Collections section.
  4. ✅❓❌⬜ AC1: Confirm the presence of a "Vital Articles" filter chip under the Collections section.

Test Case 2: Verify translation suggestions for "Vital Articles"

  1. Select the "Vital Articles" filter chip in the Collections section.
  2. View the translation suggestions in the Suggestions screen.
  3. ✅❓❌⬜ AC2: Confirm that the suggestions are based on the community-curated Vital Articles list.

Test Case 3: Verify ability to disable the "Vital Articles" filter

  1. Submit a community request to disable the "Vital Articles" filter.
  2. Refresh the Content Translation tool.
  3. Navigate to the Adjust Suggestions view and the Collections section.
  4. ✅❓❌⬜ AC3: Confirm the "Vital Articles" filter chip is no longer visible.

QA Results - Test Mobile ContentTranslation

ACStatusDetails
1T374597#10333562
2T374597#10333562
3Pass per T374597#10334959

Event Timeline

PWaigi-WMF updated the task description. (Show Details)
PWaigi-WMF updated the task description. (Show Details)
PWaigi-WMF added subscribers: SBisson, FRomeo_WMF, Sadads and 2 others.

Change #1072175 had a related patch set uploaded (by Santhosh; author: Santhosh):

[research/recommendation-api@master] Support Default collections

https://gerrit.wikimedia.org/r/1072175

PWaigi-WMF renamed this task from Custom translation suggestions: Community-defined lists (vital articles) to Custom translation suggestions: Default Collections/Vital article lists.Oct 31 2024, 2:46 PM
PWaigi-WMF updated the task description. (Show Details)
PWaigi-WMF renamed this task from Custom translation suggestions: Default Collections/Vital article lists to Community-defined Translation Collections: Default/Vital Articles.Nov 5 2024, 11:44 AM

Change #1072175 merged by jenkins-bot:

[research/recommendation-api@master] Support Default collections

https://gerrit.wikimedia.org/r/1072175

Change #1088276 had a related patch set uploaded (by KartikMistry; author: KartikMistry):

[operations/deployment-charts@master] Update recommendation-api to 2024-11-06-190017-production

https://gerrit.wikimedia.org/r/1088276

Change #1088382 had a related patch set uploaded (by Nik Gkountas; author: Nik Gkountas):

[research/recommendation-api@master] remove level 1 and 2 pages from "Vital articles" default collections

https://gerrit.wikimedia.org/r/1088382

Change #1088382 merged by jenkins-bot:

[research/recommendation-api@master] remove level 1 and 2 pages from "Vital articles" default collections

https://gerrit.wikimedia.org/r/1088382

Though we don't anticipate any community pushback, we want to ensure that these types of lists can be disabled upon request.

@PWaigi-WMF be aware that we can easily remove the Vital articles completely but we currently have no way to remove it for a user or a group of users. We could figure something out if/when you think it's important.

Change #1088276 merged by jenkins-bot:

[operations/deployment-charts@master] Update recommendation-api to 2024-11-08-142328-production

https://gerrit.wikimedia.org/r/1088276

GMikesell-WMF updated the task description. (Show Details)
GMikesell-WMF subscribed.

Test Result - Test Mobile ContentTranslation

Status: ✅ PASS
Environment: Test Mobile ContentTranslation
OS: macOS Sonoma
Browser: Chrome
Device: MBA
Emulated Device: NA

Test Artifact(s):

https://test.m.wikipedia.org/w/index.php?title=Special:ContentTranslation&active-list=suggestions&from=en&to=es&filter-type=collections&filter-id=Vital%20articles

Test Steps

Test Case 1: Verify display of "Vital Articles" filter chip

  1. Open the Content Translation tool.
  2. Navigate to the Adjust Suggestions view.
  3. Locate the Collections section.
  4. AC1: Confirm the presence of a "Vital Articles" filter chip under the Collections section.

2024-11-18_11-26-20.png (932×430 px, 107 KB)

Test Case 2: Verify translation suggestions for "Vital Articles"

  1. Select the "Vital Articles" filter chip in the Collections section.
  2. View the translation suggestions in the Suggestions screen.
  3. AC2: Confirm that the suggestions are based on the community-curated Vital Articles list.

Gif

2024-11-18_12-02-40.mp4.gif (1×722 px, 1 MB)

Test Case 3: Verify ability to disable the "Vital Articles" filter

  1. Submit a community request to disable the "Vital Articles" filter.
  2. Refresh the Content Translation tool.
  3. Navigate to the Adjust Suggestions view and the Collections section.
  4. AC3: Confirm the "Vital Articles" filter chip is no longer visible.

In T368718, is that the filter that should be in Test?

*UPDATE: Pass per T374597#10334959*

Current in TestDesign from T368718
2024-11-18_11-26-20.png (932×430 px, 106 KB)
2024-11-18_11-27-46.png (395×325 px, 28 KB)

@GMikesell-WMF, The fetching of Vital Article lists, is hardcoded, unlike the other types of collections where a page collection marker has to be added by the campaign organizers; therefore, we can safely assume that we can remove it upon request (we don't anticipate it but I did make a note of it under the product assumption section).

Also, I'd like to keep this ticket open for a while to test how all suggestions present themselves amongst other collections once they start showing up on the mobile dashboard.

No problem, I will move it to design sign-off since this task has passed, but we can leave it open there. Also, this T380388 seems to keep track of what you are looking for too. Thanks!

GMikesell-WMF moved this task from Needs QA to Design Signoff on the LPL Hypothesis board.
GMikesell-WMF updated Other Assignee, removed: GMikesell-WMF.

The Vital article was expected to act as a fallback, but does not seem to be showing in the menu:

bn.m.wikipedia.org_w_index.php_title=Special_ContentTranslation&filter-type=automatic&filter-id=collections&active-list=suggestions&from=en&to=bn(Wiki Mobile).png (568×320 px, 46 KB)

I'll check again when it becomes available.

"Vital articles" are showing now:

List of suggestionsAdjusting suggestions
bn.m.wikipedia.org_w_index.php_title=%E0%A6%AC%E0%A6%BF%E0%A6%B6%E0%A7%87%E0%A6%B7_%E0%A6%AC%E0%A6%BF%E0%A6%B7%E0%A6%AF%E0%A6%BC%E0%A6%AC%E0%A6%B8%E0%A7%8D%E0%A6%A4%E0%A7%81_%E0%A6%85%E0%A6%A8%E0%A7%81%E0%A6%AC%E0%A6%BE%E0%A6%A6&active- (7).png (568×320 px, 63 KB)
bn.m.wikipedia.org_w_index.php_title=%E0%A6%AC%E0%A6%BF%E0%A6%B6%E0%A7%87%E0%A6%B7_%E0%A6%AC%E0%A6%BF%E0%A6%B7%E0%A6%AF%E0%A6%BC%E0%A6%AC%E0%A6%B8%E0%A7%8D%E0%A6%A4%E0%A7%81_%E0%A6%85%E0%A6%A8%E0%A7%81%E0%A6%AC%E0%A6%BE%E0%A6%A6&active- (6).png (568×320 px, 44 KB)

Reading the description, I was not sure whether the "Vital articles" collection was intended to be shown only when there are no suggestions from other collections. However, it seems to show in the same way as any other "regular" collections (in the example, suggestions from both "Vital articles" and "Wiki99/Food" are shown).

From the user perspective, the only particularity of "Vital articles" seems to be that it is a very long collection that cannot be removed by the community. As we learn more about how people use the tool, we may want to observe whether longer collections get more exposure in suggestions, and consider whether the purpose of this collection could be achieved with one (or more) of the regular collection(s) without the "Vital articles" limitations.

There is a good overlap between Vital articles Level 3 and Essential articles. They are about 65% the same. It doesn't seem as useful anymore to keep it around.

@SBisson In this case, we should remove Vital articles from the code, right?

If there is 65% overlap, we still have 35% essential, vital articles left out.

  • The issue of repeated articles in multiple collections should be abstracted with in the recommendation API. Never output same articles in the API response just because they are in two different collections
  • As the number of collections grow, we should expect overap between articles. This is quite natural. For example "India" collections and "Films from India" will have lot of overlap.
  • Due to the special nature of vital articles(It is special to recommendation API because it is defined in English Wikipedia while all other collections are in Meta. This is why we had to handle it the code in different way), it may be ok to use that pool only when all other collections are used up. It was originally considered as fallback collection.

Following team discussions, it was decided to remove the 'Vital articles' default collection entirely, as its maintenance cost and code complexity outweigh the benefits of keeping it as a fallback.

Change #1102356 had a related patch set uploaded (by Nik Gkountas; author: Nik Gkountas):

[research/recommendation-api@master] remove support for default collections

https://gerrit.wikimedia.org/r/1102356

Change #1102356 merged by jenkins-bot:

[research/recommendation-api@master] remove support for default collections

https://gerrit.wikimedia.org/r/1102356

@PWaigi-WMF I see that you moved this back to QA, what else would you like me to test that wasn't on T374597#10333562? Thanks!

@PWaigi-WMF "Vital Articles" is no longer showing. I will move this back to sign-off. Thanks for all your work!

2024-12-17_14-50-55.png (604×1 px, 142 KB)