Prevent storing duplicate Wikidata articles in page collection recommendations cache
Closed, ResolvedPublic2 Estimated Story PointsBUG REPORT
Actions

Assigned To

Authored By

	ngkountas
	Nov 18 2025, 11:30 AM

Description

The Recommendation API can end up with duplicate instances of the same Wikidata article for a given collection in its cache.

The method responsible for this is get_candidates_in_collection_page. While it’s still unclear how many issues this may cause, it is not the correct behavior and should be addressed to ensure data consistency.

Details

Related Changes in Gerrit:

	Subject	Repo	Branch	Lines +/-
	Update recommendation-api to 2025-11-20-132855-production	operations/deployment-charts	master	+2 -2
	Page collections caching: Use sitematrix lang code for all articles	research/recommendation-api	master	+184 -18

Customize query in gerrit

Related Objects

Mentioned In: T410396: Page collection 'None': newly fetched
Mentioned Here: T410396: Page collection 'None': newly fetched

Event Timeline

ngkountas created this task.Nov 18 2025, 11:30 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptNov 18 2025, 11:30 AM

SBisson added a project: LPL Hypothesis.Nov 18 2025, 2:10 PM

Nikerabbit triaged this task as High priority.Nov 18 2025, 2:14 PM

Nikerabbit added projects: Unplanned-Sprint-Work, LPL Projects (Improve Discovery of Vital Content - FY26 WE 2.1.6).

Nikerabbit moved this task from Backlog to Prioritized on the LPL Hypothesis board.

SBisson assigned this task to ngkountas.Nov 18 2025, 2:16 PM

SBisson moved this task from Prioritized to In-progress on the LPL Hypothesis board.

Change #1206883 had a related patch set uploaded (by Nik Gkountas; author: Nik Gkountas):

[research/recommendation-api@master] Page collections caching: Use sitematrix lang code for all articles

https://gerrit.wikimedia.org/r/1206883

gerritbot added a project: Patch-For-Review.Nov 18 2025, 2:55 PM

ngkountas moved this task from In-progress to Needs Code Review on the LPL Hypothesis board.Nov 19 2025, 2:18 AM

ngkountas set the point value for this task to 2.

Change #1206883 merged by jenkins-bot:

[research/recommendation-api@master] Page collections caching: Use sitematrix lang code for all articles

https://gerrit.wikimedia.org/r/1206883

Maintenance_bot removed a project: Patch-For-Review.Nov 20 2025, 1:30 PM

SBisson moved this task from Needs Code Review to Pending deployment on the LPL Hypothesis board.Nov 20 2025, 6:13 PM

Change #1211118 had a related patch set uploaded (by Sbisson; author: Sbisson):

[operations/deployment-charts@master] Update recommendation-api to 2025-11-20-132855-production

https://gerrit.wikimedia.org/r/1211118

gerritbot added a project: Patch-For-Review.Nov 25 2025, 1:31 PM

Change #1211118 merged by jenkins-bot:

[operations/deployment-charts@master] Update recommendation-api to 2025-11-20-132855-production

https://gerrit.wikimedia.org/r/1211118

Mentioned in SAL (#wikimedia-operations) [2025-11-25T14:23:00Z] <stephanebisson> Updated recommendation-api to 2025-11-20-132855-production (T410396, T410387)