Page MenuHomePhabricator
Create Task
Maniphest T387370

Rec API not picking up new page collections
Closed, ResolvedPublicBUG REPORT
Actions

Description

New page collections were tagged on meta. See "Wiki Loves Ramadan 2025/*" pages.

Some of them were picked up by some servers but most of them weren't, most likely due to the pagecollectionsmetadata API call timing out.

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
PageCollectionMetadataApi: don't parse pagesmediawiki/extensions/WikimediaCampaignEventswmf/1.44.0-wmf.18+17 -30
PageCollectionMetadataApi: don't parse pagesmediawiki/extensions/WikimediaCampaignEventsmaster+17 -30
PageCollectionMetadataApi: don't parse pagesmediawiki/extensions/WikimediaCampaignEventsmaster+17 -30
PageCollectionMetadataApi: don't parse pagesmediawiki/extensions/WikimediaCampaignEventswmf/1.44.0-wmf.18+17 -30
Customize query in gerrit

Related Objects

Event Timeline

SBisson created this task.Feb 26 2025, 4:54 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 26 2025, 4:54 PM
SBisson claimed this task.Feb 26 2025, 4:54 PM
SBisson triaged this task as High priority.
gerritbot added a comment.Feb 26 2025, 5:06 PM

Change #1122998 had a related patch set uploaded (by Sbisson; author: Sbisson):

[mediawiki/extensions/WikimediaCampaignEvents@master] PageCollectionMetadataApi: don't parse pages

https://gerrit.wikimedia.org/r/1122998

gerritbot added a project: Patch-For-Review.Feb 26 2025, 5:06 PM
SBisson moved this task from In-progress to Needs Code Review on the LPL Hypothesis board.Feb 26 2025, 5:07 PM
gerritbot added a comment.Feb 27 2025, 6:09 AM

Change #1122998 merged by jenkins-bot:

[mediawiki/extensions/WikimediaCampaignEvents@master] PageCollectionMetadataApi: don't parse pages

https://gerrit.wikimedia.org/r/1122998

SBisson mentioned this in rEWCEbcaa2f89c4f8: PageCollectionMetadataApi: don't parse pages.Feb 27 2025, 6:09 AM
Maintenance_bot removed a project: Patch-For-Review.Feb 27 2025, 6:30 AM
ReleaseTaggerBot added a project: MW-1.44-notes (1.44.0-wmf.19; 2025-03-04).Feb 27 2025, 7:01 AM
gerritbot added a comment.Feb 27 2025, 7:16 AM

Change #1123238 had a related patch set uploaded (by KartikMistry; author: Sbisson):

[mediawiki/extensions/WikimediaCampaignEvents@wmf/1.44.0-wmf.18] PageCollectionMetadataApi: don't parse pages

https://gerrit.wikimedia.org/r/1123238

gerritbot added a project: Patch-For-Review.Feb 27 2025, 7:16 AM
gerritbot added a comment.Feb 27 2025, 2:04 PM

Change #1123238 merged by jenkins-bot:

[mediawiki/extensions/WikimediaCampaignEvents@wmf/1.44.0-wmf.18] PageCollectionMetadataApi: don't parse pages

https://gerrit.wikimedia.org/r/1123238

KartikMistry mentioned this in rEWCE0aa1a3033865: PageCollectionMetadataApi: don't parse pages.Feb 27 2025, 2:05 PM
Stashbot added a comment.Feb 27 2025, 2:13 PM

Mentioned in SAL (#wikimedia-operations) [2025-02-27T14:13:55Z] <samtar@deploy2002> Started scap sync-world: Backport for [[gerrit:1123238|PageCollectionMetadataApi: don't parse pages (T387370)]]

Stashbot added a comment.Feb 27 2025, 2:16 PM

Mentioned in SAL (#wikimedia-operations) [2025-02-27T14:16:51Z] <samtar@deploy2002> kartik, samtar: Backport for [[gerrit:1123238|PageCollectionMetadataApi: don't parse pages (T387370)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)

Maintenance_bot removed a project: Patch-For-Review.Feb 27 2025, 2:30 PM
ReleaseTaggerBot edited projects, added MW-1.44-notes (1.44.0-wmf.18; 2025-02-25); removed MW-1.44-notes (1.44.0-wmf.19; 2025-03-04).Feb 27 2025, 3:00 PM
gerritbot added a comment.Feb 27 2025, 3:52 PM

Change #1123398 had a related patch set uploaded (by Sbisson; author: Sbisson):

[mediawiki/extensions/WikimediaCampaignEvents@master] PageCollectionMetadataApi: don't parse pages

https://gerrit.wikimedia.org/r/1123398

gerritbot added a project: Patch-For-Review.Feb 27 2025, 3:52 PM
gerritbot added a comment.Feb 27 2025, 4:59 PM

Change #1123398 merged by jenkins-bot:

[mediawiki/extensions/WikimediaCampaignEvents@master] PageCollectionMetadataApi: don't parse pages

https://gerrit.wikimedia.org/r/1123398

SBisson mentioned this in rEWCE994af5c61597: PageCollectionMetadataApi: don't parse pages.Feb 27 2025, 5:00 PM
ReleaseTaggerBot edited projects, added MW-1.44-notes (1.44.0-wmf.19; 2025-03-04); removed MW-1.44-notes (1.44.0-wmf.18; 2025-02-25).Feb 27 2025, 5:00 PM
gerritbot added a comment.Feb 27 2025, 5:04 PM

Change #1123416 had a related patch set uploaded (by Sbisson; author: Sbisson):

[mediawiki/extensions/WikimediaCampaignEvents@wmf/1.44.0-wmf.18] PageCollectionMetadataApi: don't parse pages

https://gerrit.wikimedia.org/r/1123416

gerritbot added a comment.Feb 27 2025, 9:41 PM

Change #1123416 merged by jenkins-bot:

[mediawiki/extensions/WikimediaCampaignEvents@wmf/1.44.0-wmf.18] PageCollectionMetadataApi: don't parse pages

https://gerrit.wikimedia.org/r/1123416

SBisson mentioned this in rEWCE14f46a2a6304: PageCollectionMetadataApi: don't parse pages.Feb 27 2025, 9:42 PM
Stashbot added a comment.Feb 27 2025, 9:51 PM

Mentioned in SAL (#wikimedia-operations) [2025-02-27T21:51:30Z] <ladsgroup@deploy2002> Started scap sync-world: Backport for [[gerrit:1123416|PageCollectionMetadataApi: don't parse pages (T387370)]]

Stashbot added a comment.Feb 27 2025, 9:56 PM

Mentioned in SAL (#wikimedia-operations) [2025-02-27T21:56:07Z] <ladsgroup@deploy2002> sbisson, ladsgroup: Backport for [[gerrit:1123416|PageCollectionMetadataApi: don't parse pages (T387370)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)

ReleaseTaggerBot edited projects, added MW-1.44-notes (1.44.0-wmf.18; 2025-02-25); removed MW-1.44-notes (1.44.0-wmf.19; 2025-03-04).Feb 27 2025, 10:00 PM
Stashbot added a comment.Feb 27 2025, 10:06 PM

Mentioned in SAL (#wikimedia-operations) [2025-02-27T22:06:12Z] <ladsgroup@deploy2002> Finished scap sync-world: Backport for [[gerrit:1123416|PageCollectionMetadataApi: don't parse pages (T387370)]] (duration: 14m 42s)

Maintenance_bot removed a project: Patch-For-Review.Feb 27 2025, 10:30 PM
SBisson moved this task from Needs Code Review to Needs QA on the LPL Hypothesis board.Feb 28 2025, 2:51 PM
EChukwukere-WMF subscribed.Feb 28 2025, 4:25 PM

@SBisson the best way to test this is to use the pagecollectionsmetadata API ? or what should one look out for in the "Wiki Loves Ramadan 2025/*" pages

SBisson added a comment.Feb 28 2025, 4:53 PM

@EChukwukere-WMF the root cause of the issue was this API call being extremely slow (about 46 seconds on average) which caused other problems downstream. You can see that it is now fast.

Ultimately, you should be able to check that the "Wiki Loves Ramadan 2025/*" pages are available in the page-collection endpoint of the recommendation API.

EChukwukere-WMF added a comment.Mar 8 2025, 7:55 PM

@SBisson Thanks for the clarification

Test status: QA PASS

I am now able to see the API calls fast and observe the Wiki Loves Ramadan 2025 pages in the page collection endpoint

EChukwukere-WMF moved this task from Needs QA to Design Signoff on the LPL Hypothesis board.Mar 8 2025, 7:56 PM
Pginer-WMF moved this task from Design Signoff to Product Signoff on the LPL Hypothesis board.Mar 24 2025, 2:12 PM
• PWaigi-WMF closed this task as Resolved.Mar 25 2025, 6:12 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits