Data pages do not load or perform poorly when there are a large number of uses tracked
Closed, ResolvedPublic3 Estimated Story PointsBUG REPORT
Actions

Assigned To

Authored By

	CCiufo-WMF
	Mar 18 2025, 7:14 PM

Project Tags

Referenced Files

	F58960932: image.png
	Apr 1 2025, 9:22 PM

Subscribers

View All 11 Subscribers

Description

Steps to replicate the issue (include links if applicable):

Go to a data page that contains a large number of usage tracking links (e.g. https://commons.wikimedia.org/wiki/Data:I18n/Documentation.tab)

What happens?:
The page takes a long time to load, or fails to load at all

What should have happened instead?:
The page should load and the usage links should be paginated (same as Global Usage, 500 links at a time, then linking to a special page specifically for links)

Software version (on Special:Version page; skip for WMF-hosted wikis like Wikipedia):
Wikis that have Extension:Chart enabled

Other information (browser name/version, screenshots, etc.):
All

Thank you @Tacsipacsi for reporting this in T371300.

Details

Other Assignee: Jdlrobson-WMF

Related Changes in Gerrit:

	Subject	Author	Repo	Branch	Lines +/-
	Pager to break up large globaljsonlinks backlinks	Bvibber	mediawiki/extensions/JsonConfig	master	+461 -95

Customize query in gerrit

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved		None	T383079 Epic: Deploy Charts to other wikis
		Resolved	BUG REPORT	CCiufo-WMF	T389246 Data pages do not load or perform poorly when there are a large number of uses tracked

Event Timeline

CCiufo-WMF created this task.Mar 18 2025, 7:14 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 18 2025, 7:14 PM

CCiufo-WMF triaged this task as High priority.Mar 18 2025, 7:14 PM

CCiufo-WMF updated the task description. (Show Details)

CCiufo-WMF updated the task description. (Show Details)Mar 24 2025, 6:36 PM

CCiufo-WMF updated the task description. (Show Details)

CCiufo-WMF set the point value for this task to 3.

CCiufo-WMF moved this task from Up Next to Current Sprint on the Charts board.Mar 24 2025, 6:38 PM

CCiufo-WMF edited projects, added: Charts (Current Sprint); removed: Charts.

CCiufo-WMF assigned this task to bvibber.Mar 24 2025, 6:47 PM

bvibber moved this task from Incoming to Doing on the Charts (Current Sprint) board.Mar 24 2025, 9:21 PM

Pppery mentioned this in T389105: It is not possible to open Data:CS1/Identifier limits.tab.Mar 24 2025, 9:22 PM

Yep, I see what needs to be done -- I can crib related code off GlobalUsage for setting up a pager on this.

Change #1130727 had a related patch set uploaded (by Bvibber; author: Bvibber):

[mediawiki/extensions/JsonConfig@master] WIP pager to break up large globaljsonlinks backlinks

https://gerrit.wikimedia.org/r/1130727

gerritbot added a project: Patch-For-Review.Mar 24 2025, 9:51 PM

bvibber removed a project: Patch-For-Review.Mar 24 2025, 9:51 PM

CCiufo-WMF added a parent task: T383079: Epic: Deploy Charts to other wikis.Mar 26 2025, 8:14 PM

We're close to being in business. ;)

Here's the Special:GlobalJsonLinks view on my local test wiki; it pages correctly if you bump the results down. It should handle large datasets more efficiently than the current query that dumps everything into one giant list:

Next step this afternoon is to finish porting the Data: page usage list to use the new functions as GlobalUsage does for images, with it cutting off after 500 items or whatever and linking to the pager for the rest.

Patch should be fully functional at this point, but my last update yesterday didn't pass a test due to a whoopsie in an edge case. :D Should be corrected now. We won't make the cutoff for deployment today, so expect to deploy this next week after code review. (I'll be at an offsite meeting but with my dev laptop so I can schedule a deployment myself in a pinch.)

IKhitron subscribed.Apr 12 2025, 12:40 PM

Wellverywell subscribed.Apr 14 2025, 6:00 AM

Alien333 subscribed.Apr 14 2025, 11:28 AM

Change #1137571 had a related patch set uploaded (by Aude; author: Bvibber):

[mediawiki/extensions/JsonConfig@master] Pager to break up large globaljsonlinks backlinks

https://gerrit.wikimedia.org/r/1137571

gerritbot added a project: Patch-For-Review.Apr 21 2025, 1:39 AM

I will review https://gerrit.wikimedia.org/r/1137571 and setup a new task for the follow up to make the special page work in Codex.

Jdlrobson-WMF mentioned this in T392535: Allow exploration of chart usages for popular charts.Apr 23 2025, 8:34 PM

Jdlrobson-WMF renamed this task from Data pages perform poorly when there are a large number of uses tracked to Data pages do not load or perform poorly when there are a large number of uses tracked.Apr 24 2025, 5:37 AM

Change #1130727 merged by jenkins-bot:

[mediawiki/extensions/JsonConfig@master] Pager to break up large globaljsonlinks backlinks

https://gerrit.wikimedia.org/r/1130727

Ok, initial refactor with limit to 50 results is merged! Thanks all! The Special: page for browsing is rolled forward into T392535 and jon has some ideas on refactoring the multi-site-link-pager itself into core so we can a) restyle it with modern codex and b) use the same front-end pager code for GlobalUsage and anything else that might be doing similar linking in future.

bvibber reassigned this task from bvibber to CCiufo-WMF.Apr 24 2025, 9:41 PM

bvibber moved this task from Doing to Ready for Signoff on the Charts (Current Sprint) board.

bvibber subscribed.

ReleaseTaggerBot added a project: MW-1.44-notes (1.44.0-wmf.27; 2025-04-29).Apr 24 2025, 10:00 PM

Seddon moved this task from Ready for Signoff to Merged and Awaiting Deployment on the Charts (Current Sprint) board.Apr 30 2025, 8:08 PM

should be live

bvibber moved this task from Merged and Awaiting Deployment to Ready for Signoff on the Charts (Current Sprint) board.May 1 2025, 8:49 PM

Looks good!

Pppery merged a task: T389105: It is not possible to open Data:CS1/Identifier limits.tab.May 11 2025, 1:28 AM

Pppery added subscribers: Zache, Pppery, Trappist_the_monk.