Page MenuHomePhabricator
Create Task
Maniphest T313347

Track server load on Commons after changes to [[c:Template:Wikidata_Infobox]]
Closed, ResolvedPublicBUG REPORT
Actions

Description

Hi, I'm not too sure where to ask this, hope this is OK.

We're going to deploy a big change tomorrow to:
https://commons.wikimedia.org/wiki/Template:Wikidata_Infobox
We're moving a good chunk of the code from Wikitext to Lua, as a result of T305869. The infobox is currently used in around 4 million Commons categories.

The change should significantly reduce the load time for the infobox, and we'd be interested in seeing if that has any affect on the loads of the servers that host Commons. Perhaps it might also affect the rate at which Commons retrieves Wikidata items (if it can spend less time processing, more time fetching info). Would that be feasible / is this info public somewhere?

Related Objects

Event Timeline

Mike_Peel created this task.Jul 19 2022, 7:01 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 19 2022, 7:01 PM
TheresNoTime subscribed.Jul 19 2022, 9:57 PM
TheresNoTime added a comment.Jul 19 2022, 10:04 PM

I suppose somewhere like https://grafana.wikimedia.org/d/000000608/datacenter-overview?orgId=1 would be a good place to start looking?

Mike_Peel added a comment.Jul 19 2022, 10:16 PM
In T313347#8089429, @TheresNoTime wrote:

I suppose somewhere like https://grafana.wikimedia.org/d/000000608/datacenter-overview?orgId=1 would be a good place to start looking?

Maybe, but way too cryptic. No search results for 'Commons'...

Snaevar subscribed.Jul 19 2022, 10:55 PM

For the time Lua uses see https://grafana.wikimedia.org/d/000000139/scribunto?orgId=1&var-wiki=commonswiki
It will propably peak after the save as the pages move over to the new version and then normalize. So, compare the time after the save to when it was last edited.

For the database you want to watch the "s4" cluster, which includes commons and testcommons. I do not know which graph is best there.

Mike_Peel closed this task as Resolved.Jul 20 2022, 6:12 PM
Mike_Peel claimed this task.

Thanks! The new code is live, some changes appeared on the Grafana link @Snaevar shared, but they looked reasonable. If anyone spots any problems with server load from commons, please let me know, otherwise the big change has now happened. :-)

Aklapper renamed this task from Tracking server load on Commons? to Track server load on Commons after changes to [[c:Template:Wikidata_Infobox]].Jul 21 2022, 9:46 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits