MediaWiki periodic job update-special-pages-s5 failed
Open, LowPublicPRODUCTION ERROR
Actions

Assigned To

None

Authored By

	phaultfinder
	Wed, Apr 8, 3:03 PM

Description

Common information

dashboard: https://logstash.wikimedia.org/app/dashboards#/view/d51552d0-e309-11ef-87d0-9371e01d3c68?_a=(filters:!((query:(match_phrase:(kubernetes.labels.cronjob.keyword:update-special-pages-s5)))))&_g=(time:(from:now-24h,to:now))
description: Use kube-env mw-cron eqiad; kubectl get jobs -l team=mediawiki-special-pages,cronjob=update-special-pages-s5 --field-selector status.successful=0; kubectl logs -l cronjob=update-special-pages-s5 --timestamps=true --prefix=true -c mediawiki-main-app to see failures and logs
runbook: https://wikitech.wikimedia.org/wiki/Periodic_jobs#Troubleshooting
summary: MediaWiki periodic job update-special-pages-s5 failed

alertname: MediaWikiCronJobFailed
label_cronjob: update-special-pages-s5
label_team: mediawiki-special-pages
prometheus: k8s
severity: task
site: eqiad
source: prometheus
team: mediawiki-special-pages

Firing alerts

dashboard: https://logstash.wikimedia.org/app/dashboards#/view/d51552d0-e309-11ef-87d0-9371e01d3c68?_a=(filters:!((query:(match_phrase:(kubernetes.labels.cronjob.keyword:update-special-pages-s5)))))&_g=(time:(from:now-24h,to:now))
description: Use kube-env mw-cron eqiad; kubectl get jobs -l team=mediawiki-special-pages,cronjob=update-special-pages-s5 --field-selector status.successful=0; kubectl logs -l cronjob=update-special-pages-s5 --timestamps=true --prefix=true -c mediawiki-main-app to see failures and logs
runbook: https://wikitech.wikimedia.org/wiki/Periodic_jobs#Troubleshooting
summary: MediaWiki periodic job update-special-pages-s5 failed
alertname: MediaWikiCronJobFailed
label_cronjob: update-special-pages-s5
label_team: mediawiki-special-pages
prometheus: k8s
severity: task
site: eqiad
source: prometheus
team: mediawiki-special-pages
Source

Related Objects
Search...

Status	Subtype	Assigned	Task
Open		None	T422489 rdbms errors in eqiad
In Progress		None	T422486 MediaWiki periodic job failures due to timeouts
Open	PRODUCTION ERROR	None	T422678 MediaWiki periodic job update-special-pages-s5 failed

Event Timeline

phaultfinder created this task.Wed, Apr 8, 3:03 PM

Restricted Application changed the subtype of this task from "Task" to "Production Error". · View Herald TranscriptWed, Apr 8, 3:03 PM

Restricted Application added subscribers: A_smart_kitten, Aklapper. · View Herald Transcript

More of the same error, it seems.

	Apr 8, 2026 @ 06:52:08.704	mediawiki-special-pages
	update-special-pages-s5
	updateSpecialPages.php
	dewiki #8 /srv/mediawiki/php-1.46.0-wmf.22/includes/SpecialPage/QueryPage.php(558): MediaWiki\SpecialPage\QueryPage->reallyDoQueryInternal(5000, false)
	Apr 8, 2026 @ 06:52:08.704	mediawiki-special-pages
	update-special-pages-s5
	updateSpecialPages.php
	dewiki #12 /srv/mediawiki/php-1.46.0-wmf.22/maintenance/run.php(53): MediaWiki\Maintenance\MaintenanceRunner->run()
	Apr 8, 2026 @ 06:52:08.704	mediawiki-special-pages
	update-special-pages-s5
	updateSpecialPages.php
	dewiki #13 /srv/mediawiki/multiversion/MWScript.php(219): require_once('/srv/mediawiki/...')
	Apr 8, 2026 @ 06:52:08.704	mediawiki-special-pages
	update-special-pages-s5
	updateSpecialPages.php
	dewiki #14 {main}
	Apr 8, 2026 @ 06:52:08.704	mediawiki-special-pages
	update-special-pages-s5
	updateSpecialPages.php
	dewiki #9 /srv/mediawiki/php-1.46.0-wmf.22/includes/SpecialPage/QueryPage.php(437): MediaWiki\SpecialPage\QueryPage->reallyDoQuery(5000, false)
	Apr 8, 2026 @ 06:52:08.704	mediawiki-special-pages
	update-special-pages-s5
	updateSpecialPages.php
	dewiki #10 /srv/mediawiki/php-1.46.0-wmf.22/maintenance/updateSpecialPages.php(78): MediaWiki\SpecialPage\QueryPage->recache(5000)
	Apr 8, 2026 @ 06:52:08.704	mediawiki-special-pages
	update-special-pages-s5
	updateSpecialPages.php
	dewiki #11 /srv/mediawiki/php-1.46.0-wmf.22/maintenance/includes/MaintenanceRunner.php(694): UpdateSpecialPages->execute()
	Apr 8, 2026 @ 06:52:08.704	mediawiki-special-pages
	update-special-pages-s5
	updateSpecialPages.php
	dewiki #7 /srv/mediawiki/php-1.46.0-wmf.22/includes/SpecialPage/QueryPage.php(605): Wikimedia\Rdbms\SelectQueryBuilder->fetchResultSet()
	Apr 8, 2026 @ 06:52:08.704	mediawiki-special-pages
	update-special-pages-s5
	updateSpecialPages.php
	dewiki #6 /srv/mediawiki/php-1.46.0-wmf.22/includes/libs/Rdbms/QueryBuilder/SelectQueryBuilder.php(761): Wikimedia\Rdbms\DBConnRef->select(Array, Array, Array, 'MediaWiki\\Speci...', Array, Array)
	Apr 8, 2026 @ 06:52:08.703	mediawiki-special-pages
	update-special-pages-s5
	updateSpecialPages.php
	dewiki 
	Apr 8, 2026 @ 06:52:08.703	mediawiki-special-pages
	update-special-pages-s5
	updateSpecialPages.php
	dewiki #1 /srv/mediawiki/php-1.46.0-wmf.22/includes/libs/Rdbms/Database/Database.php(1188): Wikimedia\Rdbms\Database->getQueryExceptionAndLog('MySQL server ha...', 2006, 'SELECT  6 AS `n...', 'MediaWiki\\Speci...')
	Apr 8, 2026 @ 06:52:08.703	mediawiki-special-pages
	update-special-pages-s5
	updateSpecialPages.php
	dewiki #2 /srv/mediawiki/php-1.46.0-wmf.22/includes/libs/Rdbms/Database/Database.php(644): Wikimedia\Rdbms\Database->reportQueryError('MySQL server ha...', 2006, 'SELECT  6 AS `n...', 'MediaWiki\\Speci...', false)
	Apr 8, 2026 @ 06:52:08.703	mediawiki-special-pages
	update-special-pages-s5
	updateSpecialPages.php
	dewiki #3 /srv/mediawiki/php-1.46.0-wmf.22/includes/libs/Rdbms/Database/Database.php(1368): Wikimedia\Rdbms\Database->query(Object(Wikimedia\Rdbms\Query), 'MediaWiki\\Speci...')
	Apr 8, 2026 @ 06:52:08.703	mediawiki-special-pages
	update-special-pages-s5
	updateSpecialPages.php
	dewiki #5 /srv/mediawiki/php-1.46.0-wmf.22/includes/libs/Rdbms/Database/DBConnRef.php(386): Wikimedia\Rdbms\DBConnRef->__call('select', Array)
	Apr 8, 2026 @ 06:52:08.703	mediawiki-special-pages
	update-special-pages-s5
	updateSpecialPages.php
	dewiki #0 /srv/mediawiki/php-1.46.0-wmf.22/includes/libs/Rdbms/Database/Database.php(1214): Wikimedia\Rdbms\Database->getQueryException('MySQL server ha...', 2006, 'SELECT  6 AS `n...', 'MediaWiki\\Speci...')
	Apr 8, 2026 @ 06:52:08.703	mediawiki-special-pages
	update-special-pages-s5
	updateSpecialPages.php
	dewiki #4 /srv/mediawiki/php-1.46.0-wmf.22/includes/libs/Rdbms/Database/DBConnRef.php(129): Wikimedia\Rdbms\Database->select(Array, Array, Array, 'MediaWiki\\Speci...', Array, Array)
	Apr 8, 2026 @ 06:52:08.702	mediawiki-special-pages
	update-special-pages-s5
	updateSpecialPages.php
	dewiki Query: SELECT  6 AS `namespace`,lt_title AS `title`,COUNT(*) AS `value`  FROM `imagelinks` JOIN `linktarget` ON ((il_target_id = lt_id)) LEFT JOIN `page` ON ((lt_title = page_title) AND page_namespace = 6) LEFT JOIN `redirect` ON ((page_id = rd_from) AND rd_namespace = 6 AND rd_interwiki = '') LEFT JOIN `file` `img1` ON ((lt_title = img1.file_name) AND lt_namespace = 6 AND img1.file_deleted = 0) LEFT JOIN `file` `img2` ON ((rd_title = img2.file_name) AND img2.file_deleted = 0)   WHERE img1.file_name IS NULL AND img2.file_name IS NULL  GROUP BY lt_title ORDER BY value DESC,namespace,title LIMIT 5000  
	Apr 8, 2026 @ 06:52:08.702	mediawiki-special-pages
	update-special-pages-s5
	updateSpecialPages.php
	dewiki Error: 2006 MySQL server has gone away
	Apr 8, 2026 @ 06:52:08.702	mediawiki-special-pages
	update-special-pages-s5
	updateSpecialPages.php
	dewiki Wantedfiles                    [QueryPage] Wikimedia\Rdbms\DBQueryDisconnectedError from line 1228 of /srv/mediawiki/php-1.46.0-wmf.22/includes/libs/Rdbms/Database/Database.php: A connection error occurred during a query. 
	Apr 8, 2026 @ 06:52:08.702	mediawiki-special-pages
	update-special-pages-s5
	updateSpecialPages.php
	dewiki Function: MediaWiki\Specials\SpecialWantedFiles::reallyDoQueryInternal

jijiki moved this task from Inbox to In Progress on the ServiceOps new board.Thu, Apr 9, 9:18 AM

A_smart_kitten moved this task from To triage to Maintenance reports on the MediaWiki-Special-pages board.Thu, Apr 9, 9:21 AM

Clement_Goubert triaged this task as Low priority.Thu, Apr 9, 4:16 PM

MediaWiki periodic job update-special-pages-s5 failedOpen, LowPublicPRODUCTION ERRORActions