MediaWikiCronJobFailed
Closed, ResolvedPublic1 Estimated Story Points
Actions

Assigned To

Authored By

	phaultfinder
	May 9 2026, 4:17 PM

Project Tags

Referenced Files

None

Subscribers

Aklapper

phaultfinder

Sfaci

Description

Common information

dashboard: https://logstash.wikimedia.org/app/dashboards#/view/d51552d0-e309-11ef-87d0-9371e01d3c68?_a=(filters:!((query:(match_phrase:(kubernetes.labels.cronjob.keyword:testkitchen-updateconfigs)))))&_g=(time:(from:now-24h,to:now))
description: Use kube-env mw-cron eqiad; kubectl get jobs -l team=experiment-platform,cronjob=testkitchen-updateconfigs --field-selector status.successful=0; kubectl logs -l cronjob=testkitchen-updateconfigs --timestamps=true --prefix=true -c mediawiki-main-app to see failures and logs
runbook: https://wikitech.wikimedia.org/wiki/Periodic_jobs#Troubleshooting
summary: MediaWiki periodic job testkitchen-updateconfigs failed

alertname: MediaWikiCronJobFailed
label_cronjob: testkitchen-updateconfigs
label_team: experiment-platform
prometheus: k8s
severity: task
site: eqiad
source: prometheus
team: experiment-platform

Firing alerts

dashboard: https://logstash.wikimedia.org/app/dashboards#/view/d51552d0-e309-11ef-87d0-9371e01d3c68?_a=(filters:!((query:(match_phrase:(kubernetes.labels.cronjob.keyword:testkitchen-updateconfigs)))))&_g=(time:(from:now-24h,to:now))
description: Use kube-env mw-cron eqiad; kubectl get jobs -l team=experiment-platform,cronjob=testkitchen-updateconfigs --field-selector status.successful=0; kubectl logs -l cronjob=testkitchen-updateconfigs --timestamps=true --prefix=true -c mediawiki-main-app to see failures and logs
runbook: https://wikitech.wikimedia.org/wiki/Periodic_jobs#Troubleshooting
summary: MediaWiki periodic job testkitchen-updateconfigs failed
alertname: MediaWikiCronJobFailed
label_cronjob: testkitchen-updateconfigs
label_team: experiment-platform
prometheus: k8s
severity: task
site: eqiad
source: prometheus
team: experiment-platform
Source

Event Timeline

phaultfinder created this task.May 9 2026, 4:17 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 9 2026, 4:17 PM

Same error as before. I'll remove the failed job

sfaci@deploy1003:~$ kubectl logs jobs/testkitchen-updateconfigs-29640272 mediawiki-main-app
extensions/TestKitchen/maintenance/UpdateConfigs.php: Start run
Warning: EtcdConfig failed to fetch data: (curl error: 28) Timeout was reached in /srv/mediawiki/php-1.47.0-wmf.1/includes/Config/EtcdConfig.php on line 180
Warning: EtcdConfig failed to fetch data: (curl error: 28) Timeout was reached in /srv/mediawiki/php-1.47.0-wmf.1/includes/Config/EtcdConfig.php on line 180
Fatal error: Uncaught MediaWiki\Config\ConfigException: Failed to load configuration from etcd: (curl error: 28) Timeout was reached in /srv/mediawiki/php-1.47.0-wmf.1/includes/Config/EtcdConfig.php:207
Stack trace:
#0 /srv/mediawiki/php-1.47.0-wmf.1/includes/Config/EtcdConfig.php(130): MediaWiki\Config\EtcdConfig->load()
#1 /srv/mediawiki/wmf-config/CommonSettings.php(199): MediaWiki\Config\EtcdConfig->getModifiedIndex()
#2 /srv/mediawiki/php-1.47.0-wmf.1/LocalSettings.php(4): require('/srv/mediawiki/...')
#3 /srv/mediawiki/php-1.47.0-wmf.1/includes/Setup.php(213): require_once('/srv/mediawiki/...')
#4 /srv/mediawiki/php-1.47.0-wmf.1/maintenance/run.php(51): require_once('/srv/mediawiki/...')
#5 /srv/mediawiki/multiversion/MWScript.php(219): require_once('/srv/mediawiki/...')
#6 {main}
  thrown in /srv/mediawiki/php-1.47.0-wmf.1/includes/Config/EtcdConfig.php on line 207

Sfaci claimed this task.May 11 2026, 11:00 PM

Sfaci edited projects, added: Test Kitchen (Experiment Platform Sprint 23); removed: Test Kitchen.

Sfaci set the point value for this task to 1.

Sfaci moved this task from Ready for Development to Done on the Test Kitchen (Experiment Platform Sprint 23) board.

Sfaci added a project: Essential-Work.

KReid-WMF closed this task as Resolved.Thu, May 14, 3:07 PM

MediaWikiCronJobFailedClosed, ResolvedPublic1 Estimated Story PointsActions

Description

Common information

Firing alerts

Event Timeline

MediaWikiCronJobFailed
Closed, ResolvedPublic1 Estimated Story Points
Actions