Common information
- dashboard: https://logstash.wikimedia.org/app/dashboards#/view/d51552d0-e309-11ef-87d0-9371e01d3c68?_a=(filters:!((query:(match_phrase:(kubernetes.labels.cronjob.keyword:db-lag-stats-reporter)))))&_g=(time:(from:now-24h,to:now))
- description: Use kube-env mw-cron eqiad; kubectl get jobs -l team=data-persistence,cronjob=db-lag-stats-reporter --field-selector status.successful=0; kubectl logs -l cronjob=db-lag-stats-reporter --timestamps=true --prefix=true -c mediawiki-main-app to see failures and logs
- runbook: https://wikitech.wikimedia.org/wiki/Periodic_jobs#Troubleshooting
- summary: MediaWiki periodic job db-lag-stats-reporter failed
- alertname: MediaWikiCronJobFailed
- label_cronjob: db-lag-stats-reporter
- label_team: data-persistence
- prometheus: k8s
- severity: task
- site: eqiad
- source: prometheus
- team: data-persistence
Firing alerts
- dashboard: https://logstash.wikimedia.org/app/dashboards#/view/d51552d0-e309-11ef-87d0-9371e01d3c68?_a=(filters:!((query:(match_phrase:(kubernetes.labels.cronjob.keyword:db-lag-stats-reporter)))))&_g=(time:(from:now-24h,to:now))
- description: Use kube-env mw-cron eqiad; kubectl get jobs -l team=data-persistence,cronjob=db-lag-stats-reporter --field-selector status.successful=0; kubectl logs -l cronjob=db-lag-stats-reporter --timestamps=true --prefix=true -c mediawiki-main-app to see failures and logs
- runbook: https://wikitech.wikimedia.org/wiki/Periodic_jobs#Troubleshooting
- summary: MediaWiki periodic job db-lag-stats-reporter failed
- alertname: MediaWikiCronJobFailed
- label_cronjob: db-lag-stats-reporter
- label_team: data-persistence
- prometheus: k8s
- severity: task
- site: eqiad
- source: prometheus
- team: data-persistence
- Source