Common information
- dashboard: https://logstash.wikimedia.org/app/dashboards#/view/d51552d0-e309-11ef-87d0-9371e01d3c68?_a=(filters:!((query:(match_phrase:(kubernetes.labels.cronjob.keyword:echo-mail-batch)))))&_g=(time:(from:now-24h,to:now))
- description: Use kube-env mw-cron codfw; kubectl get jobs -l team=notifications-echo,cronjob=echo-mail-batch --field-selector status.successful=0; kubectl logs -l cronjob=echo-mail-batch --timestamps=true --prefix=true -c mediawiki-main-app to see failures and logs
- runbook: https://wikitech.wikimedia.org/wiki/Periodic_jobs#Troubleshooting
- summary: MediaWiki periodic job echo-mail-batch failed
- alertname: MediaWikiCronJobFailed
- label_cronjob: echo-mail-batch
- label_team: notifications-echo
- prometheus: k8s
- severity: task
- site: codfw
- source: prometheus
- team: notifications-echo
Firing alerts
- dashboard: https://logstash.wikimedia.org/app/dashboards#/view/d51552d0-e309-11ef-87d0-9371e01d3c68?_a=(filters:!((query:(match_phrase:(kubernetes.labels.cronjob.keyword:echo-mail-batch)))))&_g=(time:(from:now-24h,to:now))
- description: Use kube-env mw-cron codfw; kubectl get jobs -l team=notifications-echo,cronjob=echo-mail-batch --field-selector status.successful=0; kubectl logs -l cronjob=echo-mail-batch --timestamps=true --prefix=true -c mediawiki-main-app to see failures and logs
- runbook: https://wikitech.wikimedia.org/wiki/Periodic_jobs#Troubleshooting
- summary: MediaWiki periodic job echo-mail-batch failed
- alertname: MediaWikiCronJobFailed
- label_cronjob: echo-mail-batch
- label_team: notifications-echo
- prometheus: k8s
- severity: task
- site: codfw
- source: prometheus
- team: notifications-echo
- Source