snapshot of s3 in eqiad critical
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	ayounsi
	May 4 2020, 7:49 AM

Description

https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=db1115&service=snapshot+of+s3+in+eqiad
has been alerting for 1 days with snapshot for s3 at eqiad taken more than 3 days ago: Most recent backup 2020-04-30 06:33:38

The linked runbook helps understanding context, but there are no doable actions: https://wikitech.wikimedia.org/wiki/MariaDB/Backups#Alerting

Acking the alert and making this task a persistent comment for future references.

Details

	Subject	Repo	Branch	Lines +/-
	mariadb-backups: Update transfer.py to HEAD	operations/puppet	production	+3 -2
	transfer.py: Set timeout to 5 minutes	operations/software/wmfmariadbpy	master	+2 -2

Customize query in gerrit

Related Objects

Mentioned In: rOSWB777d5f023a67: transfer.py: Set timeout to 5 minutes

Event Timeline

ayounsi created this task.May 4 2020, 7:49 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 4 2020, 7:49 AM

Change 594096 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/software/wmfmariadbpy@master] transfer.py: Set timeout to 5 minutes

https://gerrit.wikimedia.org/r/594096

gerritbot added a project: Patch-For-Review.May 4 2020, 8:11 AM

Change 594096 merged by Jcrespo:
[operations/software/wmfmariadbpy@master] transfer.py: Set timeout to 5 minutes

https://gerrit.wikimedia.org/r/594096

Change 594099 had a related patch set uploaded (by Jcrespo; owner: Jcrespo):
[operations/puppet@production] mariadb-backups: Update transfer.py to HEAD

https://gerrit.wikimedia.org/r/594099

ayounsi unsubscribed.May 4 2020, 8:22 AM

Change 594099 merged by Jcrespo:
[operations/puppet@production] mariadb-backups: Update transfer.py to HEAD

https://gerrit.wikimedia.org/r/594099

Maintenance_bot removed a project: Patch-For-Review.May 4 2020, 9:10 AM