Maniphest T219640

Make spicerack more robust when unfreezing writes to elasticsearch / cirrus
Closed, ResolvedPublic
Actions

Description

As seen during recent incident, spicerack is not robust enough to errors when unfreezing writes.

Details

	Project	Branch	Lines +/-	Subject
	operations/software/spicerack	master	+9 -1	Elasticsearch: make unfreezing writes more robust.

Customize query in gerrit

Event Timeline

Gehel created this task.Mar 29 2019, 3:25 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 29 2019, 3:25 PM

Gehel claimed this task.Mar 29 2019, 3:25 PM

Gehel triaged this task as High priority.

Change 500067 had a related patch set uploaded (by Gehel; owner: Gehel):
[operations/software/spicerack@master] Elasticsearch: make unfreezing writes more robust.

https://gerrit.wikimedia.org/r/500067

gerritbot added a project: Patch-For-Review.Mar 29 2019, 3:32 PM

Change 500067 merged by Gehel:
[operations/software/spicerack@master] Elasticsearch: make unfreezing writes more robust.

https://gerrit.wikimedia.org/r/500067

Gehel moved this task from Incoming to Needs Reporting on the Discovery-Search (Current work) board.Apr 1 2019, 3:45 PM

greg moved this task from Active investigation to Follow-up prevention on the Wikimedia-Incident board.Apr 2 2019, 6:24 PM

debt closed this task as Resolved.Apr 5 2019, 10:38 PM

Krinkle edited projects, added Sustainability (Incident Followup); removed Wikimedia-Incident.Apr 28 2020, 9:50 PM

Maintenance_bot removed a project: Patch-For-Review.Apr 28 2020, 10:11 PM

Make spicerack more robust when unfreezing writes to elasticsearch / cirrusClosed, ResolvedPublicActions

Description

Details

Event Timeline

Make spicerack more robust when unfreezing writes to elasticsearch / cirrus
Closed, ResolvedPublic
Actions