Page MenuHomePhabricator

Cloud VPS outage on cloudvirt1024 and cloudvirt1018 due to storage failure
Closed, ResolvedPublic

Event Timeline

Bstorm created this task.Feb 15 2019, 1:19 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 15 2019, 1:19 AM
bd808 added a subscriber: bd808.
Andrew added a subscriber: Andrew.Feb 28 2019, 5:39 PM

I am 90% sure this was cloudvirt1024 and not 1025, so changing title...

Andrew renamed this task from Cloud VPS outage on cloudvirt1025 and cloudvirt1018 due to storage failure to Cloud VPS outage on cloudvirt1024 and cloudvirt1018 due to storage failure.Feb 28 2019, 5:40 PM
Dzahn added a subscriber: Dzahn.Mar 13 2019, 8:04 AM

Is this also the reason for the Icinga alert that there are 0 nova-compute processes on cloudvirt1024 ?

We haven't bothered to rebuild this host since it's pending some datacenter work. The alert is silenced and described I believe?

Dzahn added a comment.Mar 14 2019, 8:55 AM

It showed up in the list of unhandled alerts. I will ACK it.

@Bstorm Why Tracking-Neverending for this task? Don't you know that that way is nowadays deprecated? (T216747 ditto)

Restricted Application removed a subscriber: Liuxinyu970226. · View Herald TranscriptAug 24 2019, 3:16 AM
JJMC89 reopened this task as Open.Aug 24 2019, 3:22 AM
Dzahn removed a subscriber: Dzahn.Aug 27 2019, 1:26 PM
Andrew added a parent task: Unknown Object (Task).Sep 4 2019, 9:02 PM
Andrew closed this task as Resolved.Oct 23 2019, 3:46 PM
Andrew claimed this task.

These hosts are still offline but the user-facing outage is long since resolved and documented.