ps1-d1-eqiad and ps1-d6-eqiad down
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	RhinosF1
	Mar 20 2023, 9:23 PM

Description

Hi SRE folks,

the two PS mentioned above are down. Please see conversation below and act as required. Not tagging ops-eqiad as I don’t know impact fully and don’t want it to look like I’m authorising anything.

21:07:28 <icinga-wm> PROBLEM - Host ps1-d1-eqiad is DOWN: PING CRITICAL - Packet loss = 100%

21:07:40 <icinga-wm> PROBLEM - Host ps1-d6-eqiad is DOWN: PING CRITICAL - Packet loss = 100%

21:17:41 <papaul> RhinosF1: it looks like it not just the pdu it is all the servers connected to that mgmt switch

Event Timeline

RhinosF1 created this task.Mar 20 2023, 9:23 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 20 2023, 9:23 PM

Papaul triaged this task as Medium priority.Mar 20 2023, 9:24 PM

Papaul added a project: ops-eqiad.

Acknowledged, will investigate and update task.

• Cmjohnson claimed this task.Mar 21 2023, 3:09 PM

• Cmjohnson moved this task from Backlog to High Priority Task on the ops-eqiad board.

@Cmjohnson i changed the cable out just now but have to step out. of data center i can continue to look at it later if its still bad

Rebooted msw in rack d1 ,d6 looks to recovered

ps1-d1-eqiad and ps1-d6-eqiad downClosed, ResolvedPublicActions

Description

Event Timeline

ps1-d1-eqiad and ps1-d6-eqiad down
Closed, ResolvedPublic
Actions