db1164 power supply isn't redundant
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Marostegui
	May 12 2022, 2:05 PM

Description

It looks like db1164 power supplies are alerting of one of them not being connected. Maybe the cable is loose due to the maintenance operation that happened at T307198?

-------------------------------------------------------------------------------
Record:      23
Date/Time:   05/11/2022 19:17:33
Source:      system
Severity:    Critical
Description: The power input for power supply 1 is lost.
-------------------------------------------------------------------------------
Record:      24
Date/Time:   05/11/2022 19:17:35
Source:      system
Severity:    Critical
Description: Power supply redundancy is lost.
-------------------------------------------------------------------------------

@Cmjohnson or @Jclark-ctr could you double check?
Thanks

Related Objects
Search...

Status	Assigned	Task
Open	None	T291916 Tracking task for Bullseye migrations in production
Resolved	Marostegui	T298585 Upgrade WMF database-and-backup-related hosts to bullseye
Resolved	Ladsgroup	T303171 Upgrade s1 to Bullseye
Resolved	Jclark-ctr	T308246 db1164 power supply isn't redundant

Event Timeline

Marostegui triaged this task as Medium priority.May 12 2022, 2:05 PM

Marostegui created this task.

Marostegui moved this task from Triage to In progress on the DBA board.

Maintenance_bot added a project: SRE.May 12 2022, 2:29 PM

Thanks @Marostegui, the power cord is probably not seated correctly

• Cmjohnson moved this task from Backlog to Hardware Failure / Troubleshoot on the ops-eqiad board.May 13 2022, 4:23 PM

Hi @Jclark-ctr - can you check this out, since @Cmjohnson will be on vacation? Thanks, Willy

Any ETA? We've got the host depooled for now but I would like to repool it before the weekend if possible.

@Marostegui sorry i thought Chris had worked on it last week it was physically unplugged and crash cart was in rack. i have plugged power back into it and it is up

Jclark-ctr closed this task as Resolved.May 20 2022, 1:35 PM

Thanks John:

-------------------------------------------------------------------------------
Record:      26
Date/Time:   05/20/2022 13:33:30
Source:      system
Severity:    Ok
Description: The power supplies are redundant.
-------------------------------------------------------------------------------
Record:      27
Date/Time:   05/20/2022 13:33:33
Source:      system
Severity:    Ok
Description: The input power for power supply 1 has been restored.
-------------------------------------------------------------------------------

Will start repooling this host!

Maintenance_bot moved this task from In progress to Done on the DBA board.May 20 2022, 2:29 PM

db1164 power supply isn't redundant Closed, ResolvedPublicActions

Description

Related ObjectsSearch...

Event Timeline

db1164 power supply isn't redundant
Closed, ResolvedPublic
Actions

Related Objects
Search...