Page MenuHomePhabricator
Create Task
Maniphest T426750

db1249 is unreachable
Closed, ResolvedPublic
Actions

Description

db1249 is unreachable, its port on the TOR switch is down and the management console is unreachable as well

Can you please take a look? Thanks

(The host is a replica in s4)

Related Objects

Event Timeline

FCeratto-WMF created this task.Tue, May 19, 1:08 PM
Marostegui triaged this task as Medium priority.Tue, May 19, 1:13 PM
Marostegui added a project: DBA.
Marostegui moved this task from Triage to In progress on the DBA board.
Maintenance_bot added a project: SRE.Tue, May 19, 1:29 PM
Jclark-ctr moved this task from Backlog to Hardware Failure / Troubleshoot on the ops-eqiad board.Tue, May 19, 3:02 PM
Jclark-ctr claimed this task.Tue, May 19, 3:27 PM
Jclark-ctr closed this task as Resolved.Tue, May 19, 3:29 PM

Power cables were not inserted all the way into the PDU.

FCeratto-WMF reopened this task as Open.Tue, May 19, 4:08 PM
FCeratto-WMF removed Jclark-ctr as the assignee of this task.
FCeratto-WMF removed projects: ops-eqiad, DC-Ops.
FCeratto-WMF added a subscriber: Jclark-ctr.
FCeratto-WMF removed a subscriber: Jclark-ctr.
FCeratto-WMF added a comment.Tue, May 19, 4:15 PM

moving the task back to DBA: the host is up (and with an updated kernel) but before pooling in we should decide if we want to clone it or trust the crash recovery https://phabricator.wikimedia.org/P92613
@Marostegui

Marostegui added a comment.Wed, May 20, 6:01 AM
In T426750#11937397, @FCeratto-WMF wrote:

moving the task back to DBA: the host is up (and with an updated kernel) but before pooling in we should decide if we want to clone it or trust the crash recovery https://phabricator.wikimedia.org/P92613
@Marostegui

I've done a few checks and it all looks fine, we can repool.

ops-monitoring-bot added a comment.Wed, May 20, 6:45 AM

Starting pool of db1249 by fceratto@cumin1003: Repooling after boot

FCeratto-WMF added a comment.Wed, May 20, 6:45 AM

ok, pooling and removing silence

FCeratto-WMF closed this task as Resolved.Wed, May 20, 7:03 AM
FCeratto-WMF claimed this task.
Maintenance_bot moved this task from In progress to Done on the DBA board.Wed, May 20, 7:29 AM
ops-monitoring-bot added a comment.Wed, May 20, 7:30 AM

Completed pooling of db1249 by fceratto@cumin1003: Repooling after boot

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits