Details
Status | Subtype | Assigned | Task | ||
---|---|---|---|---|---|
Resolved | MoritzMuehlenhoff | T224549 Track remaining jessie systems in production | |||
Resolved | Dzahn | T180641 reinstall RT server with private IP and Buster | |||
Resolved | Dzahn | T236748 decom ununpentium |
Event Timeline
Change 544080 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] site/install_server: decom ununpentium
Change 544080 merged by Dzahn:
[operations/puppet@production] site/install_server: decom ununpentium
Change 547045 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] mariadb::ferm_misc: remove ununpentium from allowed hosts
Change 547045 merged by Dzahn:
[operations/puppet@production] mariadb::ferm_misc: remove ununpentium from allowed hosts for RT
Change 547047 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/dns@master] remove ununpentium.wikimedia.org
Mentioned in SAL (#wikimedia-operations) [2019-10-29T22:17:46Z] <mutante> ununpentium - shutdown Ganeti VM - running decom script, schedule icinga downtime (T236748)
cookbooks.sre.hosts.decommission executed by dzahn@cumin1001 for hosts: ununpentium.wikimedia.org
- ununpentium.wikimedia.org (FAIL)
- Downtimed host on Icinga
- No management interface found (likely a VM)
- Unable to connect to the host, wipe of bootloaders will not be performed: Cumin execution failed (exit_code=2)
- Failed to shutdown, manual intervention required: Cumin execution failed (exit_code=2)
- Set Netbox status on VM not yet supported: manual intervention required
- Removed from DebMonitor
- Removed from Puppet master and PuppetDB
ERROR: some step on some host failed, check the bolded items above
^ Gone from Icinga. Status in Netbox was "offline" without manual intervention and there is no other status that would fit decom more. It was already shutdown in Ganeti hence the shutdown error.
Change 547047 merged by Dzahn:
[operations/dns@master] remove ununpentium.wikimedia.org
Mentioned in SAL (#wikimedia-operations) [2019-10-29T23:09:04Z] <mutante> ganeti1003 - gnt-instance remove ununpentium.wikimedia.org (T236748)