Page MenuHomePhabricator

decom fluorine
Closed, ResolvedPublic

Description

after confirming with @fgiunchedi , decom fluorine fully by going through these steps (from template)

fluorine is a Dell R310 purchasing during the initial buildout of eqiad. It is well out of warranty, and will be fully decommissioned. This will not be reclaimed into spares.


  • - all system services confirmed offline from production use
  • - set all icinga checks to maint mode/disabled while reclaim/decommmission takes place.
  • - remove system from all lvs/pybal active configuration
  • - remove system from puppet/hiera/dsh/dhcp/installserver config
  • - remove site.pp (replace with role::spare if system isn't shut down immediately during this process.)

START NON-INTERRUPPTABLE STEPS

  • - disable puppet on host
  • - remove all remaining puppet references (include role::spare)
  • - power down host
  • - puppet node clean, puppet node deactivate, salt key removed
  • - check server is gone from Icinga and Servermon
  • - remove production dns entries
  • - disable switch port
  • - switch port assignment noted on this task (for later removal) (asw-a-eqiad:ge-4/0/7)

END NON-INTERRUPPTABLE STEPS

  • - WAIT, DO NOT WIPE YET (will be confirmed separately) - CONFIRMED CAN WIPE
  • - system wiped
  • - system disks wiped (by onsite)
  • - system unracked and decommissioned (by onsite), update racktables with result
  • - switch port configration removed from switch once system is unracked..

Event Timeline

Dzahn updated the task description. (Show Details)

Change 341939 had a related patch set uploaded (by Dzahn):
[operations/puppet] remove fluorine from DHCP config

https://gerrit.wikimedia.org/r/341939

Change 341940 had a related patch set uploaded (by Dzahn):
[operations/puppet] mediawiki::logging: remove fluorine from firewall rules

https://gerrit.wikimedia.org/r/341940

Change 341941 had a related patch set uploaded (by Dzahn):
[operations/dns] remove fluorine prod IP, keep mgmt

https://gerrit.wikimedia.org/r/341941

Change 341940 merged by Dzahn:
[operations/puppet] mediawiki::logging: remove fluorine from firewall rules

https://gerrit.wikimedia.org/r/341940

Change 341939 merged by Dzahn:
[operations/puppet] remove fluorine from DHCP config

https://gerrit.wikimedia.org/r/341939

Mentioned in SAL (#wikimedia-operations) [2017-03-09T21:35:51Z] <mutante> fluorine - shutdown -h now (decom) T159996

Mentioned in SAL (#wikimedia-operations) [2017-03-09T21:37:45Z] <mutante> fluorine - puppet node clean, puppet node deactivate, salt-key -d, remove from Icinga.. (T159996)

Change 341941 merged by Dzahn:
[operations/dns] remove fluorine prod IP, keep mgmt

https://gerrit.wikimedia.org/r/341941

@RobH per IRC talk, all steps above done (and added some) up to disabling switch ports. please do that as i just shut the server down a couple minutes ago.

please do NOT WIPE just yet, i added an extra step to confirm that. we want to keep the disk content for a grace period as agreed on with @fgiunchedi

you can also freel free to give it back to me and i give it to dc-ops once it can be wiped.

thank you

RobH updated the task description. (Show Details)

The switch port is disabled. Once you have confirmed this wipe can occur, please comment and assign this to @Cmjohnson.

This can now be wiped and go ahead with the process.

Change 427173 had a related patch set uploaded (by Cmjohnson; owner: Cmjohnson):
[operations/dns@master] Removing mgmt dns fluorine

https://gerrit.wikimedia.org/r/427173

Change 427173 merged by Cmjohnson:
[operations/dns@master] Removing mgmt dns fluorine

https://gerrit.wikimedia.org/r/427173

Cmjohnson updated the task description. (Show Details)