Page MenuHomePhabricator

labcontrol1003: reimage+rename to cloudcontrol1003
Closed, ResolvedPublic

Description

Reimage + rename this server to the new naming scheme.

Timeline is:

  • backup db (in /home/aborrero/db.sql @ cloudcontrol1004)
  • disable puppet in labcontrol1003
  • merge puppet patch to rename and get the new debian installer working
  • merge dns patch to add the new FQDNs (partial, the old mgmt names still remains)
  • run the wmf-auto-reimage-host script
  • restore db
  • merge DNS cleanup patch
  • racktables update
  • get the physical relabeling done (T200080)
  • done

Same happened to labvirt1021/cloudvirt1021 (see T199107 and T199132).

Event Timeline

aborrero triaged this task as Normal priority.Jul 20 2018, 9:09 AM
aborrero created this task.
Restricted Application removed a project: Patch-For-Review. · View Herald TranscriptJul 20 2018, 9:09 AM

Change 447046 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] cloudvps: eqiad1: use cloudcontrol1004 as primary control server

https://gerrit.wikimedia.org/r/447046

Change 447046 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] cloudvps: eqiad1: use cloudcontrol1004 as primary control server

https://gerrit.wikimedia.org/r/447046

Change 447048 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] Revert "cloudvps: eqiad1: use cloudcontrol1004 as primary control server"

https://gerrit.wikimedia.org/r/447048

Change 447048 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] Revert "cloudvps: eqiad1: use cloudcontrol1004 as primary control server"

https://gerrit.wikimedia.org/r/447048

Change 447056 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/dns@master] cloudvps: add cloudcontrol1003.wikimedia.org FQDN

https://gerrit.wikimedia.org/r/447056

Change 447056 merged by Arturo Borrero Gonzalez:
[operations/dns@master] cloudvps: add cloudcontrol1003.wikimedia.org FQDN

https://gerrit.wikimedia.org/r/447056

Change 447057 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] cloudvps: rename labnet1003.wikimedia.org to cloudnet1003.wikimedia.org

https://gerrit.wikimedia.org/r/447057

aborrero updated the task description. (Show Details)Jul 20 2018, 10:53 AM

Change 447057 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] cloudvps: rename labnet1003.wikimedia.org to cloudnet1003.wikimedia.org

https://gerrit.wikimedia.org/r/447057

aborrero updated the task description. (Show Details)Jul 20 2018, 11:00 AM

Script wmf-auto-reimage was launched by aborrero on neodymium.eqiad.wmnet for hosts:

labcontrol1003.wikimedia.org

The log can be found in /var/log/wmf-auto-reimage/201807201105_aborrero_1674_labcontrol1003_wikimedia_org.log.

aborrero updated the task description. (Show Details)Jul 20 2018, 11:05 AM

Same issue as in some other hosts:

(initramfs) cat /etc/mdadm/mdadm.conf 
HOMEHOST <system>
ARRAY /dev/md/0  metadata=1.2 UUID=83b2d878:ec1733d3:01cd882d:83a54de1 name=cloudcontrol1003:0
ARRAY /dev/md/1  metadata=1.2 UUID=cdff5b81:80a9429c:552e2ad1:0e5918eb name=cloudcontrol1003:1
(initramfs) mdadm --assemble /dev/md/0
mdadm: /dev/md/0 has been started with 4 drives.
(initramfs) exit

Completed auto-reimage of hosts:

['cloudcontrol1003.wikimedia.org']

and were ALL successful.

aborrero updated the task description. (Show Details)Jul 20 2018, 12:16 PM

Change 447063 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/dns@master] cloudvps: cleanup labcontrol1003 resources

https://gerrit.wikimedia.org/r/447063

Change 447063 merged by Arturo Borrero Gonzalez:
[operations/dns@master] cloudvps: cleanup labcontrol1003 resources

https://gerrit.wikimedia.org/r/447063

aborrero updated the task description. (Show Details)Jul 20 2018, 12:46 PM
aborrero closed this task as Resolved.Aug 6 2018, 8:51 AM
aborrero updated the task description. (Show Details)

All is done now.