Page MenuHomePhabricator
Create Task
Maniphest T199107

labvirt1021: reallocate from eqiad1 as cloudvirt1021
Closed, ResolvedPublic
Actions

Description

Move the labvirt1021 physical server from the main deployment to the eqiad1 one.

@chasemp suggested the new name is cloudvirt1021 instead of cloudvirt1001.

Details

ProjectBranchLines +/-Subject
operations/dnsmaster+1 -2cloudvps: clean labvirt1021 resources
operations/puppetproduction+20 -7cloudvps: reimage and rename labvirt1021 to cloudvirt1021
operations/dnsmaster+5 -4cloudvps: rename labvirt1021.eqiad.wmnet to cloudvirt1021.eqiad.wmnet
Customize query in gerrit

Related Objects
Search...

Event Timeline

aborrero triaged this task as Medium priority.Jul 9 2018, 1:09 PM
aborrero created this task.
gerritbot added a comment.Jul 9 2018, 1:18 PM

Change 444581 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] cloudvps: reimage and rename labvirt1021 to cloudvirt1001

https://gerrit.wikimedia.org/r/444581

gerritbot added a project: Patch-For-Review.Jul 9 2018, 1:18 PM
gerritbot added a comment.Jul 9 2018, 1:23 PM

Change 444584 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/dns@master] cloudvps: rename labvirt1021.eqiad.wmnet to cloudvirt1001.eqiad.wmnet

https://gerrit.wikimedia.org/r/444584

aborrero renamed this task from labvirt1021: reallocate from eqiad1 as cloudvirt1001 to labvirt1021: reallocate from eqiad1 as cloudvirt1021.Jul 9 2018, 1:26 PM
aborrero updated the task description. (Show Details)
aborrero added subscribers: Volans, RobH.Jul 9 2018, 5:07 PM

@Volans adviced we need to use this cmdline: wmf-auto-reimage-host --rename cloudvirt1021.eqiad.wmnet [...]
Also @RobH pointed a task should be filled for DCops to relabel the physical servers. The racktables entry should be updated as well by the time of the reimage+rename.

aborrero mentioned this in T199132: Relabel labvirt1021.eqiad.wmnet as cloudvirt1021.eqiad.wmnet.Jul 9 2018, 5:27 PM
aborrero added a comment.EditedJul 9 2018, 5:36 PM

My timeline for tomorrow:

  • disable puppet in labvirt1021
  • merge patches (including partial DNS patch with double mgmt FQDN)
  • run the wmf-auto-reimage-host script
  • merge DNS cleanup patch
  • racktables/netbox update
  • get the physical relabeling done (T199132)
  • done
gerritbot added a comment.Jul 10 2018, 9:13 AM

Change 444584 merged by Arturo Borrero Gonzalez:
[operations/dns@master] cloudvps: rename labvirt1021.eqiad.wmnet to cloudvirt1021.eqiad.wmnet

https://gerrit.wikimedia.org/r/444584

gerritbot added a comment.Jul 10 2018, 9:14 AM

Change 444581 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] cloudvps: reimage and rename labvirt1021 to cloudvirt1021

https://gerrit.wikimedia.org/r/444581

ops-monitoring-bot added a subscriber: ops-monitoring-bot.Jul 10 2018, 9:23 AM

Script wmf-auto-reimage was launched by aborrero on neodymium.eqiad.wmnet for hosts:

labvirt1021.eqiad.wmnet

The log can be found in /var/log/wmf-auto-reimage/201807100922_aborrero_17857_labvirt1021_eqiad_wmnet.log.

aborrero added a comment.Jul 10 2018, 9:24 AM

I used this cmdline:

aborrero@neodymium:~$ sudo wmf-auto-reimage-host -p T199107 --rename cloudvirt1021.eqiad.wmnet --rename-mgmt cloudvirt1021.mgmt.eqiad.wmnet labvirt1021.eqiad.wmnet labvirt1021.mgmt.eqiad.wmnet

ops-monitoring-bot added a comment.Jul 10 2018, 9:36 AM

Completed auto-reimage of hosts:

['cloudvirt1021.eqiad.wmnet']

Of which those FAILED:

['cloudvirt1021.eqiad.wmnet']
ops-monitoring-bot added a comment.Jul 10 2018, 9:41 AM

Script wmf-auto-reimage was launched by aborrero on neodymium.eqiad.wmnet for hosts:

labvirt1021.eqiad.wmnet

The log can be found in /var/log/wmf-auto-reimage/201807100940_aborrero_16366_labvirt1021_eqiad_wmnet.log.

aborrero added a comment.Jul 10 2018, 9:41 AM

Trying again, since the puppet change wasn't present in the TFTP servers. Trying now:

aborrero@neodymium:~$ sudo cumin 'P:installserver::tftp' 'run-puppet-agent -q'
aborrero@neodymium:~$ sudo wmf-auto-reimage-host --no-verify --no-downtime -p T199107 --rename cloudvirt1021.eqiad.wmnet --rename-mgmt cloudvirt1021.mgmt.eqiad.wmnet labvirt1021.eqiad.wmnet labvirt1021.mgmt.eqiad.wmnet

(thanks @Volans )

ops-monitoring-bot added a comment.Jul 10 2018, 9:50 AM

Completed auto-reimage of hosts:

['cloudvirt1021.eqiad.wmnet']

Of which those FAILED:

['cloudvirt1021.eqiad.wmnet']
ops-monitoring-bot added a comment.Jul 10 2018, 9:51 AM

Script wmf-auto-reimage was launched by aborrero on neodymium.eqiad.wmnet for hosts:

cloudvirt1021.eqiad.wmnet

The log can be found in /var/log/wmf-auto-reimage/201807100951_aborrero_23273_cloudvirt1021_eqiad_wmnet.log.

aborrero added a comment.Jul 10 2018, 9:55 AM

Again the debian installer prompt.

Since the new names can be reached, trying again with:

aborrero@neodymium:~$ sudo wmf-auto-reimage-host --no-verify --no-downtime -p T199107 cloudvirt1021.eqiad.wmnet cloudvirt1021.mgmt.eqiad.wmnet

ops-monitoring-bot added a comment.Jul 10 2018, 10:03 AM

Completed auto-reimage of hosts:

['cloudvirt1021.eqiad.wmnet']

Of which those FAILED:

['cloudvirt1021.eqiad.wmnet']
ops-monitoring-bot added a comment.Jul 10 2018, 10:27 AM

Script wmf-auto-reimage was launched by aborrero on neodymium.eqiad.wmnet for hosts:

cloudvirt1021.eqiad.wmnet

The log can be found in /var/log/wmf-auto-reimage/201807101026_aborrero_4568_cloudvirt1021_eqiad_wmnet.log.

ops-monitoring-bot added a comment.Jul 10 2018, 10:56 AM

Completed auto-reimage of hosts:

['cloudvirt1021.eqiad.wmnet']

and were ALL successful.

aborrero closed this task as Resolved.Jul 10 2018, 11:03 AM
aborrero mentioned this in T199202: labvirt1022: reallocate from eqiad1 as cloudvirt1022.Jul 10 2018, 11:08 AM
gerritbot added a comment.Jul 11 2018, 9:06 AM

Change 445100 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/dns@master] cloudvps: clean labvirt1021 resources

https://gerrit.wikimedia.org/r/445100

gerritbot added a comment.Jul 11 2018, 9:07 AM

Change 445100 merged by Arturo Borrero Gonzalez:
[operations/dns@master] cloudvps: clean labvirt1021 resources

https://gerrit.wikimedia.org/r/445100

aborrero mentioned this in T199521: labnet1003: reimage+rename to cloudnet1003.Jul 13 2018, 10:12 AM
aborrero mentioned this in T199906: labnet1004: reimage+rename to cloudnet1004.Jul 18 2018, 12:12 PM
aborrero mentioned this in T200068: labcontrol1003: reimage+rename to cloudcontrol1003.Jul 20 2018, 9:09 AM
Content licensed under Creative Commons Attribution-ShareAlike 3.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL