Page MenuHomePhabricator
Create Task
Maniphest T214167

labtestneutron2001: reimage to stretch & rename to cloudnet2001-dev
Closed, ResolvedPublic
Actions

Description

Use this server to try the upgrade from jessie to stretch.

Since trying the new puppet code involves reimaging, let's rename to the modern naming scheme while at it.

Timeline would be:

  • disable puppet in labtestneutron2001
  • merge puppet patch to rename and get the new debian installer working
  • merge dns patch to add the new FQDNs (partial, the old mgmt names still remains)
  • run the wmf-auto-reimage-host script
  • merge DNS cleanup patch
  • netbox update
  • get the physical relabeling done (T214181)
  • done

By the way, this server is standby in the neutron setup in the labtestn deployment.

Details

SubjectRepoBranchLines +/-
labtestneutron2001: cleanupoperations/dnsmaster+2 -4
labtestneutron2001: rename to cloudnet2001-devoperations/dnsmaster+6 -5
labtestneutron2001: reimage to stretch and rename to cloudnet2001-devoperations/puppetproduction+8 -7
Customize query in gerrit

Related Objects
Search...

Event Timeline

aborrero triaged this task as Medium priority.Jan 18 2019, 1:50 PM
aborrero created this task.
gerritbot subscribed.Jan 18 2019, 1:51 PM

Change 485185 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/puppet@production] labtestneutron2001: reimage to stretch and rename to cloudnet2001-dev

https://gerrit.wikimedia.org/r/485185

gerritbot added a project: Patch-For-Review.Jan 18 2019, 1:51 PM
aborrero updated the task description. (Show Details)Jan 18 2019, 1:53 PM
aborrero moved this task from Inbox to Doing on the cloud-services-team (Kanban) board.
gerritbot added a comment.Jan 18 2019, 2:01 PM

Change 485187 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/dns@master] labtestneutron2001: rename to cloudnet2001-dev

https://gerrit.wikimedia.org/r/485187

aborrero updated the task description. (Show Details)Jan 18 2019, 2:01 PM
gerritbot added a comment.Jan 18 2019, 3:59 PM

Change 485185 merged by Arturo Borrero Gonzalez:
[operations/puppet@production] labtestneutron2001: reimage to stretch and rename to cloudnet2001-dev

https://gerrit.wikimedia.org/r/485185

aborrero updated the task description. (Show Details)Jan 18 2019, 4:03 PM
gerritbot added a comment.Jan 18 2019, 4:06 PM

Change 485187 merged by Arturo Borrero Gonzalez:
[operations/dns@master] labtestneutron2001: rename to cloudnet2001-dev

https://gerrit.wikimedia.org/r/485187

aborrero updated the task description. (Show Details)Jan 18 2019, 4:08 PM
ops-monitoring-bot subscribed.Jan 18 2019, 4:14 PM

Script wmf-auto-reimage was launched by aborrero on cumin1001.eqiad.wmnet for hosts:

labtestneutron2001.codfw.wmnet

The log can be found in /var/log/wmf-auto-reimage/201901181613_aborrero_249597_labtestneutron2001_codfw_wmnet.log.

Stashbot subscribed.Jan 18 2019, 4:14 PM

Mentioned in SAL (#wikimedia-operations) [2019-01-18T16:14:50Z] <arturo> T214167 reimage+rename labtestneutron2001.codfw.wmnet (jessie) to cloudnet2001-dev.codfw.wmnet (stretch)

ops-monitoring-bot added a comment.Jan 18 2019, 5:29 PM

Completed auto-reimage of hosts:

['cloudnet2001-dev.codfw.wmnet']

Of which those FAILED:

['cloudnet2001-dev.codfw.wmnet']
aborrero updated the task description. (Show Details)Jan 18 2019, 5:35 PM

The host was successfully reimaged+renamed, despite the ops-monitoring-bot message.

gerritbot added a comment.Jan 21 2019, 9:52 AM

Change 485613 had a related patch set uploaded (by Arturo Borrero Gonzalez; owner: Arturo Borrero Gonzalez):
[operations/dns@master] labtestneutron2001: cleanup

https://gerrit.wikimedia.org/r/485613

gerritbot added a comment.Jan 21 2019, 9:52 AM

Change 485613 merged by Arturo Borrero Gonzalez:
[operations/dns@master] labtestneutron2001: cleanup

https://gerrit.wikimedia.org/r/485613

aborrero closed this task as Resolved.Jan 21 2019, 9:54 AM
aborrero updated the task description. (Show Details)
aborrero edited parent tasks, added: T214299: cloudvps: neutron: upgrade jessie -> stretch; removed: T212302: CloudVPS: upgrade: jessie -> stretch & mitaka -> newton.Jan 21 2019, 1:07 PM
Dzahn subscribed.Jan 22 2019, 11:52 PM

cloudnet2001-dev - Check systemd state - CRITICAL - degraded: The system is operational but one or more units failed.

https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=cloudnet2001-dev&service=Check+systemd+state

aborrero added a comment.Jan 23 2019, 11:40 AM
In T214167#4900888, @Dzahn wrote:

cloudnet2001-dev - Check systemd state - CRITICAL - degraded: The system is operational but one or more units failed.

https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=cloudnet2001-dev&service=Check+systemd+state

Thanks! should be solved now.

Papaul closed subtask T214181: codfw: rename/relabel labtestneutron2001 to cloudnet2001-dev as Resolved.Apr 12 2019, 12:38 AM
Dzahn added a comment.Mar 10 2020, 9:58 PM

Currently we have the following alerts:

cloudcontrol2001-dev - systemd state
cloudnet2002-dev - systemd state
cloudnet2003-dev - Check whether microcode mitigations for CPU vulnerabilities are applied, DPKG state
cloudvirt2001-dev - DPKG
cloudvirt2002-dev - DPKG
cloudvirt2003-dev -systemd state

Maintenance_bot removed a project: Patch-For-Review.Mar 10 2020, 10:10 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL