Page MenuHomePhabricator
Create Task
Maniphest T178423

rack/setup/install cp40(29|3[012]).ulsfo.wmnet
Closed, ResolvedPublic
Actions

Description

This task will track the setup and deployment of cp40(29|3[012]).ulsfo.wmnet

cp4029:

  • - receive in system on procurement task T160934
  • - rack system in place of older decom cp systems from T176366
  • - bios/drac/serial setup/testing
  • - mgmt dns entries added for both asset tag and hostname
  • - network port setup (description, enable, vlan)
    • end on-site specific steps
  • - update both idrac and bios firmware to latest revisions
  • - production dns entries added
  • - operations/puppet update
  • - OS installation
  • - puppet accept/initial run
  • - handoff for service implementation

cp4030:

  • - receive in system on procurement task T160934
  • - rack system in place of older decom cp systems from T176366
  • - bios/drac/serial setup/testing
  • - mgmt dns entries added for both asset tag and hostname
  • - network port setup (description, enable, vlan)
    • end on-site specific steps
  • - update both idrac and bios firmware to latest revisions
  • - production dns entries added
  • - operations/puppet update
  • - OS installation
  • - puppet accept/initial run
  • - handoff for service implementation

cp4031:

  • - receive in system on procurement task T160934
  • - rack system in place of older decom cp systems from T176366
  • - bios/drac/serial setup/testing
  • - mgmt dns entries added for both asset tag and hostname
  • - network port setup (description, enable, vlan)
    • end on-site specific steps
  • - update both idrac and bios firmware to latest revisions
  • - production dns entries added
  • - operations/puppet update
  • - OS installation
  • - puppet accept/initial run
  • - handoff for service implementation

cp4032:

  • - receive in system on procurement task T160934
  • - rack system in place of older decom cp systems from T176366
  • - bios/drac/serial setup/testing
  • - mgmt dns entries added for both asset tag and hostname
  • - network port setup (description, enable, vlan)
    • end on-site specific steps
  • - bios firmware updated
  • - idrac firmware updated
  • - system doesnt respond to idrac when it worked onsite on 2017-10-17, @RobH to investigate
  • - production dns entries added
  • - operations/puppet update
  • - OS installation
  • - puppet accept/initial run
  • - handoff for service implementation

Details

ProjectBranchLines +/-Subject
operations/puppetproduction+4 -0cp4029-32: add to cache::text::nodes
operations/puppetproduction+5 -7cp4029-32: add to cache::text (but not ipsec yet)
operations/puppetproduction+6 -1cp4032 install params
operations/puppetproduction+21 -0install params for new cp40(29|3[012]).ulsfo.wmnet
operations/dnsmaster+15 -0production dns for cp40(29|3[012]
Customize query in gerrit

Related Objects
Search...

Event Timeline

RobH created this task.Oct 17 2017, 6:40 PM
Restricted Application removed a project: Patch-For-Review. · View Herald TranscriptOct 17 2017, 6:40 PM
RobH renamed this task from rack/setup/install cp40(29|3[123]).ulsfo.wmnet to rack/setup/install cp40(29|3[012]).ulsfo.wmnet.Oct 17 2017, 6:40 PM
RobH updated the task description. (Show Details)
RobH updated the task description. (Show Details)Oct 17 2017, 7:26 PM
RobH moved this task from Backlog to Racking Tasks on the ops-ulsfo board.Oct 17 2017, 7:31 PM
RobH added a comment.Oct 17 2017, 8:28 PM

I still need to flash firmware on drac/bios before OS install on all of these.

gerritbot added a comment.Oct 17 2017, 8:53 PM

Change 384841 had a related patch set uploaded (by RobH; owner: RobH):
[operations/dns@master] production dns for cp40(29|3[012]

https://gerrit.wikimedia.org/r/384841

gerritbot added a project: Patch-For-Review.Oct 17 2017, 8:53 PM

Change 384841 merged by RobH:
[operations/dns@master] production dns for cp40(29|3[012]

https://gerrit.wikimedia.org/r/384841

• ema moved this task from Backlog to Caching on the Traffic board.Oct 18 2017, 1:50 PM
gerritbot added a comment.Oct 18 2017, 4:05 PM

Change 384997 had a related patch set uploaded (by RobH; owner: RobH):
[operations/puppet@production] install params for new cp40(29|3[012]).ulsfo.wmnet

https://gerrit.wikimedia.org/r/384997

gerritbot added a comment.Oct 18 2017, 4:10 PM

Change 384997 merged by RobH:
[operations/puppet@production] install params for new cp40(29|3[012]).ulsfo.wmnet

https://gerrit.wikimedia.org/r/384997

RobH removed a project: Patch-For-Review.Oct 18 2017, 4:19 PM
RobH updated the task description. (Show Details)
RobH updated the task description. (Show Details)Oct 18 2017, 5:49 PM
RobH added a comment.EditedOct 18 2017, 5:54 PM

cp4031 was ready to install, but now it won't let me connect to com2. I was connected, but my session timed out while I was on via com2, and now it won't let me back in, stating its in use. I've reset the drac via racadm racreset with no additional parameter, as well as both soft and hard params (racadm racreset hard), and none free up the com port.

I'm just going to remove power entirely from the system when I'm onsite to remedy the issue.

cp4029, cp4030, and cp4031 have all had firmware updates as of today.

RobH updated the task description. (Show Details)Oct 18 2017, 5:56 PM
RobH updated the task description. (Show Details)Oct 18 2017, 6:00 PM
RobH updated the task description. (Show Details)Oct 18 2017, 6:41 PM
gerritbot added a comment.Oct 19 2017, 12:00 AM

Change 385111 had a related patch set uploaded (by RobH; owner: RobH):
[operations/puppet@production] cp4032 install params

https://gerrit.wikimedia.org/r/385111

gerritbot added a project: Patch-For-Review.Oct 19 2017, 12:00 AM

Change 385111 merged by RobH:
[operations/puppet@production] cp4032 install params

https://gerrit.wikimedia.org/r/385111

RobH updated the task description. (Show Details)Oct 19 2017, 12:11 AM
RobH removed a project: Patch-For-Review.Oct 19 2017, 12:42 AM
RobH updated the task description. (Show Details)
gerritbot added a comment.Oct 19 2017, 4:38 PM

Change 385206 had a related patch set uploaded (by BBlack; owner: BBlack):
[operations/puppet@production] cp4029-32: add to cache::text (but not ipsec yet)

https://gerrit.wikimedia.org/r/385206

gerritbot added a project: Patch-For-Review.Oct 19 2017, 4:38 PM

Change 385207 had a related patch set uploaded (by BBlack; owner: BBlack):
[operations/puppet@production] cp4029-32: add to cache::text::nodes

https://gerrit.wikimedia.org/r/385207

gerritbot added a comment.Oct 19 2017, 4:39 PM

Change 385206 merged by BBlack:
[operations/puppet@production] cp4029-32: add to cache::text (but not ipsec yet)

https://gerrit.wikimedia.org/r/385206

ops-monitoring-bot added a comment.Oct 19 2017, 6:00 PM

Script wmf-auto-reimage was launched by bblack on neodymium.eqiad.wmnet for hosts:

['cp4029.ulsfo.wmnet', 'cp4030.ulsfo.wmnet', 'cp4031.ulsfo.wmnet', 'cp4032.ulsfo.wmnet']

The log can be found in /var/log/wmf-auto-reimage/201710191800_bblack_25477.log.

ops-monitoring-bot added a comment.Oct 19 2017, 6:31 PM

Completed auto-reimage of hosts:

['cp4031.ulsfo.wmnet', 'cp4030.ulsfo.wmnet', 'cp4032.ulsfo.wmnet', 'cp4029.ulsfo.wmnet']

Of which those FAILED:

['cp4031.ulsfo.wmnet', 'cp4030.ulsfo.wmnet', 'cp4032.ulsfo.wmnet', 'cp4029.ulsfo.wmnet']
gerritbot added a comment.Oct 19 2017, 6:49 PM

Change 385207 merged by BBlack:
[operations/puppet@production] cp4029-32: add to cache::text::nodes

https://gerrit.wikimedia.org/r/385207

BBlack moved this task from Caching to Hardware on the Traffic board.Oct 23 2017, 2:44 PM
BBlack closed this task as Resolved.Nov 22 2017, 8:53 PM
Content licensed under Creative Commons Attribution-ShareAlike 4.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL