Page MenuHomePhabricator
Create Task
Maniphest T266724

(Need By: TBD) rack/setup/install rdb101[12]
Closed, ResolvedPublic
Actions

Description

This task will track the racking, setup, and OS installation of rdb101[12]

Hostname / Racking / Installation Details

Hostnames: rdb1011, rdb1012
Racking Proposal: rdb1011: A1, rdb1012: D4
Networking/Subnet/VLAN/IP: rdb1011: 10.64.16.0/24, rdb1012: 10.64.48.0/24
Partitioning/Raid: same as other rdb hosts
OS Distro: Stretch

Per host setup checklist

Each host should have its own setup checklist copied and pasted into the list below.

rdb1011:

  • - receive in system on procurement task T264353 & in coupa
  • - rack system with proposed racking plan (see above) & update netbox (include all system info plus location, sxtate of planned)
  • - bios/drac/serial setup/testing
  • - mgmt dns entries added for both asset tag and hostname
  • - network port setup (description, enable, vlan)
    • end on-site specific steps
  • - production dns entries added
  • - operations/puppet update (install_server at minimum, other files if possible)
  • - OS installation
  • - puppet accept/initial run (with role:spare)
  • - host state in netbox set to staged

rdb1012:

  • - receive in system on procurement task T264353 & in coupa
  • - rack system with proposed racking plan (see above) & update netbox (include all system info plus location, state of planned)
  • - bios/drac/serial setup/testing
  • - mgmt dns entries added for both asset tag and hostname
  • - network port setup (description, enable, vlan)
    • end on-site specific steps
  • - production dns entries added
  • - operations/puppet update (install_server at minimum, other files if possible)
  • - OS installation
  • - puppet accept/initial run (with role:spare)
  • - host state in netbox set to staged

Once the system(s) above have had all checkbox steps completed, this task can be resolved.

Details

SubjectRepoBranchLines +/-
rdb1011 install paramsoperations/puppetproduction+10 -0
rdb1012 install server updatesoperations/puppetproduction+30 -24
Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedRequest• CmjohnsonT273139 decommission rdb100[56].eqiad.wmnet
 ResolvedakosiarisT281217 Replace rdb1005, rdb1006 with rdb1011, rdb1012
Unknown Object (Task)
 ResolvedRobHT266724 (Need By: TBD) rack/setup/install rdb101[12]

Event Timeline

RobH created this task.Oct 28 2020, 10:29 PM
Restricted Application added a project: SRE. · View Herald TranscriptOct 28 2020, 10:29 PM
RobH added a parent task: Unknown Object (Task).Oct 28 2020, 10:29 PM
RobH moved this task from Backlog to Racking Tasks on the ops-eqiad board.
RobH unsubscribed.
RobH mentioned this in Unknown Object (Task).Oct 28 2020, 10:33 PM
wiki_willy assigned this task to • Cmjohnson.Nov 25 2020, 7:35 PM
wiki_willy subscribed.

Arrived on Nov 17

• Cmjohnson reassigned this task from • Cmjohnson to RobH.Dec 18 2020, 5:33 PM
• Cmjohnson updated the task description. (Show Details)
• Cmjohnson added subscribers: RobH, • Cmjohnson.

@RobH these are ready for you

RobH reassigned this task from RobH to • Cmjohnson.Dec 21 2020, 4:37 PM

@Cmjohnson: rdb1011 doesn't ping via idrac interface (or ssh, or https). Please investigate rdb1011, I'll continue the steps to install rdb1012.

gerritbot added a comment.Dec 21 2020, 4:43 PM

Change 651197 had a related patch set uploaded (by RobH; owner: RobH):
[operations/puppet@production] rdb1012 install server updates

https://gerrit.wikimedia.org/r/651197

gerritbot added a project: Patch-For-Review.Dec 21 2020, 4:43 PM
RobH updated the task description. (Show Details)Dec 21 2020, 4:49 PM
gerritbot added a comment.Dec 21 2020, 4:50 PM

Change 651197 merged by RobH:
[operations/puppet@production] rdb1012 install server updates

https://gerrit.wikimedia.org/r/651197

Maintenance_bot removed a project: Patch-For-Review.Dec 21 2020, 5:10 PM
ops-monitoring-bot added a comment.Dec 21 2020, 5:19 PM

Script wmf-auto-reimage was launched by robh on cumin1001.eqiad.wmnet for hosts:

rdb1012.eqiad.wmnet

The log can be found in /var/log/wmf-auto-reimage/202012211718_robh_8458_rdb1012_eqiad_wmnet.log.

ops-monitoring-bot added a comment.Dec 21 2020, 5:19 PM

Completed auto-reimage of hosts:

['rdb1012.eqiad.wmnet']

Of which those FAILED:

['rdb1012.eqiad.wmnet']
ops-monitoring-bot added a comment.Dec 21 2020, 5:19 PM

Script wmf-auto-reimage was launched by robh on cumin1001.eqiad.wmnet for hosts:

rdb1012.eqiad.wmnet

The log can be found in /var/log/wmf-auto-reimage/202012211719_robh_8542_rdb1012_eqiad_wmnet.log.

ops-monitoring-bot added a comment.Dec 21 2020, 5:29 PM

Completed auto-reimage of hosts:

['rdb1012.eqiad.wmnet']

Of which those FAILED:

['rdb1012.eqiad.wmnet']
gerritbot added a comment.Dec 21 2020, 6:00 PM

Change 651232 had a related patch set uploaded (by RobH; owner: RobH):
[operations/puppet@production] rdb1011 install params

https://gerrit.wikimedia.org/r/651232

gerritbot added a project: Patch-For-Review.Dec 21 2020, 6:00 PM

Change 651232 merged by RobH:
[operations/puppet@production] rdb1011 install params

https://gerrit.wikimedia.org/r/651232

ops-monitoring-bot added a comment.Dec 21 2020, 6:03 PM

Script wmf-auto-reimage was launched by robh on cumin1001.eqiad.wmnet for hosts:

['rdb1011.eqiad.wmnet', 'rdb1012.eqiad.wmnet']

The log can be found in /var/log/wmf-auto-reimage/202012211803_robh_20380.log.

RobH removed a project: Patch-For-Review.Dec 21 2020, 6:06 PM
RobH updated the task description. (Show Details)
RobH claimed this task.Dec 21 2020, 6:28 PM
RobH updated the task description. (Show Details)
ops-monitoring-bot added a comment.Dec 21 2020, 6:34 PM

Completed auto-reimage of hosts:

['rdb1012.eqiad.wmnet', 'rdb1011.eqiad.wmnet']

and were ALL successful.

RobH closed this task as Resolved.Dec 21 2020, 6:34 PM
RobH added a subscriber: jijiki.

@jijiki: I've added you as a subscriber so you get a notification of this completed racking for two hosts; rdb101[12] are all done with their imaging and ready for your team to push into service. I subscribed you, due to your being the person who approved the configuration on the procurement task T264353.

DC Ops has completed the racking and imaging, so this task is now resolved.

wiki_willy mentioned this in T273922: update hostname labels on logstash103[345] & db11[51-76].Feb 12 2021, 11:24 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL