Page MenuHomePhabricator

(Aug 30th, 2019) rack/setup/install elastic10[53-67].eqiad.wmnet
Open, NormalPublic0 Story Points

Description

This task will track the racking of 15 new elastic systems, replacing elastic10[17-31].

Racking Proposal:

This was provided on procurement task T226843.

Current racking configuration (excluding hosts that will be decommissioned):

Row A: 1032(A3), 1033(A3), 1034(A3), 1035(A3), 1044(A6), 1045(A6), 1048(A6) (7 nodes)
Row B: 1036(B3), 1037(B3), 1038(B3), 1039(B3), 1046(B6), 1047(B6), 1049(B4), 1050(B4) (8 nodes)
Row C: 1040(C5), 1041(C5), 1042(C5), 1043(C5), 1051(C7), 1052(C7) (6 nodes)
Row D: none (0 node)

Proposal for new nodes:

Row A: 1053, 1054 (2 nodes, try to avoid A3, then avoid A6)
Row B: 1055 (1 node), Avoid B3, B4, B6 if possible.
Row C: 1056, 1057, 1058 (3 nodes) Avoid C5 first, then avoid C7 if possible
Row D: 1059, 1060, 1061, 1062, 1063, 1064, 1065, 1066, 1067 (9 nodes) evenly space in 10G racks, there are no elastic nodes staying in this row (the older ones in this row are all going away when these come online as they are in the elastic10[17-31] range.)

Minor imbalance (+- 1 node) between rows is not a major issue, feel free to propose another arrangement if it makes more sense to on-sites. Try to evenly space out elastic nodes in the row evenly in 10G racks.

Common specifications:

  • OS: Debian/Stretch
  • IP / Subnet: internal subnet for each row
  • Partitioning : RAID0 software (current systems use elasticsearch-raid0.cfg if we stay with 2 SSD per node, it should be good)

Installation Checklists

elastic1053:

  • - receive in system on procurement task T226843
  • - rack system with proposed racking plan (see above) & update netbox (include all system info plus location, state of planned)
  • - bios/drac/serial setup/testing
  • - mgmt dns entries added for both asset tag and hostname
  • - network port setup (description, enable, vlan)
    • end on-site specific steps
  • - production dns entries added
  • - operations/puppet update (install_server at minimum, other files if possible)
  • - OS installation
  • - puppet accept/initial run (with role:spare)
  • - host state in netbox set to staged
  • - handoff for service implementation
  • - service implementer changes from 'staged' status to 'active' status in netbox'

elastic1054:

  • - receive in system on procurement task T226843
  • - rack system with proposed racking plan (see above) & update netbox (include all system info plus location, state of planned)
  • - bios/drac/serial setup/testing
  • - mgmt dns entries added for both asset tag and hostname
  • - network port setup (description, enable, vlan)
    • end on-site specific steps
  • - production dns entries added
  • - operations/puppet update (install_server at minimum, other files if possible)
  • - OS installation
  • - puppet accept/initial run (with role:spare)
  • - host state in netbox set to staged
  • - handoff for service implementation
  • - service implementer changes from 'staged' status to 'active' status in netbox'

elastic1055:

  • - receive in system on procurement task T226843
  • - rack system with proposed racking plan (see above) & update netbox (include all system info plus location, state of planned)
  • - bios/drac/serial setup/testing
  • - mgmt dns entries added for both asset tag and hostname
  • - network port setup (description, enable, vlan)
    • end on-site specific steps
  • - production dns entries added
  • - operations/puppet update (install_server at minimum, other files if possible)
  • - OS installation
  • - puppet accept/initial run (with role:spare)
  • - host state in netbox set to staged
  • - handoff for service implementation
  • - service implementer changes from 'staged' status to 'active' status in netbox'

elastic1056:

  • - receive in system on procurement task T226843
  • - rack system with proposed racking plan (see above) & update netbox (include all system info plus location, state of planned)
  • - bios/drac/serial setup/testing
  • - mgmt dns entries added for both asset tag and hostname
  • - network port setup (description, enable, vlan)
    • end on-site specific steps
  • - production dns entries added
  • - operations/puppet update (install_server at minimum, other files if possible)
  • - OS installation
  • - puppet accept/initial run (with role:spare)
  • - host state in netbox set to staged
  • - handoff for service implementation
  • - service implementer changes from 'staged' status to 'active' status in netbox'

elastic1057:

  • - receive in system on procurement task T226843
  • - rack system with proposed racking plan (see above) & update netbox (include all system info plus location, state of planned)
  • - bios/drac/serial setup/testing
  • - mgmt dns entries added for both asset tag and hostname
  • - network port setup (description, enable, vlan)
    • end on-site specific steps
  • - production dns entries added
  • - operations/puppet update (install_server at minimum, other files if possible)
  • - OS installation
  • - puppet accept/initial run (with role:spare)
  • - host state in netbox set to staged
  • - handoff for service implementation
  • - service implementer changes from 'staged' status to 'active' status in netbox'

elastic1058:

  • - receive in system on procurement task T226843
  • - rack system with proposed racking plan (see above) & update netbox (include all system info plus location, state of planned)
  • - bios/drac/serial setup/testing
  • - mgmt dns entries added for both asset tag and hostname
  • - network port setup (description, enable, vlan)
    • end on-site specific steps
  • - production dns entries added
  • - operations/puppet update (install_server at minimum, other files if possible)
  • - OS installation
  • - puppet accept/initial run (with role:spare)
  • - host state in netbox set to staged
  • - handoff for service implementation
  • - service implementer changes from 'staged' status to 'active' status in netbox'

elastic1059:

  • - receive in system on procurement task T226843
  • - rack system with proposed racking plan (see above) & update netbox (include all system info plus location, state of planned)
  • - bios/drac/serial setup/testing
  • - mgmt dns entries added for both asset tag and hostname
  • - network port setup (description, enable, vlan)
    • end on-site specific steps
  • - production dns entries added
  • - operations/puppet update (install_server at minimum, other files if possible)
  • - OS installation
  • - puppet accept/initial run (with role:spare)
  • - host state in netbox set to staged
  • - handoff for service implementation
  • - service implementer changes from 'staged' status to 'active' status in netbox'

elastic1060:

  • - receive in system on procurement task T226843
  • - rack system with proposed racking plan (see above) & update netbox (include all system info plus location, state of planned)
  • - bios/drac/serial setup/testing
  • - mgmt dns entries added for both asset tag and hostname
  • - network port setup (description, enable, vlan)
    • end on-site specific steps
  • - production dns entries added
  • - operations/puppet update (install_server at minimum, other files if possible)
  • - OS installation
  • - puppet accept/initial run (with role:spare)
  • - host state in netbox set to staged
  • - handoff for service implementation
  • - service implementer changes from 'staged' status to 'active' status in netbox'

Event Timeline

RobH triaged this task as Normal priority.Mon, Aug 19, 6:58 PM
RobH created this task.
Restricted Application added a project: Operations. · View Herald TranscriptMon, Aug 19, 6:58 PM
RobH added a parent task: Unknown Object (Task).Mon, Aug 19, 6:58 PM

Try to evenly space out elastic nodes in the row evenly in 1G racks.

All new elastic servers are coming in with 10G cards and should go into 10G racks.

RobH updated the task description. (Show Details)Mon, Aug 19, 8:27 PM

Try to evenly space out elastic nodes in the row evenly in 1G racks.

All new elastic servers are coming in with 10G cards and should go into 10G racks.

fixed!

Cmjohnson moved this task from Backlog to Racking Tasks on the ops-eqiad board.Thu, Aug 29, 4:36 PM
RobH renamed this task from rack/setup/install elastic10[53-67].eqiad.wmnet to (Aug 30th, 2019) rack/setup/install elastic10[53-67].eqiad.wmnet.Mon, Sep 9, 4:54 PM
Cmjohnson updated the task description. (Show Details)Tue, Sep 10, 1:12 PM