Page MenuHomePhabricator

Add missing labels for equipment and cables
Closed, ResolvedPublic

Description

During the recent buildout, @Papaul encountered issues with the label machine (jamming) and ran out of time to label all equipment. These need to be addressed in a future visit.

The following are missing labels (per @Papaul):

  • All 3 msw switches
  • All 6 PDUs. The PDUs on the right side of the racks are ps1 and the onces on the left side of the racks are ps2.
  • All server power cords in rack OE15 and OE16
  • All routers power cords

Note: the last label number used was 20102 so the next one should be 20103

For the last one it was reported that:

  • cr2-esams pem 0 and 2 are plugged on ps1-oe14 pem0 is the first C19 to C20 and pem2 is the second
  • cr2-esams pem 1 and 3 are plugged on ps2-oe14 pem1 is the first C19 to C20 and pem3 is the second
  • cr3-esams pem 0 and 2 are plugged on ps1-oe16 pem0 is the first C19 to C20 and pem2 is the second
  • cr3-esams pem 1 and 3 are plugged on ps2-oe16 pem1 is the first C19 to C20 and pem3 is the second

The following are missing a cable ID in our documentation in Netbox (were missing from the spreadsheet we used to bootstrap that):

  • ps1-oe14-esams - msw-oe14-esams (network)
  • ps1-oe16-esams - msw-oe16-esams (network)
  • msw-oe15-esams - asw2-oe15-esams (network)
  • scs-oe16-esams - atlas-esams (console)
  • scs-oe16-esams - cr3-esams (console)
  • scs-oe16-esams - cr3-esams (console)
  • scs-oe16-esams - mr1-esams (console)
  • scs-oe16-esams - asw-oe14-esams (console)
  • scs-oe16-esams - asw-oe15-esams (console)
  • scs-oe16-esams - asw-oe16-esams (console)
  • All power cables

(also see T237006 for a similar task)

Event Timeline

faidon triaged this task as Medium priority.Oct 31 2019, 1:36 PM
faidon created this task.
Restricted Application added a subscriber: Aklapper. · View Herald Transcript
RobH added a subscriber: RobH.

Please note that ps1-oe1[456]-esams do NOT have their individual power ports labeled. As part of this task, can a cable mapping of all power cables be generated so we can update the PDUs for remote power control?

Power cords label information for servers in rack OE14

Serverps1ps2
lvs30052008020088
ganeti30012008120089
dns30012008220090
cp30502008320091
cp30512008420092
cp30522008520093
cp30532008620094
cp30542008720095
Papaul updated the task description. (Show Details)
Papaul updated the task description. (Show Details)
mark added a subscriber: mark.

All SERVER power cords have been audited in this sheet: https://docs.google.com/spreadsheets/d/1RMb6lMCc94wUj6MgSm1yYdnAC3SUsZIRj8zHLtxRx4o/edit?usp=sharing

Missing labels on either end of the cord have been augmented. All should be labeled and documented now - just needs netbox updates.

I've filled out all red cells in the (original) bootstrap spreadsheet.

cr2-esams now has its power cables labeled:

PEM0: 20145 (to ps1 outlet 32)
PEM1: 20146 (to ps2 outlet 32)
PEM2: 20147 (to ps1 outlet 31)
PEM3: 20148 (to ps2 outlet 31)

cr3-esams now has its power cables labeled:

PEM0: 20149 (to ps1 outlet 36)
PEM1: 20150 (to ps2 outlet 36)
PEM2: 20151 (to ps1 outlet 35)
PEM3: 20152 (to ps2 outlet 35)

cr2-esams now has its power cables labeled:

PEM0: 20145 (to ps1 outlet 32)
PEM1: 20146 (to ps2 outlet 32)
PEM2: 20147 (to ps1 outlet 31)
PEM3: 20148 (to ps2 outlet 31)

netbox updated

cr3-esams now has its power cables labeled:

PEM0: 20149 (to ps1 outlet 36)
PEM1: 20150 (to ps2 outlet 36)
PEM2: 20151 (to ps1 outlet 35)
PEM3: 20152 (to ps2 outlet 35)

netbox updated

Power cords label information for servers in rack OE14

Serverps1ps2
lvs30052008020088
ganeti30012008120089
dns30012008220090
cp30502008320091
cp30512008420092
cp30522008520093
cp30532008620094
cp30542008720095

All SERVER power cords have been audited in this sheet: https://docs.google.com/spreadsheets/d/1RMb6lMCc94wUj6MgSm1yYdnAC3SUsZIRj8zHLtxRx4o/edit?usp=sharing

Missing labels on either end of the cord have been augmented. All should be labeled and documented now - just needs netbox updates.

Unfortunately, this doesn't include what port # on the PDU each server is plugged into, so we'll have to have ESAMS remote hands audit them. However, we can use what @Papaul and @mark have provided to double-check the work of the ESAMS technicians!

Please note that I've created a google sheet that lists off every single device in the racks, and their power cable mappings. I cannot link it here, as it is currently shared public. I'll be sharing the link directly with iron mountain support, so they can populate the sheet with the power cable mappings.

I've populated the sheet in advance with all server/network device names and all known info (we have most of the cable IDs, but only the ports for the routers.)

This work will ONLY take place during business hours for WMF, and not during the holiday break, so work will need to take place this week, or delay until AFTER the break.

I'm reviewing the work order with Willy now before submission.

Ok, request submitted. Iron mountain has a few steps, first is a request ID SCTASK0137107.

Next they'll convert my request into a different ticket # (for work order iirc) and send it to us.

Please note support went ahead and already did this, and updated me via task. I have the updated list, and will import into netbox later this week.

Updated into netbox, all cables are now tracked in netbox except possibly the spare switches (which were not covered in this task.) I'll make a lower priority task since spare switches are only there for spare, and not active use.