Page MenuHomePhabricator

eqiad: rack frack refresh equipment
Closed, ResolvedPublic

Description

Now that the equipment has been received (T165542), it needs to be racked.

I have a draft of current/transition/final rack elevation on:
https://docs.google.com/spreadsheets/d/1MOnChfjRT0mFQAEzFwWx-PAiS3KvHdswnzeVOHbN8eE/edit#gid=1155493243
(see the notes as well)

@Cmjohnson , could you let me know if that plan is possible and makes sens to you? (as the reality can be quite different from the racktables view). Especially in eqiad where the rack is quite full and leaves us with little margins.

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

For the naming, please use:
pfw3a-eqiad and pfw3b-eqiad for the firewalls, and
fasw-c1a-eqiad and fasw-c1b-eqiad for the switches

Then for the cabling, please follow:

pfw-deployment.png (718×942 px, 41 KB)

For the naming, please use:
pfw3a-eqiad and pfw3b-eqiad for the firewalls, and
fasw-c1a-eqiad and fasw-c1b-eqiad for the switches

Then for the cabling, please follow:

pfw-deployment(2).png (718×944 px, 44 KB)

EDIT: Updated diagram
EDIT2: Updated diagram

@ayounsi I will start racking the gear this week according to the google doc. Much of what I can remove are cable managers.

this has been slow progress...During the initial racking, all the screws were tightened too tight and now have to be drilled off.

As we struggled a bit in codfw to figure out which optics/links were working on the SRX/EX, here is what is currently there:
pfw3a/pfw3b

FPC 0            REV 11   711-053832   ACPK6163          FEB
  PIC 0                   BUILTIN      BUILTIN           12x1G-T-4x1G-SFP-4x10G
    Xcvr 16               NON-JNPR     AP41MSS           SFP+-10G-LR
    Xcvr 17               NON-JNPR     AS32FG8           SFP+-10G-LR
    Xcvr 19      REV 01   740-030076   APF134500145CY    SFP+-10G-CU1M

fasw:

FPC 0            REV 27   650-044932   PE3717130734      EX4300-48T
  PIC 1          REV 27   BUILTIN      BUILTIN           4x 40GE QSFP+
    Xcvr 0                NON-JNPR     100620667         UNKNOWN
    Xcvr 1                NON-JNPR     100620664         UNKNOWN
  PIC 2          REV 02   611-063980   MY3716460148      4x 1G/10G SFP/SFP+
    Xcvr 0                NON-JNPR     AS32FME           SFP+-10G-LR

All the switches and pfw's have been racked and racktables updated. both pfw3a and pfw3b have been connected to the scs console and msw switch. Both frasw1 and frasw2 have been connected to the scs and mgmt switch, frmsw has been connected to the msw

pfw3a -> cr1-xe-5/1/1 cable # 4026
pfw3b -> cr2-xe-5/1/1/ cable # 4027

pfw3a xe-0/0/17 -> frasw1 xe-0/2/0 cable #4001
pfw3b xe-0/0/17 -> frasw2 xe-0/2/0 cable # 4000

pfw3a xe-0/0/19 -> pfw3b xe-0/0/19

frasw1 qfsp port 0 -> frasw2 qfsp port 1
frasw2 qfsp port 0 -> frasw2 qfsp port 1

@Cmjohnson, thanks. Can you rename frasw1 and frasw2 to fasw-c1a-eqiad and fasw-c1b-eqiad ?
Also the console port to pfw3b doesn't seem to work.

Change 373923 had a related patch set uploaded (by Ayounsi; owner: Ayounsi):
[operations/dns@master] Add new eqiad frack IPs

https://gerrit.wikimedia.org/r/373923

Change 373923 merged by Ayounsi:
[operations/dns@master] Add new eqiad frack IPs

https://gerrit.wikimedia.org/r/373923

Updated names to fasw-c1a-eqiad and fasw-c1b-eqiad physically, racktables and scs.

Another change, please use xe-3/1/7 on cr1/2-eqiad instead of xe-5/1/1 (T149196)

pfw3a xe-0/0/17 -> frasw1 xe-0/2/0 cable #4001
pfw3b xe-0/0/17 -> frasw2 xe-0/2/0 cable # 4000

Those seem to currently land on fasw-c1a-eqiad:xe-0/2/2 and fasw-c1b-eqiad:xe-0/2/2
Would it be possible to move the SFP to the ports 0/2/0 ?

moved the fibers to cr1/2 to xe-3/1/7
swapped the cable with fiber connecting pfw-3a and pfw-3b (xe-1/0/17)
Moved connections pfw-3a/b and fasw-c1a/b to xe-0/2/0
Power cycled pfw-3b-eqiad

this has been completed.