Page MenuHomePhabricator
Create Task
Maniphest T403031

Eqiad: Replacement top-of-rack switch for rack C1
Open, MediumPublic
Actions

Description

The current plan to expand the fr-tech footprint in eqiad to two racks will involve moving the existing equipment out of rack C1 to E15 so that both of the fundraising racks are in row E.

Once complete this will make rack C1 free for regular production WMF servers, however we will need a top-of-rack switch for the rack to connect them to.

Switch

We thus need to order the following:

1 x Nokia 7220-IXR-D2L 48xSFP port switch (3HE21786AA)

It needs to have the "advanced tier" software license and same support options as those purchased under T368959. As discussed on our call yesterday I'm not sure how we want to handle this in terms of the budget assignment, it may make sense to make it part of the fr-tech project as it is related.

NOTE: This has been ordered as part of {T412711}

Cables

Additionally we will need two duplex single-mode fibre optic cables:

  • One from C1 to D1
  • One from C1 to D8

@Jclark-ctr @VRiley-WMF can you advise @RobH on the lenghts required for those?

Optics

Also we will need four of these optics to connect either end of those cables:

4 x 100G-BaseCWDM4

VLANS
Note for myself, once this is ready, we need to configure public1-c1-eqiad on that switch https://netbox.wikimedia.org/ipam/vlans/407/

Details

Related Changes in Gerrit:
SubjectAuthorRepoBranchLines +/-
lsw1-c1-eqiad: add definitions needed for new switchCathal Mooneyoperations/puppetproduction+30 -0
Add lsw1-c1-eqiad to devicesCathal Mooneyoperations/homer/publicmaster+8 -0
wmf-config: Add new subnet for eqiad rack C1 to reverse-proxy.phpCathal Mooneyoperations/mediawiki-configmaster+2 -0
Add INCLUDE statements for reverse entries in new eqiad c1 vlansCathal Mooneyoperations/dnsmaster+16 -0
Customize query in gerrit

Related Objects
Search...

Event Timeline

cmooney created this task.Aug 27 2025, 10:55 AM
cmooney triaged this task as Medium priority.
Restricted Application added a project: DC-Ops. · View Herald TranscriptAug 27 2025, 10:55 AM
cmooney added a parent task: T403035: Eqiad: Fr-tech expansion.Aug 27 2025, 11:09 AM
Jclark-ctr added a comment.Aug 27 2025, 1:03 PM

Based on the cabling for spine D1 (T401238) last week, I will need an 8m fiber. @VRiley-WMF, will you be able to update the length for D8 while cabling T401240?

Device ADevice A PortDevice BDevice B PortTypecableIDLength required
ssw1-d1-eqiadethernet-1/2lsw1-c1-eqiadethernet-1/56LC-LC SMF8m
ssw1-d8-eqiadethernet-1/3lsw1-c1-eqiadethernet-1/55LC-LC SMF
Jclark-ctr moved this task from Backlog to Procurement on the ops-eqiad board.Aug 27 2025, 5:59 PM
wiki_willy assigned this task to VRiley-WMF.Sep 2 2025, 8:34 PM
VRiley-WMF added a comment.Sep 15 2025, 6:16 PM
Device ADevice A PortDevice BDevice B PortTypecableIDLength required
ssw1-d1-eqiadethernet-1/2lsw1-c1-eqiadethernet-1/56LC-LC SMF8m
ssw1-d8-eqiadethernet-1/3lsw1-c1-eqiadethernet-1/55LC-LC SMF15m
VRiley-WMF closed this task as Resolved.Oct 14 2025, 8:04 PM
Jclark-ctr added a comment.Oct 14 2025, 10:55 PM

@RobH @vriley where we using this ticket as a placeholder for ordering replacement switch for c1? Unsure if this should be closed

Jclark-ctr reopened this task as Open.Oct 15 2025, 6:10 AM
Jclark-ctr removed VRiley-WMF as the assignee of this task.
cmooney updated the task description. (Show Details)Jan 20 2026, 4:14 PM
RobH added a comment.Jan 20 2026, 5:06 PM

Update from meeting:

  • This switch need was noted by Willy on the Nokia A/B T412711 order and is being ordered there.
  • This task can stay as the implementation/cabling task as its in the S1 space and has only technical info.
RobH added a parent task: Unknown Object (Task).Jan 20 2026, 5:06 PM
RobH assigned this task to VRiley-WMF.Jan 20 2026, 5:08 PM

@VRiley-WMF or @Jclark-ctr: With the switch being ordered on T412711, the only thing possibly pending order from the task description here are 4 * www.fs.com/products/71644.html.

Can you check if you have any of these optics on site and/or how many we need to order?

VRiley-WMF added a comment.Feb 3 2026, 10:53 AM

@RobH I was able to locate 2 that we have that are new in the box. We do have a few others that are loose on site.

Peachey88 updated the task description. (Show Details)Feb 3 2026, 11:04 AM
ayounsi updated the task description. (Show Details)Jun 8 2026, 11:53 AM
ayounsi added a parent task: T422043: Create public vlans in eqiad and codfw.
ayounsi subscribed.Jun 9 2026, 3:14 PM
cmooney removed a parent task: Unknown Object (Task).Thu, Oct 1, 8:27 AM
gerritbot added a comment.Thu, Oct 8, 2:21 PM

Change #1353239 had a related patch set uploaded (by Cathal Mooney; author: Cathal Mooney):

[operations/puppet@production] lsw1-c1-eqiad: add definitions needed for new switch

https://gerrit.wikimedia.org/r/1353239

gerritbot added a project: Patch-For-Review.Thu, Oct 8, 2:21 PM
gerritbot added a comment.Thu, Oct 8, 2:37 PM

Change #1353248 had a related patch set uploaded (by Cathal Mooney; author: Cathal Mooney):

[operations/dns@master] Add INCLUDE statements for IPv6 reverse DNS new eqiad c1 vlans

https://gerrit.wikimedia.org/r/1353248

gerritbot added a comment.Thu, Oct 8, 2:50 PM

Change #1353248 merged by Cathal Mooney:

[operations/dns@master] Add INCLUDE statements for reverse entries in new eqiad c1 vlans

https://gerrit.wikimedia.org/r/1353248

gerritbot added a comment.Thu, Oct 8, 4:27 PM

Change #1353292 had a related patch set uploaded (by Cathal Mooney; author: Cathal Mooney):

[operations/homer/public@master] Add lsw1-c1-eqiad to devices

https://gerrit.wikimedia.org/r/1353292

gerritbot added a comment.Thu, Oct 8, 5:07 PM

Change #1353307 had a related patch set uploaded (by Cathal Mooney; author: Cathal Mooney):

[operations/mediawiki-config@master] wmf-config: Add new subnet for eqiad rack C1 to reverse-proxy.php

https://gerrit.wikimedia.org/r/1353307

cmooney added a subtask: T440631: lsw1-c1-eqiad: mgmt0 traffic not working after upgrade to SR-Linux 26.7.3.Thu, Oct 8, 5:27 PM
gerritbot added a comment.Thu, Oct 8, 9:17 PM

Change #1353292 merged by jenkins-bot:

[operations/homer/public@master] Add lsw1-c1-eqiad to devices

https://gerrit.wikimedia.org/r/1353292

gerritbot added a comment.Thu, Oct 15, 11:03 AM

Change #1353239 merged by Cathal Mooney:

[operations/puppet@production] lsw1-c1-eqiad: add definitions needed for new switch

https://gerrit.wikimedia.org/r/1353239

cmooney added a comment.Thu, Oct 15, 12:41 PM

I think everything should be in place to rack servers in C1 and connect to the new switch.

@Jclark-ctr when we have the first one in place let's try a reimage and confirm things work ok and we can sign it off as working.

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits