Page MenuHomePhabricator
Create Task
Maniphest T364095

Codfw row C/D switch installation & configuration
Open, MediumPublic
Actions

Description

Master task to track the installation and configuration of new Spine and Leaf switch devices for codfw rows C and D. When complete we can begin the process of migrating server uplinks from old to new switches.

Details

SubjectRepoBranchLines +/-
Change EVPN BGP YAML to group into clusters and add codfw switchesoperations/homer/publicmaster+210 -40
Add includes for netbox-generated PTRs for new spine-core linksoperations/dnsmaster+8 -0
Add reverse DNS entries for new codfw private subnetsoperations/dnsmaster+130 -55
Customize query in gerrit

Related Objects
Search...

Event Timeline

cmooney triaged this task as Medium priority.May 3 2024, 10:16 AM
cmooney created this task.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 3 2024, 10:16 AM
cmooney added subtasks: Unknown Object (Task), T360789: codfw row C/D upgrade racking task.May 3 2024, 10:16 AM
cmooney added a subtask: T364097: Decom lsw1-a1-codfw.May 3 2024, 10:25 AM
Papaul moved this task from Backlog to Codfw Switch migration on the ops-codfw board.May 3 2024, 4:23 PM
Papaul closed subtask T364097: Decom lsw1-a1-codfw as Resolved.May 8 2024, 12:36 AM
gerritbot added a comment.May 10 2024, 1:41 PM

Change #1030115 had a related patch set uploaded (by Cathal Mooney; author: Cathal Mooney):

[operations/dns@master] Add reverse DNS entries for new codfw private subnets

https://gerrit.wikimedia.org/r/1030115

gerritbot added a project: Patch-For-Review.May 10 2024, 1:41 PM
gerritbot added a comment.May 10 2024, 4:17 PM

Change #1030115 merged by Cathal Mooney:

[operations/dns@master] Add reverse DNS entries for new codfw private subnets

https://gerrit.wikimedia.org/r/1030115

Maintenance_bot removed a project: Patch-For-Review.May 10 2024, 4:31 PM
gerritbot added a comment.May 13 2024, 5:21 PM

Change #1031031 had a related patch set uploaded (by Cathal Mooney; author: Cathal Mooney):

[operations/dns@master] Add includes for netbox-generated PTRs for new spine-core links

https://gerrit.wikimedia.org/r/1031031

gerritbot added a project: Patch-For-Review.May 13 2024, 5:21 PM
gerritbot added a comment.May 13 2024, 5:41 PM

Change #1031031 merged by Cathal Mooney:

[operations/dns@master] Add includes for netbox-generated PTRs for new spine-core links

https://gerrit.wikimedia.org/r/1031031

Maintenance_bot removed a project: Patch-For-Review.May 13 2024, 6:31 PM
cmooney added a subtask: T365169: Switch BGP (EVPN) topology between rows/spines at core sites.May 16 2024, 3:03 PM
gerritbot added a comment.Wed, May 22, 11:30 AM

Change #1034889 had a related patch set uploaded (by Cathal Mooney; author: Cathal Mooney):

[operations/homer/public@master] Change EVPN BGP YAML to group into clusters and add codfw switches

https://gerrit.wikimedia.org/r/1034889

Restricted Application added a project: DC-Ops. · View Herald TranscriptWed, May 22, 11:30 AM
gerritbot added a project: Patch-For-Review.Wed, May 22, 11:30 AM
gerritbot added a comment.Fri, Jun 7, 2:35 PM

Change #1034889 merged by jenkins-bot:

[operations/homer/public@master] Change EVPN BGP YAML to group into clusters and add codfw switches

https://gerrit.wikimedia.org/r/1034889

Stashbot added a comment.Fri, Jun 7, 2:55 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-07T14:55:05Z] <topranks> enabling port et-1/0/2 for 100G mode on cr2-codfw T364095

Maintenance_bot removed a project: Patch-For-Review.Fri, Jun 7, 3:31 PM
ops-monitoring-bot added a comment.Fri, Jun 7, 5:12 PM

Icinga downtime and Alertmanager silence (ID=4f6d5735-139a-4c58-be67-6179e7c2ab71) set by cmooney@cumin1002 for 1:00:00 on 3 host(s) and their services with reason: bouncing fpc 1 pic 0 on cr2-codfw

cr2-codfw,cr2-codfw IPv6,re0.cr2-codfw.mgmt
cmooney added a subscriber: Jhancock.wm.Fri, Jun 7, 5:14 PM
This comment was removed by cmooney.
Stashbot added a comment.Fri, Jun 7, 5:23 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-07T17:23:54Z] <topranks> disable IP transit to Lumen AS3356 from cr2-eqiad to allow line card reset T364095

Stashbot added a comment.Fri, Jun 7, 5:24 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-07T17:24:54Z] <topranks> re-route traffic from cr2-eqord away from circuit to cr2-codfw to allow for line card reset T364095

ops-monitoring-bot added a comment.Fri, Jun 7, 5:28 PM

Icinga downtime and Alertmanager silence (ID=ef0faea2-9357-469a-a5c3-aa5b1c50c748) set by cmooney@cumin1002 for 0:20:00 on 3 host(s) and their services with reason: bouncing fpc 1 pic 0 on cr2-codfw

cloudsw1-b1-codfw.mgmt,cr2-eqord,pfw3-codfw
Stashbot added a comment.Fri, Jun 7, 5:31 PM

Mentioned in SAL (#wikimedia-operations) [2024-06-07T17:31:33Z] <topranks> resetting line card 1/0 on cr2-codfw to enable new 100G link to ssw1-d8-codfw T364095

cmooney added a subtask: T366941: Move asw-c-codfw and asw-d-codfw CR uplinks to Spine switches.Fri, Jun 7, 7:50 PM
cmooney closed subtask T365169: Switch BGP (EVPN) topology between rows/spines at core sites as Resolved.
cmooney added a subtask: T367512: Get test host connected to codfw row c/d lsw's.Fri, Jun 14, 1:22 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL