Page MenuHomePhabricator

Add linecard diversity to the router-to-router interconnect in codfw
Open, MediumPublic

Description

cr1-codfw and cr2-codfw connect to each other via an aggregate of two 10G links, but each router has only one FPC linecard, and said linecard has both the cross-router links, as well as the peering/transit links, and the cross-cluster transport links.

This means that, if the FPC linecard fails on the current VRRP master, all codfw hosts will lose connectivity to the outside world indefinitely, until someone intervenes.

Possible solutions include adding a special router-to-router vlan to the row switches, or just buying more linecards and using them for the router-to-router link.

Event Timeline

CDanis created this task.Mar 25 2020, 7:48 PM
Restricted Application added a project: Operations. · View Herald TranscriptMar 25 2020, 7:48 PM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript

As data point, FPC0 got purchased on 2014 and FPC5 in 2013 so it's also time to replace them.

MoritzMuehlenhoff triaged this task as Medium priority.Apr 6 2020, 12:53 PM