After a few months since ncredir was moved to IPIP encapsulation without major issues it's time for a big cluster :)
IPIP encapsulation enabled in:
- eqiad
- codfw
- esams
- ulsfo
- eqsin
- drmrs
- magru
After a few months since ncredir was moved to IPIP encapsulation without major issues it's time for a big cluster :)
IPIP encapsulation enabled in:
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | Vgutierrez | T332027 Replace current L4LB with with Katran-based alternative | |||
| Resolved | Vgutierrez | T357257 Use IPIP encapsulation on lvs<-->upload cluster | |||
| Resolved | Vgutierrez | T357258 Release tcp-mss-clamper for bullseye | |||
| Resolved | Vgutierrez | T365101 MSS clamper check triggers false positives | |||
| Resolved | Vgutierrez | T365354 rp_filter should be disabled on puppet apply |
Change #1031944 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):
[operations/puppet@production] hiera: Enable IPIP on upload@ulsfo cp hosts
Mentioned in SAL (#wikimedia-operations) [2024-05-15T14:51:41Z] <vgutierrez> disable puppet on A:lvs before merging https://gerrit.wikimedia.org/r/c/operations/puppet/+/1031827- T357257
Change #1031827 merged by Vgutierrez:
[operations/puppet@production] hiera: Enable IPIP encapsulation on upload@ulsfo
Mentioned in SAL (#wikimedia-operations) [2024-05-15T14:57:40Z] <vgutierrez> re-enable puppet on A:lvs - T357257
Change #1031944 merged by Vgutierrez:
[operations/puppet@production] hiera: Enable IPIP on upload@ulsfo cp hosts
Change #1031955 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):
[operations/puppet@production] hiera: disable rp_filter on upload@ulsfo
Change #1031955 merged by Vgutierrez:
[operations/puppet@production] hiera: disable rp_filter on upload@ulsfo
Mentioned in SAL (#wikimedia-operations) [2024-05-15T15:25:46Z] <vgutierrez> rolling restart of pybal on lvs4010 and lvs4009 - T357257
Mentioned in SAL (#wikimedia-operations) [2024-05-15T15:58:36Z] <vgutierrez> repool upload@ulsfo with IPIP encapsulation enabled - T357257
Change #1032483 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):
[operations/puppet@production] hiera: Enable IPIP on high-traffic2@eqsin
Change #1032484 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):
[operations/puppet@production] hiera: Enable IPIP on upload@eqsin
Change #1032488 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):
[operations/dns@master] depool upload@eqsin before enabling IPIP encapsulation
Change #1030057 merged by Vgutierrez:
[operations/alerts@master] team-traffic: Add runbook link to LVSRealserverMSS alert
Change #1032488 merged by Vgutierrez:
[operations/dns@master] depool upload@eqsin before enabling IPIP encapsulation
Mentioned in SAL (#wikimedia-operations) [2024-05-20T13:17:08Z] <vgutierrez> depool upload@eqsin before enabling IPIP encapsulation - T357257
Change #1032483 merged by Vgutierrez:
[operations/puppet@production] hiera: Enable IPIP on high-traffic2@eqsin
Change #1032484 merged by Vgutierrez:
[operations/puppet@production] hiera: Enable IPIP on upload@eqsin
Mentioned in SAL (#wikimedia-operations) [2024-05-20T14:00:45Z] <vgutierrez> rolling restart of pybal on lvs5005 and lvs5006 - T357257
Change #1032820 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):
[operations/dns@master] Revert "depool upload@eqsin before enabling IPIP encapsulation"
Change #1032820 merged by Vgutierrez:
[operations/dns@master] Revert "depool upload@eqsin before enabling IPIP encapsulation"
Mentioned in SAL (#wikimedia-operations) [2024-05-20T14:12:51Z] <vgutierrez> repool upload@eqsin with IPIP encapsulation enabled - T357257
Change #1034090 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):
[operations/puppet@production] hiera: Enable IPIP on high-traffic2@codfw
Change #1034091 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):
[operations/puppet@production] hiera: Enable IPIP on upload@codfw
Change #1034092 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):
[operations/dns@master] depool upload@codfw before enabling IPIP encapsulation
Change #1034092 merged by Vgutierrez:
[operations/dns@master] depool upload@codfw before enabling IPIP encapsulation
Mentioned in SAL (#wikimedia-operations) [2024-05-20T15:05:24Z] <vgutierrez> depool upload@codfw before enabling IPIP encapsulation - T357257
Change #1034090 merged by Vgutierrez:
[operations/puppet@production] hiera: Enable IPIP on high-traffic2@codfw
Change #1034091 merged by Vgutierrez:
[operations/puppet@production] hiera: Enable IPIP on upload@codfw
Mentioned in SAL (#wikimedia-operations) [2024-05-20T15:30:05Z] <vgutierrez> rolling restart of pybal on lvs2014 and lvs2012 - T357257
Change #1032822 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):
[operations/dns@master] Revert "depool upload@codfw before enabling IPIP encapsulation"
Change #1032822 merged by Vgutierrez:
[operations/dns@master] Revert "depool upload@codfw before enabling IPIP encapsulation"
Mentioned in SAL (#wikimedia-operations) [2024-05-20T15:38:16Z] <vgutierrez> repool upload@codfw with IPIP encapsulation enabled - T357257
Change #1034898 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):
[operations/dns@master] depool upload@magru before enabling IPIP encapsulation
Change #1034898 merged by Vgutierrez:
[operations/dns@master] depool upload@magru before enabling IPIP encapsulation
Mentioned in SAL (#wikimedia-operations) [2024-05-22T12:18:38Z] <vgutierrez> depool upload@magru before enabling IPIP encapsulation - T357257
Change #1034899 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):
[operations/puppet@production] hiera: Enable IPIP on high-traffic2@magru
Change #1034900 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):
[operations/puppet@production] hiera: Enable IPIP on upload@magru
Change #1034899 merged by Vgutierrez:
[operations/puppet@production] hiera: Enable IPIP on high-traffic2@magru
Change #1034900 merged by Vgutierrez:
[operations/puppet@production] hiera: Enable IPIP on upload@magru
Change #1034877 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):
[operations/dns@master] Revert "depool upload@magru before enabling IPIP encapsulation"
Change #1034877 merged by Vgutierrez:
[operations/dns@master] Revert "depool upload@magru before enabling IPIP encapsulation"
Mentioned in SAL (#wikimedia-operations) [2024-05-22T12:50:18Z] <vgutierrez> repool upload@magru with IPIP encapsulation enabled - T357257
Change #1034908 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):
[operations/dns@master] depool upload@eqiad before enabling IPIP encapsulation
Change #1034908 merged by Vgutierrez:
[operations/dns@master] depool upload@eqiad before enabling IPIP encapsulation
Mentioned in SAL (#wikimedia-operations) [2024-05-22T13:00:44Z] <vgutierrez> depool upload@eqiad before enabling IPIP encapsulation - T357257
Change #1034909 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):
[operations/puppet@production] hiera: Enable IPIP on high-traffic2@eqiad
Change #1034910 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):
[operations/puppet@production] hiera: Enable IPIP on upload@eqiad
Change #1034909 merged by Vgutierrez:
[operations/puppet@production] hiera: Enable IPIP on high-traffic2@eqiad
Change #1034910 merged by Vgutierrez:
[operations/puppet@production] hiera: Enable IPIP on upload@eqiad
Mentioned in SAL (#wikimedia-operations) [2024-05-22T13:39:12Z] <vgutierrez> rolling restart of pybal on lvs1020 and lvs1018 - T357257
Change #1034880 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):
[operations/dns@master] Revert "depool upload@eqiad before enabling IPIP encapsulation"
Change #1034880 merged by Vgutierrez:
[operations/dns@master] Revert "depool upload@eqiad before enabling IPIP encapsulation"
Mentioned in SAL (#wikimedia-operations) [2024-05-22T13:53:14Z] <vgutierrez> repool upload@eqiad with IPIP encapsulation enabled - T357257
Change #1034947 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):
[operations/dns@master] Depool upload@drmrs before enabling IPIP encapsulation
Change #1034948 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):
[operations/puppet@production] hiera: Enable IPIP on high-traffic2@drmrs
Change #1034949 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):
[operations/puppet@production] hiera: Enable IPIP on upload@drmrs
Change #1034947 merged by Vgutierrez:
[operations/dns@master] Depool upload@drmrs before enabling IPIP encapsulation
Mentioned in SAL (#wikimedia-operations) [2024-05-22T14:43:10Z] <vgutierrez> depool upload@drmrs before enabling IPIP encapsulation - T357257
Change #1034948 merged by Vgutierrez:
[operations/puppet@production] hiera: Enable IPIP on high-traffic2@drmrs
Change #1034949 merged by Vgutierrez:
[operations/puppet@production] hiera: Enable IPIP on upload@drmrs
Mentioned in SAL (#wikimedia-operations) [2024-05-22T15:10:13Z] <vgutierrez> rolling restart of pybal on lvs6003 and lvs6002 - T357257
Change #1034885 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):
[operations/dns@master] Revert "Depool upload@drmrs before enabling IPIP encapsulation"
Change #1034885 merged by Vgutierrez:
[operations/dns@master] Revert "Depool upload@drmrs before enabling IPIP encapsulation"
Mentioned in SAL (#wikimedia-operations) [2024-05-22T15:16:54Z] <vgutierrez> repool upload@drmrs with IPIP encapsulation enabled - T357257
Change #1034968 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):
[operations/puppet@production] hiera: Enable IPIP on high-traffic2@esams
Change #1034969 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):
[operations/puppet@production] hiera: Enable IPIP on esams@upload
Change #1035373 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):
[operations/dns@master] depool upload@esams before enabling IPIP encapsulation
Change #1035373 merged by Vgutierrez:
[operations/dns@master] depool upload@esams before enabling IPIP encapsulation
Mentioned in SAL (#wikimedia-operations) [2024-05-23T11:52:32Z] <vgutierrez> depool upload@esams before enabling IPIP encapsulation - T357257
Change #1034968 merged by Vgutierrez:
[operations/puppet@production] hiera: Enable IPIP on high-traffic2@esams
Change #1034969 merged by Vgutierrez:
[operations/puppet@production] hiera: Enable IPIP on esams@upload
Mentioned in SAL (#wikimedia-operations) [2024-05-23T12:50:04Z] <vgutierrez> rolling restart of pybal on lvs3010 and lvs3009 - T357257
Change #1035390 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):
[operations/dns@master] Revert "depool upload@esams before enabling IPIP encapsulation"
Change #1035390 merged by Vgutierrez:
[operations/dns@master] Revert "depool upload@esams before enabling IPIP encapsulation"
Mentioned in SAL (#wikimedia-operations) [2024-05-23T12:57:28Z] <vgutierrez> repool upload@esams with IPIP encapsulation enabled - T357257