Page MenuHomePhabricator

Use IPIP encapsulation on lvs<-->upload cluster
Closed, ResolvedPublic

Description

After a few months since ncredir was moved to IPIP encapsulation without major issues it's time for a big cluster :)

IPIP encapsulation enabled in:

  • eqiad
  • codfw
  • esams
  • ulsfo
  • eqsin
  • drmrs
  • magru

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
operations/dnsmaster+0 -2
operations/dnsmaster+2 -0
operations/puppetproduction+2 -14
operations/puppetproduction+2 -2
operations/dnsmaster+0 -2
operations/dnsmaster+2 -0
operations/puppetproduction+2 -0
operations/puppetproduction+2 -2
operations/dnsmaster+0 -2
operations/dnsmaster+2 -0
operations/puppetproduction+2 -0
operations/puppetproduction+4 -4
operations/dnsmaster+0 -2
operations/dnsmaster+2 -0
operations/puppetproduction+2 -0
operations/puppetproduction+2 -2
operations/dnsmaster+0 -2
operations/dnsmaster+2 -0
operations/puppetproduction+2 -0
operations/puppetproduction+2 -2
operations/dnsmaster+0 -2
operations/dnsmaster+2 -0
operations/puppetproduction+3 -0
operations/puppetproduction+2 -2
operations/alertsmaster+2 -2
operations/dnsmaster+2 -0
operations/puppetproduction+1 -0
operations/puppetproduction+2 -0
operations/puppetproduction+4 -2
operations/puppetproduction+24 -11
operations/puppetproduction+2 -0
operations/puppetproduction+6 -3
operations/dnsmaster+2 -0
operations/puppetproduction+0 -2
operations/puppetproduction+2 -0
operations/puppetproduction+0 -2
operations/puppetproduction+4 -0
operations/puppetproduction+9 -2
Show related patches Customize query in gerrit

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes

Change #1031944 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):

[operations/puppet@production] hiera: Enable IPIP on upload@ulsfo cp hosts

https://gerrit.wikimedia.org/r/1031944

Change #1031827 merged by Vgutierrez:

[operations/puppet@production] hiera: Enable IPIP encapsulation on upload@ulsfo

https://gerrit.wikimedia.org/r/1031827

Mentioned in SAL (#wikimedia-operations) [2024-05-15T14:57:40Z] <vgutierrez> re-enable puppet on A:lvs - T357257

Change #1031944 merged by Vgutierrez:

[operations/puppet@production] hiera: Enable IPIP on upload@ulsfo cp hosts

https://gerrit.wikimedia.org/r/1031944

Change #1031955 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):

[operations/puppet@production] hiera: disable rp_filter on upload@ulsfo

https://gerrit.wikimedia.org/r/1031955

Change #1031955 merged by Vgutierrez:

[operations/puppet@production] hiera: disable rp_filter on upload@ulsfo

https://gerrit.wikimedia.org/r/1031955

Mentioned in SAL (#wikimedia-operations) [2024-05-15T15:25:46Z] <vgutierrez> rolling restart of pybal on lvs4010 and lvs4009 - T357257

Mentioned in SAL (#wikimedia-operations) [2024-05-15T15:58:36Z] <vgutierrez> repool upload@ulsfo with IPIP encapsulation enabled - T357257

Change #1032483 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):

[operations/puppet@production] hiera: Enable IPIP on high-traffic2@eqsin

https://gerrit.wikimedia.org/r/1032483

Change #1032484 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):

[operations/puppet@production] hiera: Enable IPIP on upload@eqsin

https://gerrit.wikimedia.org/r/1032484

Change #1032488 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):

[operations/dns@master] depool upload@eqsin before enabling IPIP encapsulation

https://gerrit.wikimedia.org/r/1032488

Change #1030057 merged by Vgutierrez:

[operations/alerts@master] team-traffic: Add runbook link to LVSRealserverMSS alert

https://gerrit.wikimedia.org/r/1030057

Change #1032488 merged by Vgutierrez:

[operations/dns@master] depool upload@eqsin before enabling IPIP encapsulation

https://gerrit.wikimedia.org/r/1032488

Mentioned in SAL (#wikimedia-operations) [2024-05-20T13:17:08Z] <vgutierrez> depool upload@eqsin before enabling IPIP encapsulation - T357257

Change #1032483 merged by Vgutierrez:

[operations/puppet@production] hiera: Enable IPIP on high-traffic2@eqsin

https://gerrit.wikimedia.org/r/1032483

Change #1032484 merged by Vgutierrez:

[operations/puppet@production] hiera: Enable IPIP on upload@eqsin

https://gerrit.wikimedia.org/r/1032484

Mentioned in SAL (#wikimedia-operations) [2024-05-20T14:00:45Z] <vgutierrez> rolling restart of pybal on lvs5005 and lvs5006 - T357257

Change #1032820 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):

[operations/dns@master] Revert "depool upload@eqsin before enabling IPIP encapsulation"

https://gerrit.wikimedia.org/r/1032820

Change #1032820 merged by Vgutierrez:

[operations/dns@master] Revert "depool upload@eqsin before enabling IPIP encapsulation"

https://gerrit.wikimedia.org/r/1032820

Mentioned in SAL (#wikimedia-operations) [2024-05-20T14:12:51Z] <vgutierrez> repool upload@eqsin with IPIP encapsulation enabled - T357257

Change #1034090 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):

[operations/puppet@production] hiera: Enable IPIP on high-traffic2@codfw

https://gerrit.wikimedia.org/r/1034090

Change #1034091 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):

[operations/puppet@production] hiera: Enable IPIP on upload@codfw

https://gerrit.wikimedia.org/r/1034091

Change #1034092 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):

[operations/dns@master] depool upload@codfw before enabling IPIP encapsulation

https://gerrit.wikimedia.org/r/1034092

Change #1034092 merged by Vgutierrez:

[operations/dns@master] depool upload@codfw before enabling IPIP encapsulation

https://gerrit.wikimedia.org/r/1034092

Mentioned in SAL (#wikimedia-operations) [2024-05-20T15:05:24Z] <vgutierrez> depool upload@codfw before enabling IPIP encapsulation - T357257

Change #1034090 merged by Vgutierrez:

[operations/puppet@production] hiera: Enable IPIP on high-traffic2@codfw

https://gerrit.wikimedia.org/r/1034090

Change #1034091 merged by Vgutierrez:

[operations/puppet@production] hiera: Enable IPIP on upload@codfw

https://gerrit.wikimedia.org/r/1034091

Mentioned in SAL (#wikimedia-operations) [2024-05-20T15:30:05Z] <vgutierrez> rolling restart of pybal on lvs2014 and lvs2012 - T357257

Change #1032822 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):

[operations/dns@master] Revert "depool upload@codfw before enabling IPIP encapsulation"

https://gerrit.wikimedia.org/r/1032822

Change #1032822 merged by Vgutierrez:

[operations/dns@master] Revert "depool upload@codfw before enabling IPIP encapsulation"

https://gerrit.wikimedia.org/r/1032822

Mentioned in SAL (#wikimedia-operations) [2024-05-20T15:38:16Z] <vgutierrez> repool upload@codfw with IPIP encapsulation enabled - T357257

Change #1034898 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):

[operations/dns@master] depool upload@magru before enabling IPIP encapsulation

https://gerrit.wikimedia.org/r/1034898

Change #1034898 merged by Vgutierrez:

[operations/dns@master] depool upload@magru before enabling IPIP encapsulation

https://gerrit.wikimedia.org/r/1034898

Mentioned in SAL (#wikimedia-operations) [2024-05-22T12:18:38Z] <vgutierrez> depool upload@magru before enabling IPIP encapsulation - T357257

Change #1034899 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):

[operations/puppet@production] hiera: Enable IPIP on high-traffic2@magru

https://gerrit.wikimedia.org/r/1034899

Change #1034900 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):

[operations/puppet@production] hiera: Enable IPIP on upload@magru

https://gerrit.wikimedia.org/r/1034900

Change #1034899 merged by Vgutierrez:

[operations/puppet@production] hiera: Enable IPIP on high-traffic2@magru

https://gerrit.wikimedia.org/r/1034899

Change #1034900 merged by Vgutierrez:

[operations/puppet@production] hiera: Enable IPIP on upload@magru

https://gerrit.wikimedia.org/r/1034900

Change #1034877 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):

[operations/dns@master] Revert "depool upload@magru before enabling IPIP encapsulation"

https://gerrit.wikimedia.org/r/1034877

Change #1034877 merged by Vgutierrez:

[operations/dns@master] Revert "depool upload@magru before enabling IPIP encapsulation"

https://gerrit.wikimedia.org/r/1034877

Mentioned in SAL (#wikimedia-operations) [2024-05-22T12:50:18Z] <vgutierrez> repool upload@magru with IPIP encapsulation enabled - T357257

Change #1034908 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):

[operations/dns@master] depool upload@eqiad before enabling IPIP encapsulation

https://gerrit.wikimedia.org/r/1034908

Change #1034908 merged by Vgutierrez:

[operations/dns@master] depool upload@eqiad before enabling IPIP encapsulation

https://gerrit.wikimedia.org/r/1034908

Mentioned in SAL (#wikimedia-operations) [2024-05-22T13:00:44Z] <vgutierrez> depool upload@eqiad before enabling IPIP encapsulation - T357257

Change #1034909 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):

[operations/puppet@production] hiera: Enable IPIP on high-traffic2@eqiad

https://gerrit.wikimedia.org/r/1034909

Change #1034910 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):

[operations/puppet@production] hiera: Enable IPIP on upload@eqiad

https://gerrit.wikimedia.org/r/1034910

Change #1034909 merged by Vgutierrez:

[operations/puppet@production] hiera: Enable IPIP on high-traffic2@eqiad

https://gerrit.wikimedia.org/r/1034909

Change #1034910 merged by Vgutierrez:

[operations/puppet@production] hiera: Enable IPIP on upload@eqiad

https://gerrit.wikimedia.org/r/1034910

Mentioned in SAL (#wikimedia-operations) [2024-05-22T13:39:12Z] <vgutierrez> rolling restart of pybal on lvs1020 and lvs1018 - T357257

Change #1034880 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):

[operations/dns@master] Revert "depool upload@eqiad before enabling IPIP encapsulation"

https://gerrit.wikimedia.org/r/1034880

Change #1034880 merged by Vgutierrez:

[operations/dns@master] Revert "depool upload@eqiad before enabling IPIP encapsulation"

https://gerrit.wikimedia.org/r/1034880

Mentioned in SAL (#wikimedia-operations) [2024-05-22T13:53:14Z] <vgutierrez> repool upload@eqiad with IPIP encapsulation enabled - T357257

Change #1034947 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):

[operations/dns@master] Depool upload@drmrs before enabling IPIP encapsulation

https://gerrit.wikimedia.org/r/1034947

Change #1034948 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):

[operations/puppet@production] hiera: Enable IPIP on high-traffic2@drmrs

https://gerrit.wikimedia.org/r/1034948

Change #1034949 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):

[operations/puppet@production] hiera: Enable IPIP on upload@drmrs

https://gerrit.wikimedia.org/r/1034949

Change #1034947 merged by Vgutierrez:

[operations/dns@master] Depool upload@drmrs before enabling IPIP encapsulation

https://gerrit.wikimedia.org/r/1034947

Mentioned in SAL (#wikimedia-operations) [2024-05-22T14:43:10Z] <vgutierrez> depool upload@drmrs before enabling IPIP encapsulation - T357257

Change #1034948 merged by Vgutierrez:

[operations/puppet@production] hiera: Enable IPIP on high-traffic2@drmrs

https://gerrit.wikimedia.org/r/1034948

Change #1034949 merged by Vgutierrez:

[operations/puppet@production] hiera: Enable IPIP on upload@drmrs

https://gerrit.wikimedia.org/r/1034949

Mentioned in SAL (#wikimedia-operations) [2024-05-22T15:10:13Z] <vgutierrez> rolling restart of pybal on lvs6003 and lvs6002 - T357257

Change #1034885 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):

[operations/dns@master] Revert "Depool upload@drmrs before enabling IPIP encapsulation"

https://gerrit.wikimedia.org/r/1034885

Change #1034885 merged by Vgutierrez:

[operations/dns@master] Revert "Depool upload@drmrs before enabling IPIP encapsulation"

https://gerrit.wikimedia.org/r/1034885

Mentioned in SAL (#wikimedia-operations) [2024-05-22T15:16:54Z] <vgutierrez> repool upload@drmrs with IPIP encapsulation enabled - T357257

Change #1034968 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):

[operations/puppet@production] hiera: Enable IPIP on high-traffic2@esams

https://gerrit.wikimedia.org/r/1034968

Change #1034969 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):

[operations/puppet@production] hiera: Enable IPIP on esams@upload

https://gerrit.wikimedia.org/r/1034969

Change #1035373 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):

[operations/dns@master] depool upload@esams before enabling IPIP encapsulation

https://gerrit.wikimedia.org/r/1035373

Change #1035373 merged by Vgutierrez:

[operations/dns@master] depool upload@esams before enabling IPIP encapsulation

https://gerrit.wikimedia.org/r/1035373

Mentioned in SAL (#wikimedia-operations) [2024-05-23T11:52:32Z] <vgutierrez> depool upload@esams before enabling IPIP encapsulation - T357257

Change #1034968 merged by Vgutierrez:

[operations/puppet@production] hiera: Enable IPIP on high-traffic2@esams

https://gerrit.wikimedia.org/r/1034968

Change #1034969 merged by Vgutierrez:

[operations/puppet@production] hiera: Enable IPIP on esams@upload

https://gerrit.wikimedia.org/r/1034969

Mentioned in SAL (#wikimedia-operations) [2024-05-23T12:50:04Z] <vgutierrez> rolling restart of pybal on lvs3010 and lvs3009 - T357257

Change #1035390 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):

[operations/dns@master] Revert "depool upload@esams before enabling IPIP encapsulation"

https://gerrit.wikimedia.org/r/1035390

Change #1035390 merged by Vgutierrez:

[operations/dns@master] Revert "depool upload@esams before enabling IPIP encapsulation"

https://gerrit.wikimedia.org/r/1035390

Mentioned in SAL (#wikimedia-operations) [2024-05-23T12:57:28Z] <vgutierrez> repool upload@esams with IPIP encapsulation enabled - T357257

Vgutierrez updated the task description. (Show Details)