Page MenuHomePhabricator

migrate all high-traffic1 and high-traffic2 services to maglev
Closed, ResolvedPublic

Description

In order to close the gap between the current LVS based on IPVS and the new one based on katran we need to migrate all the remaining services using the wrr scheduler to maglev (mh):

  • high-traffic1:
    • ncredir
  • high-traffic2:
    • ldap-ro
    • cloudelastic

Event Timeline

Vgutierrez triaged this task as Medium priority.Jun 25 2024, 3:39 PM

Change #1053332 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):

[operations/puppet@production] hiera: Switch nredir to maglev

https://gerrit.wikimedia.org/r/1053332

Change #1053332 merged by Vgutierrez:

[operations/puppet@production] hiera: Switch ncredir to maglev

https://gerrit.wikimedia.org/r/1053332

Change #1053333 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] hiera: Switch ldap-ro to maglev

https://gerrit.wikimedia.org/r/1053333

Change #1053334 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] hiera: Switch cloudelastic to maglev

https://gerrit.wikimedia.org/r/1053334

Mentioned in SAL (#wikimedia-operations) [2024-07-10T15:14:56Z] <vgutierrez> rolling restart of secondary LVSs to switch ncredir to maglev - T368083

Mentioned in SAL (#wikimedia-operations) [2024-07-10T15:16:34Z] <vgutierrez@cumin1002> START - Cookbook sre.loadbalancer.restart-pybal rolling-restart of pybal on A:lvs-secondary (T368083)

Mentioned in SAL (#wikimedia-operations) [2024-07-10T15:19:35Z] <vgutierrez@cumin1002> END (PASS) - Cookbook sre.loadbalancer.restart-pybal (exit_code=0) rolling-restart of pybal on A:lvs-secondary (T368083)

Mentioned in SAL (#wikimedia-operations) [2024-07-10T15:24:22Z] <vgutierrez> rolling restart of high-traffic1 LVSs to switch ncredir to maglev - T368083

Mentioned in SAL (#wikimedia-operations) [2024-07-10T15:24:32Z] <vgutierrez@cumin1002> START - Cookbook sre.loadbalancer.restart-pybal rolling-restart of pybal on A:lvs-high-traffic1 (T368083)

Mentioned in SAL (#wikimedia-operations) [2024-07-10T15:27:10Z] <vgutierrez@cumin1002> END (PASS) - Cookbook sre.loadbalancer.restart-pybal (exit_code=0) rolling-restart of pybal on A:lvs-high-traffic1 (T368083)

Change #1053333 merged by BCornwall:

[operations/puppet@production] hiera: Switch ldap-ro to maglev

https://gerrit.wikimedia.org/r/1053333

Change #1053334 merged by BCornwall:

[operations/puppet@production] hiera: Switch cloudelastic to maglev

https://gerrit.wikimedia.org/r/1053334

Mentioned in SAL (#wikimedia-operations) [2024-07-10T15:48:51Z] <brett@cumin2002> START - Cookbook sre.loadbalancer.restart-pybal rolling-restart of pybal on A:lvs-high-traffic1-eqsin (T368083)

Mentioned in SAL (#wikimedia-operations) [2024-07-10T15:49:25Z] <brett@cumin2002> END (PASS) - Cookbook sre.loadbalancer.restart-pybal (exit_code=0) rolling-restart of pybal on A:lvs-high-traffic1-eqsin (T368083)

Mentioned in SAL (#wikimedia-operations) [2024-07-10T15:54:58Z] <brett@cumin2002> START - Cookbook sre.loadbalancer.restart-pybal rolling-restart of pybal on A:lvs-high-traffic2-eqsin (T368083)

Mentioned in SAL (#wikimedia-operations) [2024-07-10T15:55:31Z] <brett@cumin2002> END (PASS) - Cookbook sre.loadbalancer.restart-pybal (exit_code=0) rolling-restart of pybal on A:lvs-high-traffic2-eqsin (T368083)

Mentioned in SAL (#wikimedia-operations) [2024-07-10T16:00:00Z] <brett@cumin2002> START - Cookbook sre.loadbalancer.restart-pybal rolling-restart of pybal on A:lvs-high-traffic1 (T368083)

Mentioned in SAL (#wikimedia-operations) [2024-07-10T16:02:58Z] <brett@cumin2002> END (PASS) - Cookbook sre.loadbalancer.restart-pybal (exit_code=0) rolling-restart of pybal on A:lvs-high-traffic1 (T368083)

Mentioned in SAL (#wikimedia-operations) [2024-07-10T16:05:20Z] <brett@cumin2002> START - Cookbook sre.loadbalancer.restart-pybal rolling-restart of pybal on A:lvs-high-traffic2 (T368083)

Mentioned in SAL (#wikimedia-operations) [2024-07-10T16:08:17Z] <brett@cumin2002> END (PASS) - Cookbook sre.loadbalancer.restart-pybal (exit_code=0) rolling-restart of pybal on A:lvs-high-traffic2 (T368083)

BCornwall updated the task description. (Show Details)

Mentioned in SAL (#wikimedia-operations) [2024-07-10T16:11:48Z] <brett@cumin2002> START - Cookbook sre.loadbalancer.restart-pybal rolling-restart of pybal on A:lvs-secondary (T368083)

Mentioned in SAL (#wikimedia-operations) [2024-07-10T16:14:43Z] <brett@cumin2002> END (PASS) - Cookbook sre.loadbalancer.restart-pybal (exit_code=0) rolling-restart of pybal on A:lvs-secondary (T368083)