Page MenuHomePhabricator

LVS switch move

Authored By
cmooney
May 25 2023, 1:20 PM
Size
927 B
Referenced Files
None
Subscribers
None

LVS switch move

1. cumin1001 - disable pybal on lvs
sudo cumin 'lvs1019*' 'disable-puppet "decomm" && systemctl stop pybal.service'
2. deploy1002.eqiad.wmnet - lock deploys
scap lock --all "LVS maintenance in eqiad, blocking deploys T322937"
3. Wait for all existing connections to drop off on lvs1019 & roughly equivalent to be present on 1020
https://grafana.wikimedia.org/d/000000343/load-balancers-lvs?orgId=1&from=now-1h&to=now&viewPanel=4
4. Get John to do move physically
5. Check all looks ok in terms of reachability/MAC addresses/pings etc.
ip neigh show etc, ping
6. cumin1001 - re-enable pybal
sudo cumin 'lvs1019*' 'enable-puppet "UNSURE" && systemctl start pybal.service'
7. Check BGP from pybal looks ok, check connections on grafana graph start showing again for lvs
https://grafana.wikimedia.org/d/000000343/load-balancers-lvs?orgId=1&from=now-1h&to=now&viewPanel=4
8. deploy1002.eqiad.wmnet - unlock deploys
hit enter

File Metadata

Mime Type
text/plain; charset=utf-8
Storage Engine
blob
Storage Format
Raw Data
Storage Handle
10850881
Default Alt Text
LVS switch move (927 B)

Event Timeline