Convert misc varnish cluster from 1layer config to 2layer config. This removes the last of our 1layer-style clusters for standardization, makes it possible to expand the misc cluster into the cache pops in a normal way, and cleans up a few things related to other coming refactoring work...
Description
Details
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | • ema | T199720 Deploy initial ATS test clusters in core DCs | |||
| Resolved | • ema | T96853 Evaluate Apache Traffic Server | |||
| Declined | BBlack | T96851 Evaluate limited caching inside nginx | |||
| Restricted Task | |||||
| Resolved | BBlack | T96847 Refactor varnish puppet config | |||
| Declined | BBlack | T119396 Create globally-unique varnish cache cluster port/instancename mappings | |||
| Duplicate | None | T101339 Expand misc cluster into cache PoPs | |||
| Resolved | BBlack | T119394 Convert misc cluster to 2-layer |
Event Timeline
Change 255108 had a related patch set uploaded (by BBlack):
misc-cluster 2layer refactor, step 1/3
Change 255109 had a related patch set uploaded (by BBlack):
misc-cluster 2layer refactor, step 2/3
Change 255110 had a related patch set uploaded (by BBlack):
misc-cluster 2layer refactor, step 3/3
The misc cluster is now in a 2-layer multi-DC configuration (including ipsec), but with a few missing pieces to go for full functionality:
- Defining dynamic_directors stuff for depooling varnish backends (right now it's static)
- Setting up new IPs, GeoDNS, and LVS stuff to actually route users to the other datacenters for termination
Change 255375 had a related patch set uploaded (by BBlack):
cache_misc - Add full set of services to conftool data
Change 255376 had a related patch set uploaded (by BBlack):
cache_misc - define global IPs in LVS config data
Change 255377 had a related patch set uploaded (by BBlack):
cache_misc - set up LVS services at all DCs
Change 255378 had a related patch set uploaded (by BBlack):
cache_misc - switch to conftool dynamic directors
Change 255375 merged by BBlack:
cache_misc - Add full set of services to conftool data
Change 255383 had a related patch set uploaded (by BBlack):
cache_misc: add LVS service IPs to balancers themselves
Change 255383 merged by BBlack:
cache_misc: add LVS service IPs to balancers themselves
Change 255384 had a related patch set uploaded (by BBlack):
cache_misc: fix various icinga monitoring
Ok at this point everything is ready and configured correctly, except the final switch hasn't been flipped to send users to the geographic endpoints, which is: https://gerrit.wikimedia.org/r/#/c/255331/
Change 256704 had a related patch set uploaded (by BBlack):
cache_misc: move pass-blocks to layer-common code