Page MenuHomePhabricator

Replace cache proxies: deployment-cache-(text|upload)08 (Bullseye deprecation)
Closed, ResolvedPublic

Description

Should be renamed to deployment-cp-(text|upload) per T280393. Traffic is in the process of migrating these hosts: T433998#12258671.

Event Timeline

deployment-cp-text09 and deployment-cp-upload09 are provisioned and ready for service, but I'm not sure how deployment-prep's DNS is set up to switch hosts. @Southparkfan are you aware of how to handle this?

Mentioned in SAL (#wikimedia-cloud) [2026-09-15T19:09:13Z] <Southparkfan> add deployment-cp-text09 and deployment-cp-upload09 to 'cache_hosts' hiera key - T436468

Hi @BCornwall, thank you for your help! I have added the servers to cache_hosts.

In order to switch to the new hosts, you'll need to re-allocate the floating IPs in Horizon. However, a migration seems to involve more work.

As far as I can see, these are the steps you'll need to take:

  1. Add the primary IPv4 and IPv6 addresses of the new cache proxies to wmf-config/reverse-proxy-labs.php (example)
  2. Re-allocate floating IPs via Horizon: 185.15.56.36 for the text host, 185.15.56.35 for the upload host
  3. Remove the IPv4 addresses of the old cache proxies from wmf-config/reverse-proxy-labs.php (example), remove the references in cache_hosts and cache::hosts (Project Puppet in Horizon), and remove the Puppet Prefix for both deployment-cache-text and deployment-cache-upload
  4. Decommission the old cache proxies

Please let me know how you would like to proceed: you can perform the switchover on your own, you can hand it over to me, we can do it together and, et cetera - up to you.

Change #1342025 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/mediawiki-config@master] [beta] Update wgCdnServersNoPurge for new cp hosts

https://gerrit.wikimedia.org/r/1342025

Thanks, @Southparkfan ! I went ahead and moved the floating IPs over. The patch is ready for review/merging. I figure things are working now and a little overlap between the steps is okay, but forgive me if it wasn't.

Change #1342025 merged by jenkins-bot:

[operations/mediawiki-config@master] [beta] Update wgCdnServersNoPurge for new cp hosts

https://gerrit.wikimedia.org/r/1342025

Yay, thanks for the help deploying it. Regarding tofu integration, I'm not seeing any existing states, though I'll admit I didn't look super hard. Is this something that can/should be tracked separately?

Mentioned in SAL (#wikimedia-cloud) [2026-09-17T16:24:02Z] <brett> delete deployment-cache, deployment-cache-text, and deployment-cache-upload prefixes - T436468

deployment-cache-(text|upload)08 have been shut down for a few days and things seem to be calm. I've deleted the instances and removed the deployment-cache, deployment-cache-text, and deployment-cache-upload prefixes.