Our Phabricator servers are getting old and will be routinely replaced.
T279176 is hardware refresh for phab1001
T280540 is to rack phab1002 (eqiad)
T279177 is hardware refresh for phab2001
T280544 is to rack phab2002 (codfw)
New hosts have been added to "insetup" role in https://gerrit.wikimedia.org/r/c/operations/puppet/+/681197 and will get DHCP and OS install
in the tasks linked above.
Then they will be handed over to serviceops to move into production.
---
migration plan to switch from phab1001 to phab1004 in production:
- announce downtime window of 30 min (November 21, 2022, 2pm PST, 10pm GMT, 2200 UTC)
- stop Phabricator and everything on phab1001 (kill PHP processes, make sure it's dead)
- merge puppet change in hieradata/common.yaml (https://gerrit.wikimedia.org/r/c/operations/puppet/+/858397)
- run puppet on phab1004, see it change database config to use m3-master and port 3306 (instead of m3-slave and 3323) in the file /etc/phabricator/config.yaml
- test phab web UI on phab1004 somehow before DNS is switched (ssh tunnel, foxy proxy)
- if it looks good, merge DNS change for both discovery and SPF record (https://gerrit.wikimedia.org/r/c/operations/dns/+/858409), otherwise revert
topic branch: https://gerrit.wikimedia.org/r/q/topic:phab_migration