With all the Ganeti clusters now set up in the edge sites and the forthcoming deprecation of jessie on the existing install* servers we should define the plans for install* servers in the edge sites:
The existing Ganeti instances (install1002/install2002) provide the following services:
- DHCP
- TFTP / d-i preseeding configuration
- Web proxy
- the apt.wikimedia.org repository (which is synchronised via rsync to between eqiad/codfw)
From my PoV when moving to buster and into the edge sites we should split the apt.wikimedia.org repository to a separate role/Ganeti instance (like repo1001.wikimedia.org/repo2001.wikimedia.org) and have install1003/install2003/install3001/install4001/install5001 which only provide DHCP/TFTP/d-i/proxy.
I don't think there's a good case for replicating apt.wikimedia.org repository to the edge sites; it's only a handful of servers and the majority of installation traffic originates from our main Debian mirror (sodium) in eqiad anyway. Plus, all our codfw servers already install from the repository provided by install1002 via the apt.wikimedia.org CNAME.