We should set up a duplicate of Holmium with some services available to switch on if needed and with some services provided as live secondaries:
Live secondaries:
Off but available for emergencies:
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | yuvipanda | T105720 Labs team reliability goal for Q1 2015/16 | |||
| Resolved | Andrew | T105723 Eliminate SPOFs in Labs infrastructure | |||
| Resolved | Andrew | T106142 holmium is a spof | |||
| Resolved | RobH | T106147 New server: labservices1001 | |||
| Resolved | jcrespo | T114159 New db grants for labservices1001 |
Change 242187 had a related patch set uploaded (by Andrew Bogott):
Add labservices1001 as a holmium spare.
labservices1001 is up and serving dns. The remaining step is to add it as a secondary nameserver to labs instances.
Change 242567 had a related patch set uploaded (by Andrew Bogott):
Add labs-recursor1 as a secondary nameserver for labs instances.
Change 242567 merged by Andrew Bogott:
Add labs-recursor1 as a secondary nameserver for labs instances.
labservices1001 is now the secondary nameserver for labs instances. Nothing hits pdns auth directly, but that server is also live.
At some point holmium should now be renamed to labservices1002, and the naming rearranged to make 1001 the primary rather than the secondary. In the meantime, though, holmium is no longer a spof.