This task will track the racking, setup and configuration of all PDUs in row C. We shouldn't have any impact on servers going down. The only thing to keep in mind is that during the PDU replacing process the management switch in that particular rack will not be available.
If you are a service owner and think that you need to depool your server(s) during the maintenance window, please put a "YES" in the "List of Servers and network devices" table below.
Thanks
Schedule
Rack | Date | Time | Comments | |
C1 | August 3rd | 11:30 am CT/4:30pm UTC | ||
C2 | August 4th | 1:300 pm CT/6:30pm UTC | ||
C3 | Already replaced | |||
C4 | August 4th | 09:30 am CT/2:30pm UTC | ||
C5 | August 4th | 10:00 am CT/3:00pm UTC | ||
C6 | August 4th | 10:30 am CT/3:30pm UTC | ||
C7 | August 4th | 11:00 am CT/4:00pm UTC | ||
C8 | August 11th | 09:30 am CT/2:30pm UTC | ||
Per PDU setup Checklist
ps1-c1-codfw/ps2-c1-codfw
- - receive in new PDUs on T303460
- - apply asset tags to each tower (both primary and link towers) as well has hostname labels.
- - add new PDUs into netbox
- - Downtime the old PDU in Icinga
- - Run the "Move devices attributes" to move all settings from old PDU to new PDU
- - Login to the master PDU and do the configuration
- - Make sure Icinga is seeing the new PDU
List of Servers and network devices in rack C1
Servers | Do you need to depool? |
es2032 | |
es2031 | |
kubernetes2012 | Powered down |
kubernetes2011 | Powered down |
db2138 | |
restbase2022 | depooled and downtimed - can be powered off |
db2125 | |
ganeti2010 | |
ganeti2009 | |
db2112 | |
restbase2015 | depooled and downtimed - can be powered off |
cloudcontrol2003-dev | |
ores2005 | |
mc2027 | YES will need to be powered off/depooled? right before the maintenance, and back on right after |
elastic2031 | Depooled and powered down |
restbase2011 | |
mc2037 | YES will need to be powered off/depooled? right before the maintenance, and back on right after |
pc2013 | |
wcqs2002 | Depooled and powered down |
cumin2002 | Powered down |
db2149 | |
ps1-c2-codfw/ps2-c2-codfw
- - receive in new PDUs on T303460
- - apply asset tags to each tower (both primary and link towers) as well has hostname labels.
- - add new PDUs into netbox
- - Downtime the old PDU in Icinga
- - Run the "Move devices attributes" to move all settings from old PDU to new PDU
- - Login to the master PDU and do the configuration
- - Make sure Icinga is seeing the new PDU
List of Servers and network devices in rack C2
Servers | Do you need to depool? |
lvs2009 | |
ms-fe2011 | |
moss-fe2001 | |
kafka-logging2003 | |
elastic2045 | |
cp2036 | powered off |
cp2035 | powered off |
dns2001 | powered off |
ml-cache2003 | |
ms-be2055 | |
elastic2047 | |
elastic2046 | |
ms-be2048 | |
ms-be2035 | |
ms-be2034 | |
ms-be2042 | |
backup2009 | |
ms-be2068 | |
backup2006 | |
ps1-c4-codfw/ps2-c4-codfw
- - receive in new PDUs on T303460
- - apply asset tags to each tower (both primary and link towers) as well has hostname labels.
- - add new PDUs into netbox
- - Downtime the old PDU in Icinga
- - Run the "Move devices attributes" to move all settings from old PDU to new PDU
- - Login to the master PDU and do the configuration
- - Make sure Icinga is seeing the new PDU
List of Servers and network devices in rack C4
Servers | Do you need to depool? |
elastic2082 | No, not in production |
elastic2081 | No, not in production |
mc2048 | |
mc2047 | |
wdqs2011 | |
elastic2066 | powered down and ready for maintenance |
elastic2065 | powered down and ready for maintenance |
ms-backup2001 | |
logstash2035 | |
ms-be2064 | |
backup2003 | |
ms-be2058 | |
ps1-c5-codfw/ps2-c5-codfw
- - receive in new PDUs on T303460
- - apply asset tags to each tower (both primary and link towers) as well has hostname labels.
- - add new PDUs into netbox
- - Downtime the old PDU in Icinga
- - Run the "Move devices attributes" to move all settings from old PDU to new PDU
- - Login to the master PDU and do the configuration
- - Make sure Icinga is seeing the new PDU
List of Servers and network devices in rack C5
Servers | Do you need to depool? |
db2166 | |
db2126 | |
db2114 | |
logstash2002 | |
restbase2016 | |
ores2006 | |
db2165 | |
db2090 | |
parse2013 | |
parse2012 | |
db2102 | |
restbase2020 | |
ganeti2012 | |
mc2031 | |
mc2030 | |
elastic2033 | Powered off/ready for work |
elastic2032 | Powered off/ready for work |
wdqs2001 | Powered off/ready for work |
phab2001 | |
parse2011 | |
gitlab-runner2003 | |
ganeti2011 | |
restbase2025 | |
ml-serve2003 | |
ps1-c6-codfw/ps2-c6-codfw
- - receive in new PDUs on T303460
- - apply asset tags to each tower (both primary and link towers) as well has hostname labels.
- - add new PDUs into netbox
- - Downtime the old PDU in Icinga
- - Run the "Move devices attributes" to move all settings from old PDU to new PDU
- - Login to the master PDU and do the configuration
- - Make sure Icinga is seeing the new PDU
List of Servers and network devices in rack C6
Servers | Do you need to depool? |
db2180 | |
db2179 | |
db2168 | |
db2167 | |
parse2015 | |
parse2014 | |
mw2365 | |
db2127 | |
mw2364 | |
mw2363 | |
mw2362 | |
mw2361 | |
mw2360 | |
mw2359 | |
mw2358 | |
mw2357 | |
mw2356 | |
ganeti2014 | |
ganeti2013 | |
mw2355 | |
es2022 | |
dbproxy2003 | |
db2116 | |
db2099 | |
mw2354 | |
mw2353 | |
mw2352 | |
mw2351 | |
mw2350 | |
wdqs2008 | |
db2135 | |
db2095 | |
db2115 | |
ps1-c7-codfw/ps2-c7-codfw
- - receive in new PDUs on T303460
- - apply asset tags to each tower (both primary and link towers) as well has hostname labels.
- - add new PDUs into netbox
- - Downtime the old PDU in Icinga
- - Run the "Move devices attributes" to move all settings from old PDU to new PDU
- - Login to the master PDU and do the configuration
- - Make sure Icinga is seeing the new PDU
List of Servers and network devices in rack C7
Servers | Do you need to depool? |
elastic2083 | Not in production/ready for work |
mc2050 | |
mc2049 | |
elastic2071 | |
cp2038 | powered off |
cp2037 | powered off |
elastic2059 | Powered down/ready for work |
logstash2028 | |
ms-be2054 | |
cloudbackup2002 | |
cloudbackup2002-array1 | |
kafka-main2003 | |
ms-be2036 | |
thanos-be2003 | |
elastic2048 | Powered down/ready for work |
ms-be2049 | |
ps1-c8-codfw/ps2-c8-codfw
- - receive in new PDUs on T303460
- - apply asset tags to each tower (both primary and link towers) as well has hostname labels.
- - add new PDUs into netbox
- - Downtime the old PDU in Icinga
- - Run the "Move devices attributes" to move all settings from old PDU to new PDU
- - Login to the master PDU and do the configuration
- - Make sure Icinga is seeing the new PDU
List of Servers and network devices in rack C8
Servers | Do you need to depool? |
frdb2001 | |
pay-lvs2002 | |
frlog2001 | |
frdb2002 | |
frban2001 | |
frauth2001 | |
frmon2001 | |
pfw3-codfw.wikimedia.org:7 | |
fasw-c-codfw.mgmt.codfw.wmnet:1 | |
pfw3-codfw.wikimedia.org:0 | |
fasw-c-codfw.mgmt.codfw.wmnet:0 | |
frqueue2001 | |
frbast2001 | |
pay-lvs2001 | |
civi2001 | |
payments2003 | |
frpm2001 | |
frpig2001 | |
payments2002 | |
payments2001 | |
frbackup2002 | |
frdb2003 | |
fran2001 | |
frqueue2002 | |
frdata2001 | |
frmx2001 | |