Change 562894 had a related patch set uploaded (by RobH; owner: RobH):
[operations/dns@master] setting new eqsin PDUs dns entries

https://gerrit.wikimedia.org/r/562894

Change 562894 merged by RobH:
[operations/dns@master] setting new eqsin PDUs dns entries

https://gerrit.wikimedia.org/r/562894

Hey - this was a Q2 task but it hasn't seen an update in a while. What's the status?

We only got confirmation of delivery of the PDUs yesterday via email. I'll be dispatching directions to Jin after we determine what date works best.

@BBlack: Do you have a preference on when this work takes place? We want to ensure it is done when someone from Traffic is around. Jin works Singapore hours, and it takes a day or two to setup the work.

Will next week work for a downtime for EQSIN and a swap of the PDUs or will this need to wait until post-all-hands?

I've not seen @BBlack in IRC since posting the above comment, I suspect due to pre-all-hands-rush. We have SRE meeting time set aside during all hands, so I'll sync up with @BBlack about this.

When chatting with @wiki_willy about this earlier this week, our current plan is likely to offline eqsin from dns/usage sometime in the week of Feb. 3 (week after all hands), or possibly the week of Feb. 10.

Please note this has been confirmed as likely to occur on Feb 6th (GMT). Jin has approved that he can work during that window, and we need to get confirmation from @BBlack that this is ok for Traffic.

Update:

Start time of 2020-02-06 16:00 Pacific / 2020-02-07 00:00 GMT / 2020-02-07 08:00 Singapore time
Expected window 2-4 hours expected, 4-8 possible if issues during PDU setup.

I've coordinated with Jin via Google Hangout Messages and he has reviewed the rack and ensured he has all the cabled needed. I sent in this email to him, but since then he also followed up immediately and went onsite last evening (my time, early am his time) to work on pre-staging things as best he could.

The email has ticket numbers, google sheet links, and other things I rather not put in this task, so just updating this with generalities and specifics (open tickets) won't get appended until they are resolved/closed.

Mentioned in SAL (#wikimedia-operations) [2020-02-07T01:24:46Z] <robh> eqsin pdu work ongoing starting now. ps1-603 swapping per T242250

@RobH please let me know once the PDUs should be snmp-accessible, they'll need to be added to puppet/monitoring

Change 571522 had a related patch set uploaded (by RobH; owner: RobH):
[operations/puppet@production] adding monitoring for eqsin pdus

https://gerrit.wikimedia.org/r/571522

Change 571522 merged by RobH:
[operations/puppet@production] adding monitoring for eqsin pdus

https://gerrit.wikimedia.org/r/571522