The nagios check for "DNS Discovery operations diffs" has been alerting since the DC switch over. The fix is likely simple however it is also worth investigating if the switch over process needs to be amended to include this change
Description
Details
Event Timeline
While making the change here i notice that some services which would normally be active-active seem to be only running in codfw e.g.
- eventgate-analytics-external
- shellbox
- api-gateway
- push-notifications
Further i notice that swift-rw is still active in eqiad
Change 703390 had a related patch set uploaded (by Jbond; author: John Bond):
[operations/puppet@production] P:configmaster: update disc state to match post dc switch over state
Change 703390 merged by Jbond:
[operations/puppet@production] P:configmaster: update disc state to match post dc switch over state
Change 703396 had a related patch set uploaded (by Jbond; author: John Bond):
[operations/puppet@production] P:configmaster: update expected status for eventgate-external
Change 703396 merged by Jbond:
[operations/puppet@production] P:configmaster: update expected status for eventgate-external
Not sure how I missed the icinga alert, but thanks for the ping. I have documented this as a manual step that needs to be taken https://wikitech.wikimedia.org/w/index.php?title=Switch_Datacenter&type=revision&diff=1917853&oldid=1917612