So @Quiddity pointed out that https://wmflabs.org (the site itself that was just redirecting to wikitech) was no longer working, and I found it was pointing at the old main region proxy IP which no longer appeared to have any instances. That was a simple fix (updated DNS to point it at the new one), but I found others listed at https://tools.wmflabs.org/openstack-browser/project/project-proxy
Description
Description
Related Objects
Related Objects
Event Timeline
Comment Actions
The following still point at the old 208.80.155.156:
ase.wikipedia.wmflabs.org.
math.testme.wmflabs.org.
mathoid.testme.wmflabs.org.
mws.testme.wmflabs.org.
openid-wiki.instance-proxy.wmflabs.org.
structured.wikiquote.wmflabs.org.
Comment Actions
Yeah these are all DNS records with no matching proxy entries:
sqlite> select * from route where domain in ('ase.wikipedia.wmflabs.org', 'math.testme.wmflabs.org', 'mathoid.testme.wmflabs.org', 'mws.testme.wmflabs.org', 'openid-wiki.instance-proxy.wmflabs.org', 'structured.wikiquote.wmflabs.org');
sqlite>Comment Actions
I'm going to take care of this but have just noticed horizon has more questionable stuff I didn't notice before on openstack-browser
Comment Actions
Alright, the following all point at 208.80.155.156 and so do not work.
These ones show up on https://tools.wmflabs.org/openstack-browser/project/wmflabsdotorg but not https://tools.wmflabs.org/openstack-browser/project/project-proxy:
codesearch-sourcegraph1.wmflabs.org. migrat4-testone.wmflabs.org. migrat4-testtwo.wmflabs.org. sourcegraph1.wmflabs.org. sourcegraph11.wmflabs.org.
These ones show up on https://tools.wmflabs.org/openstack-browser/project/project-proxy but not https://tools.wmflabs.org/openstack-browser/project/wmflabsdotorg:
ase.wikipedia.wmflabs.org. math.testme.wmflabs.org. mathoid.testme.wmflabs.org. mws.testme.wmflabs.org. openid-wiki.instance-proxy.wmflabs.org. structured.wikiquote.wmflabs.org.
Note also proxy-eqiad.wmflabs.org, let's deal with that later.
Comment Actions
Deleted all of the first list from DNS. Need to track down the second list. I imagine they're under other projects' zones.
Comment Actions
Mentioned in SAL (#wikimedia-cloud) [2019-03-19T17:44:16Z] <Krenair> Deleted orphaned DNS records codesearch-sourcegraph1, migrat4-testone, migrat4-testtwo, sourcegraph1, sourcegraph11 T218633
Comment Actions
Mentioned in SAL (#wikimedia-cloud) [2019-03-19T17:46:53Z] <Krenair> Deleted orphaned DNS records ase.wikipedia, math.testme, mathoid.testme, mws.testme, openid-wiki.instance-proxy, structured.wikiquote T218633
Comment Actions
Alright so proxy-eqiad.wmflabs.org... It points at 208.80.155.156 though is not a proxy entry like the others.
m.wmflabs.org and www.wmflabs.org CNAME to this record.
Comment Actions
There is a proxy-eqiad1.wmflabs.org. pointing at the new IP in the new region, so I am going to update the m and www records to CNAME to that instead, and delete the old one.
Comment Actions
Mentioned in SAL (#wikimedia-cloud) [2019-03-19T18:00:24Z] <Krenair> Updated m and www records to CNAME to proxy-eqiad1 instead of proxy-eqiad (which was an A record to a now unused IP), found in review at T218633
Comment Actions
Mentioned in SAL (#wikimedia-cloud) [2019-03-19T18:00:43Z] <Krenair> Removed old proxy-eqiad A record pointing at no-longer-used IP T218633
Comment Actions
I should make another task about cleaning up this zone, but it's all done in terms of the proxy I think.