| • Mholloway | |
| Apr 13 2020, 2:39 PM |
| F31754966: Screenshot from 2020-04-13 10-33-34.png | |
| Apr 13 2020, 2:39 PM |
Steps to Reproduce: Navigate to https://commons.wikimedia.beta.wmflabs.org/wiki/Special:Upload
Expected Results: Upload form appears and workflow proceeds as usual
Actual Results: Autoblocked message appears. The provided username and IP associated with the block are 172.16.1.181. (In fact, I am logged in as Mdholloway and connecting from a public IP address.)
Confirmed on enwp beta as detecting wrong IP as well
| Subject | Repo | Branch | Lines +/- | |
|---|---|---|---|---|
| beta: update text cache IP | operations/mediawiki-config | master | +2 -2 |
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | BUG REPORT | hashar | T250085 All users autoblocked from editing on Beta Wikis (IP address detected incorrectly as the deployment-cache-text06 internal IP) | ||
| Resolved | zeljkofilipin | T250166 selenium-daily-beta-MediaWiki Jenkins job fails with `Autoblocked because your IP address was recently used by "JonelleMaier71"` |
172.16.1.181 should never show as connecting to public internet. It’s part of the BOGON IPs.
172.16.0.0/21 is the internal IP space for instances in the Cloud VPS network. 172.16.1.181 is the Cloud VPS facing ip address of the deployment-cache-text06.deployment-prep.eqiad1.wikimedia.cloud instance. That instance is part of the "CDN" layer for deployment-prep (aka "beta cluster").
I don't remember if we are or are not explicitly keeping the MediaWiki servers from seeing the x-forwared-for data in deployment-prep or not.
The auto block has expired and as such commons beta is editable but the issue will probably re-occur as soon as another block is placed assuming the fix to detect your actual IP isn’ applied.
the issue will probably re-occur as soon as another block is placed assuming the fix to detect your actual IP isn’ applied.
It does.
I'm going to be bold and call this high-priority.
Read: It absolutely will occur again (as it has done) until the actual IP is detected and not the internal one.
I'm going to be bold and call this high-priority.
It probably is, takes down at least two beta wikis (possibly all), It affects enwp beta + commons beta at least as well from my quick test.
Caused by
2020-04-11
15:07 Migrated from deployment-cache-text05 (stretch) to deployment-cache-text06 (buster) - class stopped working on stretch with https://gerrit.wikimedia.org/r/c/operations/puppet/+/584553 - shut down old instance - T250006
Change 588706 had a related patch set uploaded (by Hashar; owner: Hashar):
[operations/mediawiki-config@master] beta: update text cache IP
Change 588706 merged by jenkins-bot:
[operations/mediawiki-config@master] beta: update text cache IP
The config change should have been deployed on beta now ( https://gerrit.wikimedia.org/r/#/c/operations/mediawiki-config/+/588706/ ). So tentatively that should be fixed?