https://commons.wikimedia.org/wiki/Special:VipsTest?thumb=File%3AExample.jpg&width=100&sharpen=0.8
The normal image is present, the VIPS image is blank. From https://commons.wikimedia.org/wiki/Special:VipsTest?thumb=File%3Aexample.jpg&width=100&sharpen=0.8Error fetching URL: Failed to connect to 10.2.1.21 port 80: Connection refused
Description
Description
Details
Details
| Project | Branch | Lines +/- | Subject | |
|---|---|---|---|---|
| operations/mediawiki-config | master | +0 -1 | Unset $wgVipsThumbnailerHost |
Related Objects
Related Objects
- Mentioned In
- T199938: VipsScaler broken for MediaWiki production (/usr/bin/vips: No such file)
T56751: Thumbs from Special:VipsTest fail - Mentioned Here
- T199938: VipsScaler broken for MediaWiki production (/usr/bin/vips: No such file)
rODNS6d0b546710b7: Remove imagescaler discovery entries / rendering records
rODNSdc7dff1db24e: Add LVS IPs for the new proton service
T186748: [EPIC] New service request: chromium-render/deploy
T188062: Remove imagescaler cluster (aka 'rendering')
Event Timeline
Comment Actions
This is happening again. Easy to reproduce at https://commons.wikimedia.org/wiki/Special:VipsTest?thumb=File%3Aexample.jpg&width=100&sharpen=0.8.
The IP in question comes from wmf-config:
CommonSettings.php
$wgVipsThumbnailerHost = '10.2.1.21';
This IP, oddly, resolves to proton.svc.codfw.wmnet, which is unrelated (Proton is the Chromium PDF rendering service)
mwmaint1001.eqiad.wmnet
$ curl proton.svc.codfw.wmnet curl: (7) Failed to connect to proton.svc.codfw.wmnet port 80: Connection refused
Looks like it originally pointed to the imagescaler pool, which was removed (T188062, 6d0b546710b70), and then the LVS IP was re-used for Proton (T186748 , dc7dff1db24ea62).
When the imagescaler pool was decom'ed, this reference in wmf-config should have been updated to point to the general app server pool instead, or disabled given we don't need to proxy anymore as each app server is now capable of doing this locally.
Comment Actions
Change 446639 had a related patch set uploaded (by Reedy; owner: Reedy):
[operations/mediawiki-config@master] Unset $wgVipsThumbnailerHost
Comment Actions
Change 446639 merged by jenkins-bot:
[operations/mediawiki-config@master] Unset $wgVipsThumbnailerHost
Comment Actions
Mentioned in SAL (#wikimedia-operations) [2018-07-18T19:24:19Z] <reedy@deploy1001> Synchronized wmf-config/CommonSettings.php: Unset wgVipsThumbnailHost T199937 (duration: 00m 55s)
Comment Actions
It's still failing but now with:
Error creating thumbnail: /bin/bash: /usr/bin/vips: No such file or directory Error code: 127
I've filed T199938 for that.