some file thumbs fail to purge on upload of a new version
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	• bzimport
	Jan 11 2012, 11:21 PM

Description

Author: saibotrash

Description:
last time Tim Starling said I should ask in irc on current problems ... well, did so - no response in wikimedia-tech:

(23:52:49) Saibo: http://upload.wikimedia.org/wikipedia/commons/thumb/9/9a/Sinai_Red_sea_ecological_disaster_Nabq_nature_reserve.jpg/120px-Sinai_Red_sea_ecological_disaster_Nabq_nature_reserve.jpg http://upload.wikimedia.org/wikipedia/commons/thumb/9/9a/Sinai_Red_sea_ecological_disaster_Nabq_nature_reserve.jpg/121px-Sinai_Red_sea_ecological_disaster_Nabq_nature_reserve.jpg
(23:52:49) Saibo: compare ;-) Seems as if purge on upload of new version fails for some old thumb versions.
(23:53:14) Saibo: note: maybe this is only from Germany
(23:53:23) Saibo: as it happened some times in the past...
(23:53:32) Saibo: squids in Amsterdam were foul

Version: unspecified
Severity: normal

Details

Reference: bz33672

Related Objects

Mentioned Here: T331138: FileBackendMultiWrite multi-dc and thumbnail handling

Event Timeline

• bzimport raised the priority of this task from to Unbreak Now!.Nov 22 2014, 12:08 AM

• bzimport added projects: WMF-General-or-Unknown, acl*sre-team.

• bzimport set Reference to bz33672.

• bzimport created this task.Jan 11 2012, 11:21 PM

saibotrash wrote:

tested with FF3.6 and wget

Confirmed. The 120px has an old thumb stuck.

http://upload.wikimedia.org/wikipedia/commons/thumb/9/9a/Sinai_Red_sea_ecological_disaster_Nabq_nature_reserve.jpg/120px-Sinai_Red_sea_ecological_disaster_Nabq_nature_reserve.jpg

HTTP/1.0 200 OK
Server: nginx/0.7.65
Date: Wed, 25 Jan 2012 07:19:34 GMT
Content-Type: image/jpeg
Content-Length: 3552
Last-Modified: Sun, 01 May 2011 16:24:22 GMT
Accept-Ranges: bytes
Age: 477164
X-Cache: HIT from amssq58.esams.wikimedia.org
X-Cache-Lookup: HIT from amssq58.esams.wikimedia.org:3128
X-Cache: MISS from amssq54.esams.wikimedia.org
X-Cache-Lookup: MISS from amssq54.esams.wikimedia.org:80
Connection: keep-alive

http://upload.wikimedia.org/wikipedia/commons/thumb/9/9a/Sinai_Red_sea_ecological_disaster_Nabq_nature_reserve.jpg/121px-Sinai_Red_sea_ecological_disaster_Nabq_nature_reserve.jpg
HTTP/1.0 200 OK

Server: nginx/0.7.65
Date: Mon, 30 Jan 2012 19:52:31 GMT
Content-Type: image/jpeg
X-Wikimedia-Thumb: http://commons.wikimedia.org/w/thumb.php?f=Sinai_Red_sea_ecological_disaster_Nabq_nature_reserve.jpg&width=121
X-Cache: MISS from sq55.wikimedia.org
X-Cache-Lookup: MISS from sq55.wikimedia.org:3128
X-Cache: MISS from sq82.wikimedia.org
X-Cache-Lookup: MISS from sq82.wikimedia.org:80
X-Cache: MISS from amssq58.esams.wikimedia.org
X-Cache-Lookup: MISS from amssq58.esams.wikimedia.org:3128
X-Cache: MISS from amssq59.esams.wikimedia.org
X-Cache-Lookup: MISS from amssq59.esams.wikimedia.org:80
Connection: close

No difference after purging to 120px (date of 121px updates).

The real 120px thumb at pmtpa:

HTTP/1.0 200 OK
Server: nginx/0.7.65
Date: Mon, 30 Jan 2012 19:53:59 GMT
Content-Type: image/jpeg
Content-Length: 3420
Last-Modified: Mon, 30 Jan 2012 19:53:16 GMT
Accept-Ranges: bytes
Age: 3
X-Cache: HIT from sq79.wikimedia.org
X-Cache-Lookup: HIT from sq79.wikimedia.org:3128
X-Cache: MISS from sq43.wikimedia.org
X-Cache-Lookup: MISS from sq43.wikimedia.org:80
Connection: keep-alive

saibotrash wrote:

(In reply to comment #2)
works for me now. Same for you? From IRC: mutante had a look at it but doesn't know the root cause.

Yes, it got updated although I don't know why :)

CT told me today that the thumbnail server crashed on the 20th, so *some* of what we're seeing here may be related to that.

Per comments, this seems to be working. Since we're going to be doing a lot of work next week, we'll keep an eye out for problems in this area.

This still happens. I've uploaded a new version of https://commons.wikimedia.org/wiki/File:EPSON_PX-8_-_1.jpg with cropped image on 2023-03-29 03:32 GMT.

But as of today, 3 weeks later, [[File:EPSON PX-8 - 1.jpg|thumb]] markup (see enwiki tpl sandbox test) still leads to 220px thumbnail URL https://upload.wikimedia.org/wikipedia/commons/thumb/d/db/EPSON_PX-8_-_1.jpg/220px-EPSON_PX-8_-_1.jpg (archive), for which a backend cached thumbnail of older uncropped version is still returned (note a large padding on the left side).

Response headers:

HTTP/1.1 200 OK
date: Tue, 18 Apr 2023 21:49:24 GMT
content-type: image/jpeg
content-length: 9026
content-disposition: inline;filename*=UTF-8''EPSON_PX-8_-_1.jpg
etag: 420cdfab96580e693f4d89dbe5253720
last-modified: Wed, 29 Mar 2023 03:16:52 GMT
server: ATS/9.1.4
age: 4091
x-cache: cp6008 miss, cp6006 hit/17
x-cache-status: hit-front
server-timing: cache;desc="hit-front", host;desc="cp6006"
strict-transport-security: max-age=106384710; includeSubDomains; preload
report-to: { "group": "wm_nel", "max_age": 604800, "endpoints": [{ "url": "https://intake-logging.wikimedia.org/v1/events?stream=w3c.reportingapi.network_error&schema_uri=/w3c/reportingapi/network_error/1.0.0" }] }
nel: { "report_to": "wm_nel", "max_age": 604800, "failure_fraction": 0.05, "success_fraction": 0.0}
x-client-ip: ...
x-content-type-options: nosniff
access-control-allow-origin: *
access-control-expose-headers: Age, Date, Content-Length, Content-Range, X-Content-Duration, X-Cache
timing-allow-origin: *
accept-ranges: bytes

(last-modified is few minutes before the moment of uploading a new version)

When requesting different size, e.g. 221px thumbnail, https://upload.wikimedia.org/wikipedia/commons/thumb/d/db/EPSON_PX-8_-_1.jpg/221px-EPSON_PX-8_-_1.jpg (archive), current cropped version is returned.

(I've tried both a purge action and even a null edit on the file, but that seems to have no effect, regarding to stuck thumbnail cache.)

Commons backend should reliably invalidate all thumbnail caches of a file on new version upload.

Please do not reopen very old tasks. Please create new tasks for new issues even there are looking the same (after some years it should be called "new"). The issue you describe sounds like T331138 and that can be fixed by a fresh purge now.

some file thumbs fail to purge on upload of a new versionClosed, ResolvedPublicActions

Description

Details

Related Objects

Event Timeline

some file thumbs fail to purge on upload of a new version
Closed, ResolvedPublic
Actions