Page MenuHomePhabricator
Create Task
Maniphest T206190

Outdated thumbnails for djvu file on Commons cannot be purged and do not update
Open, Needs TriagePublic
Actions

Description

Yesterday, during upload of this file:
https://commons.wikimedia.org/wiki/File:PL_Jean_de_La_Fontaine_-_Bajki.djvu
I have got "system under maintanance" error message. After that (as a result of the error?) some thumbnails of pages from this file were not updated. Especially, one of them:
https://upload.wikimedia.org/wikipedia/commons/thumb/d/d8/PL_Jean_de_La_Fontaine_-_Bajki.djvu/page657-1024px-PL_Jean_de_La_Fontaine_-_Bajki.djvu.jpg
is critical for Polish Wikisource.

Please advice, how can we update it, or clear it manually in the cache.

Related Objects
Search...

Event Timeline

Ankry created this task.Oct 4 2018, 6:14 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptOct 4 2018, 6:14 AM
Ankry added a comment.Oct 4 2018, 6:17 AM

Another outdated thumbnail is
https://upload.wikimedia.org/wikipedia/commons/thumb/d/d8/PL_Jean_de_La_Fontaine_-_Bajki.djvu/page657-3669px-PL_Jean_de_La_Fontaine_-_Bajki.djvu.jpg
(but this one is not critical for us).
The page=657 was the only page modified in the recent revision of the file.

Ankry added a comment.EditedOct 4 2018, 6:25 AM

Please also point out, if there is a standard procedure that can be applied in such cases before reporting here.

Aklapper renamed this task from Please, remove outdated thumbnail from cache or update it to Outdated thumbnail for djvu file on Commons cannot be purged and does not update.Oct 4 2018, 6:52 AM
Aklapper added a parent task: T43371: Thumbnail/imagescaler (tracking).
Aklapper added projects: SRE-swift-storage, Thumbor.

Please also point out, if there is a standard procedure that can be applied in such cases before reporting here.

I tried https://commons.wikimedia.org/wiki/File:PL_Jean_de_La_Fontaine_-_Bajki.djvu?action=purge and then opening the two links with a fake URL parameter

and then reloading these two images while bypassing my browser cache but that has not helped...

• Gilles subscribed.Oct 4 2018, 9:24 AM

It's the purge that's malfunctioning and not purging the thumbnails for that file at all.

GET parameters get filtered out, that's why they're not allowing you to bypass the cache, but this trick works: https://upload.wikimedia.org/wikipedia/commons/thumb/d/d8/PL_Jean_de_La_Fontaine_-_Bajki.djvu/page657-1024px-PL_Jean_de_La_Fontaine_-_Bajkifoo.djvu.jpg

Other DJVus purge fine. Since you mention that there was an error an upload time, maybe try to reupload the latest version of the file? It's possible that you hit a read-only phase for some of the upload process which left some of the data in a semi-broken state.

Ankry added a comment.Oct 4 2018, 3:02 PM
In T206190#4641158, @Gilles wrote:

Other DJVus purge fine. Since you mention that there was an error an upload time, maybe try to reupload the latest version of the file? It's possible that you hit a read-only phase for some of the upload process which left some of the data in a semi-broken state.

@Gilles Reuploaded and no effect. Successfull upload this time, no error message. Previously uploaded file deleted to avoid SHA1 conflicts that prevent reupload.

It seems to me that some relation between file and its cache entries has been broken.
What else can be done here?

Zdzislaw subscribed.Oct 4 2018, 9:25 PM
Ankry added a comment.Oct 21 2018, 9:24 PM

The thumbnails seem to be OK already.
@Gilles can it be closed? Or there is something more to do here?

Ankry mentioned this in T207615: Varnish won't purge thumbnails of specific file.Oct 21 2018, 9:30 PM
• Gilles closed this task as Resolved.Oct 22 2018, 11:25 AM
• Gilles claimed this task.

No, I think it's impossible to reproduce the exact conditions that happened during upload and caused this. It seems like the various expiry mechanisms ultimately rectified that thumbnail, thanks for the update.

Ankry reopened this task as Open.Dec 12 2018, 10:28 PM
Ankry added a comment.Dec 12 2018, 10:30 PM

@Gilles The problem appeared again with file:
https://commons.wikimedia.org/wiki/File:Poezye_oryginalne_i_t%C5%82omaczone.djvu
pages: 468, 465, 447, 379, 377, 375, 374 and image size of 954px, eg.
https://upload.wikimedia.org/wikipedia/commons/thumb/1/1a/Poezye_oryginalne_i_t%C5%82omaczone.djvu/page377-954px-Poezye_oryginalne_i_t%C5%82omaczone.djvu.jpg

Ankry mentioned this in T214759: Purge attempts for pages of files with large number of thumbnails fails on Commons.Jan 26 2019, 11:31 AM
Aklapper removed • Gilles as the assignee of this task.Jan 26 2019, 12:19 PM
Matlin subscribed.Jan 27 2019, 10:59 AM
jijiki edited parent tasks, added: T170817: Upgrade Thumbor servers to Stretch; removed: T43371: Thumbnail/imagescaler (tracking).Feb 22 2019, 7:42 PM
jijiki removed a parent task: T170817: Upgrade Thumbor servers to Stretch.Feb 26 2019, 12:26 PM
Ankry mentioned this in T215558: Proofread Page extension on Wikisource is displaying wrong pages; purge on Commons file fails.Jul 4 2019, 8:16 PM
AntiCompositeNumber mentioned this in T281780: Thumbnail of deleted image shown in "File history" after new image with same filename got uploaded.May 5 2021, 3:22 PM
Ankry added a comment.Jun 19 2021, 5:49 PM

Problem not observed for over a year, but it appeared again recently.
See:
https://upload.wikimedia.org/wikipedia/commons/thumb/a/a7/Karol_May_-_Old_Surehand_06.djvu/page94-878px-Karol_May_-_Old_Surehand_06.djvu.jpg
and compare with eg.
https://upload.wikimedia.org/wikipedia/commons/thumb/a/a7/Karol_May_-_Old_Surehand_06.djvu/page94-879px-Karol_May_-_Old_Surehand_06.djvu.jpg
(they are thumbnails of different pages while related to the same page number (94))

Ankry added a comment.Jun 19 2021, 5:56 PM

Just FYI: currently, we are replacing ProofreadPage generated images with images of different pixel size altering the page content using MediaWiki:Common.js (for affected pages). But any suggestion of less ugly workaround is welcome.

Ankry renamed this task from Outdated thumbnail for djvu file on Commons cannot be purged and does not update to Outdated thumbnails for djvu file on Commons cannot be purged and do not update.Jun 19 2021, 5:58 PM
JoKalliauer subscribed.Jun 19 2021, 8:32 PM
Mormegil mentioned this in T333679: Thumbnail did not update after new file was uploaded.Mar 31 2023, 12:29 PM
Wargo added a subtask: T186153: outdated DjVu file page thumbnail in cache.Mar 19 2024, 1:33 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL