Preferably in the form of a plugin, otherwise as a new feature/pull request on their project.
Description
Details
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | • Gilles | T77697 Investigate Swift replacement for thumbnails | |||
| Resolved | • Gilles | T121388 Service-based thumbnailing re-architecture in production with Thumbor | |||
| Resolved | • Gilles | T111718 Service-based thumbnailing re-architecture on Vagrant | |||
| Resolved | • Gilles | T110858 Investigate thumbor | |||
| Resolved | • Gilles | T111005 Purging in Thumbor | |||
| Resolved | hashar | T117955 can't install libcurl-dev on Jessie | |||
| Resolved | • Gilles | T118439 File-based result storage for Thumbor with hash-based file layout | |||
| Invalid | • Gilles | T118440 Hook up Thumbor purging to Mediawiki purging | |||
| Resolved | • Gilles | T111009 Compare performance of thumbor rendering engines |
Event Timeline
At first, we could avoid the purging issue in thumbor by simply storing things very shortly in it. I.e. the originals would stay for a minute, to cater for upload thumbnail prerendering bursts. Thumbnails wouldn't be stored at all. Purging requests should delete the original from swift immediately and schedule a varnish purge 1+ minutes later. This way by the time a new request would come to varnish later than a minute after the purge, it would be funneled to thumbor, which in turn would try to re-download the original and fail.
Then, if we want to use thumbor as a hot swap/safety net in case of disaster scenarios where varnish fails partially or fully, we need to store thumbnails on thumbor machines for a period of time. This will require writing a new FS-based storage engine for those, as the current one's directory tree scheme is completely impractical for content hash-based deletions of multiple thumbnails at once:
vagrant@mediawiki-vagrant:/tmp/thumbor/result_storage/v2/un/sa/unsafe/110x147/filters:sharpen(0.04,0,false)/127.0.0.1:8080/images/9/9a$
A new entry point for deletion commands would have to be added to thumbor.
Ideally purging would work for the original (stored in memcached) and all thumbnail sizes at once (stored on the FS).
Change 251316 had a related patch set uploaded (by Gilles):
Add ability to purge originals cached by thumbor
Change 251432 had a related patch set uploaded (by Gilles):
Add libcurl-dev to Python Jenkins
Add libcurl-dev to Python Jenkins https://gerrit.wikimedia.org/r/251432 that does not work on Jessie. Filled as T117955: can't install libcurl-dev on Jessie
Change 251479 had a related patch set uploaded (by Hashar):
contint: explicitly set ssl/tls libcurl dev package
Change 251479 merged by Muehlenhoff:
contint: explicitly set ssl/tls libcurl dev package
Change 251316 merged by jenkins-bot:
Add ability to purge originals cached by thumbor