Thumbnail/imagescaler (tracking)
Open, NormalPublic


Author: sumanah

We seem to be experiencing a bunch of potentially related problems with the imagescaler and thumbnail functionality right now -- see . I'm marking bugs as blocking this one if they have to do with thumbnail generation.

Version: wmf-deployment
Severity: normal


T4007: [DO NOT USE] Tracking bug [superseded by the #Tracking tag]
T39883: Bug and feature requests related to Wikimedia Commons (tracking)
Blocked By
T136088: The file Socialist_Party_logo.svg render a blank thumbnail
T131029: Created thumbnail of specific PNG image has 798px width instead of usual 800px
T133175: Specific Thumbnail generation for TIF file not working anymore
T127914: PDF-preview is missing (Error creating thumbnail: can't process font stream)
T123381: Thumbnailer giving random changes in contrast/white point for greyscale PNG
T123806: Some thumbnails return an application/x-www-form-urlencoded Content-Type (fixed by purging)
T118568: Huge SVG causing "huge input lookup" issue on Shanghai page.
T117333: Generation of a WebM video thumbnail on Commons broken
T115813: Thumbnail missing for PDF file
T115278: Thumbnail URL construction inconsistent (leading to URL with >300 characters creating 503 error when accessing the "wrong" way)
T112421: Update rsvg on the image scalers
T111815: SVG files larger than 10 MB cannot be thumbnailed
T113458: Specific thumbnail request for a SVG log image name throws: Error generating thumbnail
T113123: image magick stripping colour profile of PNG files [probably regression]
T108517: PNG thumbnails issues (tracking)
T107742: Superfluous border line in thumbnail
T105793: Commons thumbnail of Pluto photo is broken at 500px
T102597: Won't create thumbnail for 30000×3200 pixel file on Commons
T101834: Thumbnail image on Commons not displayed
T100435: "Error creating thumbnail: Error code: 137" (for progressive JPEG not using baseline)
T99227: Setting PDF or DjVu thumbnail size by height produces "Invalid thumbnail parameters" error
T97174: Previews are not always generated immediately after uploading a file to Wikimedia Commons
T96505: Problems with image thumbnailing on Commons
T95333: 220px of Fachada_e_lateral_da_Catedral_São_Sebastião_após_pintura,_Coronel_Fabriciano_MG.JPG not purging
T91104: PHP thumbnailer as a service
T88833: SVG thumbnail generator: relative font-size: smaller/larger not handled (text disappear)
T87775: Evaluate vignette for thumbnail scaling
T70145: Generate JPG thumbnails with ImageMagick + mozjpeg instead of IM alone
T71377: Error generating thumbnail - OOM on progressive jpeg
T71336: VIPS scaled thumbnails don't have a comment with a link to the file description page
T68109: Spam restriction on thumbnailing restrictive enough I hit it on normal browsing activity
T69703: Change MediaWiki default thumbnail size to 300px based on user behavior
T69698: Pre-render certain thumbnail sizes on upload
T69695: Replace "Thumbnail size" property in preferences with responsive resizing images
T72734: Thumbnails for specific PDF file on Commons not generated: "no decode delegate for this image format"
T67475: Resized raster image does not succeed metadata of the original file
T67383: Create optimised thumbnail even when original size is used
T67217: Operational issues for very large TIFFs
T72189: Stuck old 1024px thumbnail version of a specific djvu image on
T63711: out of memory for some animated GIF images on Commons
T61975: PDF containing jpx/jp2 encoded images from uploaded to Commons won't thumbnail
T66801: Image rendering of subpages from a PDF file not working on Portuguese Wikisource within ProofreadPage extension
T51693: Thumbnail of GIF file is not displayed in PDF output
T66622: Error generating thumbnail: As an anti-spam measure, you are limited from performing this action too many times
T51528: MediaWiki tries to create a thumbnail multiple times although that is not needed
T54740: mw1153 often returns 500 errors generating thumbnails
T49825: European varnish cache is not purged
T51118: Limit number of image scaling attempts
T56188: Thumbnails from recent uploads don't render
T44342: Some Thumbnails are not created
T44302: Thumbnails of images with "+" in filename do not show
T46071: Error Generating Thumbnail for 700 Mpx JPG
T49409: Specific animated GIF with large number of frames has no thumbnails created
T56045: Wikimedia thumbnail generator often returns HTTP 500 Internal Server Error
T50927: 201px thumbnail of Coat_of_arm_Bautzen.svg on Commons cannot be purged
T54203: VipsScaler clutters /tmp on imagescalers
T44047: thumb.php on Wikimedia Commons is serving broken images (thumbnail generation fails)
T57431: Reupload should purge File page (aka image has malformed dimensions)
T50700: Could not find data for image on pdf upload
T48976: Thumbnail and originals cache purging fails on Varnishes
T47212: TIFs appear less focused than JPG equivalent
T43665: Occasional segmentation fault on PDF thumbnail generation
T45454: Dirty background shown on scaled GIF images due to imagemagick's convert tool
T43528: Thumbnails not displayed for local videos on test2wiki
T45364: Not updated thumbnails / original file when reverting a picture to an older version (JPG, 2007, 2,898 × 3,807)
T45357: "thumbnail" or "thumb" embed fails on Tulsi Gabbard.jpg unless pixel width specified
T45345: 401 Unauthorized error preventing thumbnail display
T43447: 401 error for some thumbnails on
T45268: Greyscale Jpg Thumbnails do not get sharpened
T43403: UW does not display thumbs for OGV files in some browsers
T43386: [Regression] Error creating thumbnail: convert: incorrect data check
T43388: [Regression] DjVu size info not extracted, thumbs failing
T43385: Ignorable TIFF warnings prevent thumbnail generation
T50178: Error creating thumbnail: "Warning: File has insufficient data for an image."
T43381: Handle invalid PDF - Can't process font stream, loading font by the name
T43382: [Regression] Corrupt GIF no longer thumbnails or renders
T43380: Corrupt images should be detected and reported - by humans or automatic script.
T43376: Error creating thumbnail: oggThumb failed to create the thumbnail.
T43374: [Regression] Error creating thumbnail: convert: Too many IDAT's found
T43375: Error creating thumbnail: convert: Expected 8 bytes; found 0 bytes
T43373: [Error generating thumbnail] Empty error on Human_100_100000.svg
T43372: [Regression] Error creating thumbnail: Error reading SVG:Invalid URI
T46872: 401 Unauthorized for min.wp's thumbnails
T43362: Error creating thumbnail: Metadata uses too much space
T43361: [404 File Not Found] Some lost files
T41615: 404 error for all revisions of some files
T50041: Error creating thumbnail for specific PDF files on Commons: "Killed" (Ghostscript exceeding memory limits?)
T50007: Error creating PDF on Commons: "convert: no decode delegate for this image format" (fixed in GS 9.07)
T50003: Large thumbnails of "lossless" files return error
T43174: Many SVG files without namespace (xmlns) attribute have stopped rendering
T48350: Purging for all sites but eqiad is broken
T44963: Squid cache not being cleared for thumbs when updating new version of image
T43130: Invalidation of Varnish thumbnail cache sometimes doesn't work
T43113: thumb.php fails to generate thumbnail of SVG images (gives HTML error as body)
T48243: Requests for new thumbnail sizes never return
T46508: htcp cache purges for images do not seem to clear europe upload squid caches
T38166: OOM when generating 6000px wide thumb of large (baseline) jpeg
T46319: Error generating thumbnail: The source file for the specified thumbnail does not exist
T46310: Thumbnail cache should be automatically discarded after 6 months
T39539: Image thumbnailing on WAMP sometimes locks up
T25831: Better error presentation for high res PDFs
T30810: Video thumbnails don't work (on live Commons?)
T25326: PDF image extraction fails
T33680: [Regression] Thumbnail cache should be invalidated on re-upload
T30310: Thumbnails creation errors
T26854: Black/striped thumbnails of CMYK JPEGs
T20310: thumbnail images not created, PHP Warning at GlobalFunctions.php on line 1943
T18416: SVG rendering maximum should base on area, not largest size?
T20127: Mediawiki accepts to create thumbnails with the wrong extension
T27903: Video thumbnails may be broken (commons.prototype config)
T19645: OOM while thumbnailing huge progressive / interlaced JPEGs
T10901: SVG rasterisation and management on Wikimedia sites (tracking)
T24195: Improved error feedback for SVG thumbnail rendering
T22312: Error creating thumbnail: Image was not scaled, is the requested width bigger than the source?
T15493: Can't create thumbnail of images with a peculiar aspect ratio
T5574: Better wiki markup to display media files needed
T5537: SVGs fail to render silently if they contain an <image /> element
bzimport set Reference to bz41371.
bzimport added a subscriber: Unknown Object (MLST).
bzimport created this task.Oct 25 2012, 7:21 AM

sumanah wrote:

I think the most urgent bugs here are:

Bug 39615 - 404 error for some files
Bug 41174 - Many SVG files have stopped rendering
Bug 41130 - ?action=purge on the file description page no longer regenerates thumbnails

sumanah wrote:

Brion, I was wondering whether you think your,24115,n,z changeset for high-res image support might have had any effect regarding the most recent thumbnailing issues?

sumanah wrote:

Adding interested people.

brion added a comment.Oct 25 2012, 5:40 PM

(In reply to comment #2)

Brion, I was wondering whether you think your,24115,n,z changeset for high-res image
support might have had any effect regarding the most recent thumbnailing

Actual thumbnail generation code paths are untouched here, so it shouldn't be doing anything too surprising...

It should be causing some additional thumbnail generation to happen (as folks with Retina iPads and MacBooks browse), but should be relatively lightweight as we're using the delayed rendering options in production -- the files shouldn't get generated until they're actually loaded via the 404 handler, and only a small amount of our traffic should be hitting them so far.

Note that the Commons village pump post was from a guy who used a bot to scan for images that don't render. He didn't say that something had recently changed. I reviewed the images yesterday, and could only find one bug that was introduced recently (oggThumb version error), and that's fixed now. I fixed another issue (TIFF metadata too large), but that had probably been there since PagedTiffHandler was introduced.

(In reply to comment #5)

Note that the Commons village pump post was from a guy who used a bot to scan
for images that don't render. He didn't say that something had recently

Sure. Some things did change but it's not trivial to identify them and they don't even necessarily have to change back (e.g. bug 41375, bug 41381, bug 41382 about new restictions).

I reviewed the images yesterday, and could only find one bug that was
introduced recently (oggThumb version error), and that's fixed now.

You mean "OggHandler requires oggThumb version 0.9 or later" I guess, but bug 41376 still makes those files broken (and there are hundreds of them).

I fixed
another issue (TIFF metadata too large), but that had probably been there since
PagedTiffHandler was introduced.

Most likely.

(In reply to comment #7)

Thumbs are broken for local files on WikiVoyage

Should be fixed for all WV wikis as of a few days ago.

Steinsplitter moved this task from Incoming to Backlog on the Commons board.Mar 11 2015, 12:55 PM
Steinsplitter moved this task from Backlog to Tracking bugs on the Commons board.Mar 13 2015, 10:03 AM
Restricted Application added subscribers: Steinsplitter, Matanya. · View Herald TranscriptJul 15 2015, 11:24 PM
Jdforrester-WMF moved this task from Untriaged to Backlog on the Multimedia board.Sep 4 2015, 6:31 PM
Catrope set Security to None.Nov 13 2015, 8:22 PM
Catrope removed a subscriber: Catrope.
Restricted Application added a subscriber: Pokefan95. · View Herald TranscriptApr 23 2016, 9:54 AM
Aklapper changed the status of blocking task T136088: The file Socialist_Party_logo.svg render a blank thumbnail from "Resolved" to "Invalid".Tue, May 24, 8:08 PM

Add Comment