Discussion on English Wikisource is at https://en.wikisource.org/wiki/Wikisource:Scriptorium/Help#Problems_with_File:Special_301_Report_2014.pdf

Hi @beleg_tal, thanks for taking the time to report this!

PDF files uploaded to Commons, English Wikisource, and English Wikipedia (and presumably other projects) in the last day or so fail to display thumbnails.

All PDF files? Some pdf files? Can you provide full links (complete URLs) to some PDF files with that problem? Currently the task here only mentions https://en.wikisource.org/wiki/File:Special_301_Report_2014.pdf

Probably same problem as T127914, T75584, T72734

PDF files uploaded to Commons, English Wikisource, and English Wikipedia (and presumably other projects) in the last day or so fail to display thumbnails.

All PDF files? Some pdf files? Can you provide full links (complete URLs) to some PDF files with that problem? Currently the task here only mentions https://en.wikisource.org/wiki/File:Special_301_Report_2014.pdf

As far as I can tell, the issue affects ALL PDF files uploaded in the last couple of days. We noticed it first on these two that are used in Wikisource projects:

• https://commons.wikimedia.org/wiki/File:Special_301_Report_2014.pdf
• https://en.wikisource.org/wiki/File:Über_einen_die_Erzeugung_und_Verwandlung_des_Lichtes_betreffenden_heuristischen_Gesichtspunkt.pdf

I then went to https://commons.wikimedia.org/wiki/Special:NewFiles and searched the page for "PDF", and confirmed that the issue occurred on all PDF files in the first few thousand items listed. Currently the following PDF files are listed, and they are all affected:

• https://commons.wikimedia.org/wiki/File:الزاد_في_الفيزياء.pdf
• https://commons.wikimedia.org/wiki/File:Deckblatt2.pdf
• https://commons.wikimedia.org/wiki/File:Grundkurs_Mathematik_(Osnabrück_2016-2017)Teil_IIVorlesung58.pdf
• https://commons.wikimedia.org/wiki/File:Wikimedia_Armenia_educational_programs_and_plans_for_future.pdf
• https://commons.wikimedia.org/wiki/File:Grundkurs_Mathematik_(Osnabr%C3%BCck_2016-2017)Teil_IIVorlesung57.pdf
• https://commons.wikimedia.org/wiki/File:Grundkurs_Mathematik_(Osnabr%C3%BCck_2016-2017)Teil_IIVorlesung56.pdf
• https://commons.wikimedia.org/wiki/File:Grundkurs_Mathematik_(Osnabr%C3%BCck_2016-2017)Teil_IIVorlesung55.pdf
• https://commons.wikimedia.org/wiki/File:Grundkurs_Mathematik_(Osnabr%C3%BCck_2016-2017)Teil_IIVorlesung54.pdf
• https://commons.wikimedia.org/wiki/File:Grundkurs_Mathematik_(Osnabr%C3%BCck_2016-2017)Teil_IIVorlesung53.pdf
• https://commons.wikimedia.org/wiki/File:Grundkurs_Mathematik_(Osnabr%C3%BCck_2016-2017)Teil_IIVorlesung52.pdf
• https://commons.wikimedia.org/wiki/File:Grundkurs_Mathematik_(Osnabr%C3%BCck_2016-2017)Teil_IIVorlesung51.pdf
• https://commons.wikimedia.org/wiki/File:Grundkurs_Mathematik_(Osnabr%C3%BCck_2016-2017)Teil_IIVorlesung50.pdf
• https://commons.wikimedia.org/wiki/File:Grundkurs_Mathematik_(Osnabr%C3%BCck_2016-2017)Teil_IIVorlesung38.pdf
• https://commons.wikimedia.org/wiki/File:1914._%D0%9F%D1%80%D0%B8%D1%87%D0%B8%D0%BD%D1%8B_%D1%81%D0%B0%D0%BC%D0%BE%D1%83%D0%B1%D0%B8%D0%B9%D1%81%D1%82%D0%B2_%D0%B2_%D1%80%D1%83%D1%81%D1%81%D0%BA%D0%BE%D0%B9_%D1%88%D0%BA%D0%BE%D0%BB%D0%B5.pdf
• https://commons.wikimedia.org/wiki/File:1bhk_Flat_on_Rent_in_Mumbai.pdf
• https://commons.wikimedia.org/wiki/File:Organigramme_de_la_Mission_r%C3%A9gionale_pour_l%27emploi_des_Arrondissements_de_Namur_et_Dinant.pdf
• https://commons.wikimedia.org/wiki/File:Vitality_Chiropractor_in_San_Jose_CA.pdf

Those are all the PDF files uploaded to Commons between 06:00 and the time of this post. I don't know how far back the issue goes. Older PDF files don't have this issue, e.g. https://commons.wikimedia.org/wiki/File:Eastern_Book_Company_%26_Ors_vs_D.B._Modak_%26_Anr.pdf which I uploaded on March 14.

Note: We've also identified the issue with https://commons.wikimedia.org/wiki/File:Improvisatrice.pdf whose latest revision was uploaded on March 22, which means that there are more files affected than only "the last few days".

Actually, looking at https://en.wikisource.org/wiki/File:Eastern_Book_Company_%26_Ors_vs_D.B._Modak_%26_Anr.pdf which I uploaded on March 14:

• Pages which have already been proofread at Wikisource have page images that display correctly, e.g. https://en.wikisource.org/wiki/Page:Eastern_Book_Company_%26_Ors_vs_D.B._Modak_%26_Anr.pdf/12
• Pages which have NOT already been proofread do not display correctly, e.g. https://en.wikisource.org/w/index.php?title=Page:Eastern_Book_Company_%26_Ors_vs_D.B._Modak_%26_Anr.pdf/13&action=edit&redlink=1

I assume that the issue is not tied to being proofread/not proofread, so much as being accessed in the first place.

This is most definitely broken due by https://phabricator.wikimedia.org/T164000, I can't really tell why that broke things, but reverting it is safe at this point; the underlying vulnerability in ghostscript is now fixed and the updated packages have been rolled out to the production cluster earlier the day.

thumbnail failed on mw2150: error 0 "Reading profile /etc/firejail/mediawiki-converters.profile
Reading profile /etc/firejail/mediawiki-converters.profile
]0;firejail /usr/bin/convert -depth 8 -quality 95 -resize 180 - /tmp/transform_75a822c4e8a2.jpg convert: no decode delegate for this image format `' @ error/constitute.c/ReadImage/501.
convert: no images defined `/tmp/transform_75a822c4e8a2.jpg' @ error/convert.c/ConvertImageCommand/3210.
Parent pid 28613, child pid 28615

Parent is shutting down, bye..." from "('/usr/local/bin/mediawiki-firejail-ghostscript' '-sDEVICE=jpeg' '-sOutputFile=-' '-dFirstPage=2' '-dLastPage=2' '-dSAFER' '-r150' '-dBATCH' '-dNOPAUSE' '-q' '/tmp/localcopy_ee85b9c71615.pdf' | '/usr/local/bin/mediawiki-firejail-convert' '-depth' '8' '-quality' '95' '-resize' '180' '-' '/tmp/transform_75a822c4e8a2.jpg')"

The commands work for me locally (ghostcript 9.18, ImageMagick 6.8.9-9, with Special_301_Report_2014.pdf).
IIRC "no decode delegate" is a weird catchall bug in ImageMagick which usually has nothing to do with plugins not being available.

There is also some weird character encoding bug going on which is probably irrelevant.

The character encoding thing looks like its related to colours. Presumably the escape control character is being stripped by the logs

+1 to just reverting the pdfhandler config change

Change 350981 had a related patch set uploaded (by Reedy; owner: Reedy):
[operations/mediawiki-config@master] Revert "Run Pdf Processors in firejails"

https://gerrit.wikimedia.org/r/350981

Change 350981 merged by jenkins-bot:
[operations/mediawiki-config@master] Revert "Run Pdf Processors in firejails"

https://gerrit.wikimedia.org/r/350981

Mentioned in SAL (#wikimedia-operations) [2017-04-29T09:59:23Z] <reedy@naos> Synchronized wmf-config/CommonSettings.php: Revert pdf processor firejails T164045 (duration: 02m 41s)

Thanks, all