Page MenuHomePhabricator
Create Task
Maniphest T193200

PDF file has "0 x 0 pixels" and no thumbnail when shown on mediawiki.org but works fine on Commons
Closed, ResolvedPublic
Actions

Description

This file is not displaying properly at mediawikiwiki, but it looks fine on Commons.
I've tried purging the file page at Commons and Mediawikiwiki, and purging a page it is used on. That didn't help.
The only clue is the "0 x 0 pixels" metadata. Possibly that means it is related to T192866 ?

https://www.mediawiki.org/wiki/File:Mobile_Page_Issues_Research.pdf ‎(0 × 0 pixels, file size: 1.32 MB)
https://commons.wikimedia.org/wiki/File:Mobile_Page_Issues_Research.pdf (1,500 × 843 pixels, file size: 1.32 MB)

Missing thumbnail generation can be seen at https://www.mediawiki.org/w/index.php?title=User:CKoerner_(WMF)/sandbox&oldid=2765329 where the link on the right should actually be a normal thumbnail.

Details

SubjectRepoBranchLines +/-
Fix for pdfinfo changes in poppler-utils 0.48mediawiki/extensions/PdfHandlerREL1_28+15 -2
Fix for pdfinfo changes in poppler-utils 0.48mediawiki/extensions/PdfHandlerREL1_30+13 -2
Fix for pdfinfo changes in poppler-utils 0.48mediawiki/extensions/PdfHandlerREL1_29+15 -2
Fix for pdfinfo changes in poppler-utils 0.48mediawiki/extensions/PdfHandlerREL1_27+15 -2
Fix for pdfinfo changes in poppler-utils 0.48mediawiki/extensions/PdfHandlerREL1_31+15 -4
Fix for pdfinfo changes in poppler-utils 0.48mediawiki/extensions/PdfHandlermaster+15 -4
Fix for pdfinfo changes in poppler-utils 0.48mediawiki/extensions/PdfHandlerwmf/1.32.0-wmf.1+15 -4
Customize query in gerrit

Related Objects

Event Timeline

Quiddity created this task.Apr 26 2018, 8:53 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptApr 26 2018, 8:53 PM
• brion subscribed.Apr 26 2018, 9:04 PM

I'm seeing 0x0 and broken thumbnails on Commons itself for a bunch of other recently uploaded PDF files, could be related issue with some machines missing something used for metadata loading?

https://commons.wikimedia.org/wiki/Special:NewFiles?user=&mediatype%5B%5D=OFFICE&start=&end=&wpFormIdentifier=specialnewimages&limit=50&offset=

• brion added a comment.Apr 26 2018, 10:17 PM

This may be an issue with inconsistent versions of poppler-utils/pdfinfo installed, maybe? In local testing that with poppler 0.48.0 in Debian Stretch, it looks like the -meta (metadata) and -l 999999 (give sizes for pages up to 999999) seem to be at odds.

On the older 0.26.5 in Jessie it works ok.

# Stretch vagrant vm
vagrant@vagrant:/srv/images/5/59$ pdfinfo -enc UTF-8 -l 9999999 -meta  Mobile_Page_Issues_Research.pdf 
vagrant@vagrant:/srv/images/5/59$ pdfinfo -enc UTF-8 -l 9999999  Mobile_Page_Issues_Research.pdf 
Creator:        Google
Tagged:         no
UserProperties: no
Suspects:       no
Form:           none
Internal Error: xref num 3 not found but needed, try to reconstruct<0a>
JavaScript:     no
Pages:          21
Encrypted:      no
Page    1 size: 720 x 405 pts
Page    1 rot:  0
Page    2 size: 720 x 405 pts
Page    2 rot:  0
Page    3 size: 720 x 405 pts
Page    3 rot:  0
Page    4 size: 720 x 405 pts
Page    4 rot:  0
Page    5 size: 720 x 405 pts
Page    5 rot:  0
Page    6 size: 720 x 405 pts
Page    6 rot:  0
Page    7 size: 720 x 405 pts
Page    7 rot:  0
Page    8 size: 720 x 405 pts
Page    8 rot:  0
Page    9 size: 720 x 405 pts
Page    9 rot:  0
Page   10 size: 720 x 405 pts
Page   10 rot:  0
Page   11 size: 720 x 405 pts
Page   11 rot:  0
Page   12 size: 720 x 405 pts
Page   12 rot:  0
Page   13 size: 720 x 405 pts
Page   13 rot:  0
Page   14 size: 720 x 405 pts
Page   14 rot:  0
Page   15 size: 720 x 405 pts
Page   15 rot:  0
Page   16 size: 720 x 405 pts
Page   16 rot:  0
Page   17 size: 720 x 405 pts
Page   17 rot:  0
Page   18 size: 720 x 405 pts
Page   18 rot:  0
Page   19 size: 720 x 405 pts
Page   19 rot:  0
Page   20 size: 720 x 405 pts
Page   20 rot:  0
Page   21 size: 720 x 405 pts
Page   21 rot:  0
File size:      1385436 bytes
Optimized:      no
PDF version:    1.4
vagrant@vagrant:/srv/images/5/59$ pdfinfo -enc UTF-8  -meta  Mobile_Page_Issues_Research.pdf
• brion added a comment.Apr 26 2018, 10:22 PM

Looks like that was reported by third-party users as T117839 some while back. It might just be hitting us now due to a package change?

gerritbot subscribed.Apr 26 2018, 10:38 PM

Change 429356 had a related patch set uploaded (by Brion VIBBER; owner: Brion VIBBER):
[mediawiki/extensions/PdfHandler@master] Fix for pdfinfo changes in poppler-utils 0.48

https://gerrit.wikimedia.org/r/429356

gerritbot added a project: Patch-For-Review.Apr 26 2018, 10:38 PM
• brion added a subscriber: MoritzMuehlenhoff.Apr 26 2018, 10:47 PM

@MoritzMuehlenhoff logs show poppler-utils was updated for security recently; if that involved updating some machines to a newer version from an old old version it might be triggering this. If so, the patch to PdfHandler above *should* resolve the issue with compatibility for both old and new poppler-utils version...

• brion added a comment.Apr 26 2018, 10:59 PM

Looks like more Debian Stretch api & app servers got into the mix in the last few days, which probably explains it.

Some portion of upload requests will go through the Stretch machines, which'll fail to get metadata from pdfinfo, and then subsequent thumbnail operations on those files fail because they lack metadata.

I'll schedule a swat deploy for the hotfix.

• brion claimed this task.Apr 26 2018, 11:06 PM
gerritbot added a comment.Apr 26 2018, 11:16 PM

Change 429358 had a related patch set uploaded (by Reedy; owner: Brion VIBBER):
[mediawiki/extensions/PdfHandler@wmf/1.32.0-wmf.1] Fix for pdfinfo changes in poppler-utils 0.48

https://gerrit.wikimedia.org/r/429358

gerritbot added a comment.Apr 26 2018, 11:22 PM

Change 429359 had a related patch set uploaded (by Reedy; owner: Brion VIBBER):
[mediawiki/extensions/PdfHandler@REL1_31] Fix for pdfinfo changes in poppler-utils 0.48

https://gerrit.wikimedia.org/r/429359

gerritbot added a comment.Apr 26 2018, 11:27 PM

Change 429358 merged by jenkins-bot:
[mediawiki/extensions/PdfHandler@wmf/1.32.0-wmf.1] Fix for pdfinfo changes in poppler-utils 0.48

https://gerrit.wikimedia.org/r/429358

gerritbot added a comment.Apr 26 2018, 11:29 PM

Change 429362 had a related patch set uploaded (by Reedy; owner: Brion VIBBER):
[mediawiki/extensions/PdfHandler@REL1_30] Fix for pdfinfo changes in poppler-utils 0.48

https://gerrit.wikimedia.org/r/429362

gerritbot added a comment.Apr 26 2018, 11:31 PM

Change 429363 had a related patch set uploaded (by Reedy; owner: Brion VIBBER):
[mediawiki/extensions/PdfHandler@REL1_29] Fix for pdfinfo changes in poppler-utils 0.48

https://gerrit.wikimedia.org/r/429363

gerritbot added a comment.Apr 26 2018, 11:32 PM

Change 429364 had a related patch set uploaded (by Reedy; owner: Brion VIBBER):
[mediawiki/extensions/PdfHandler@REL1_27] Fix for pdfinfo changes in poppler-utils 0.48

https://gerrit.wikimedia.org/r/429364

ReleaseTaggerBot added a project: MW-1.32-notes (WMF-deploy-2018-04-24 (1.32.0-wmf.1)).Apr 27 2018, 12:00 AM
gerritbot added a comment.Apr 27 2018, 12:31 AM

Change 429356 merged by jenkins-bot:
[mediawiki/extensions/PdfHandler@master] Fix for pdfinfo changes in poppler-utils 0.48

https://gerrit.wikimedia.org/r/429356

gerritbot added a comment.Apr 27 2018, 12:40 AM

Change 429359 merged by jenkins-bot:
[mediawiki/extensions/PdfHandler@REL1_31] Fix for pdfinfo changes in poppler-utils 0.48

https://gerrit.wikimedia.org/r/429359

ReleaseTaggerBot edited projects, added MW-1.32-notes (WMF-deploy-2018-05-01 (1.32.0-wmf.2)); removed MW-1.32-notes (WMF-deploy-2018-04-24 (1.32.0-wmf.1)).Apr 27 2018, 1:01 AM
Aklapper added a project: MediaWiki-extensions-PdfHandler.Apr 27 2018, 1:28 AM
• brion added a comment.Apr 27 2018, 2:28 AM

Fix went live a couple hours ago, all files uploaded since then seem to be detecting metadata ok. May need to run a script to fix up the broken ones per-wiki, I'll look into that tomorrow.

MoritzMuehlenhoff added a comment.Apr 27 2018, 12:19 PM
In T193200#4162967, @brion wrote:

Looks like more Debian Stretch api & app servers got into the mix in the last few days, which probably explains it.

Some portion of upload requests will go through the Stretch machines, which'll fail to get metadata from pdfinfo, and then subsequent thumbnail operations on those files fail because they lack metadata.

Ack, that sounds like what happened here. Does that extension have CI tests, if so it would be nice if a test could be added which only tests the pdfinfo invocation against the expected output format. We usually start rolling CI tests for new distro releases before we upgrade our servers, so those tests would have caught this.

gerritbot added a comment.Apr 30 2018, 8:20 PM

Change 429877 had a related patch set uploaded (by Brion VIBBER; owner: Brion VIBBER):
[mediawiki/extensions/PdfHandler@REL1_28] Fix for pdfinfo changes in poppler-utils 0.48

https://gerrit.wikimedia.org/r/429877

gerritbot added a comment.Apr 30 2018, 8:23 PM

Change 429364 merged by jenkins-bot:
[mediawiki/extensions/PdfHandler@REL1_27] Fix for pdfinfo changes in poppler-utils 0.48

https://gerrit.wikimedia.org/r/429364

gerritbot added a comment.Apr 30 2018, 8:25 PM

Change 429363 merged by jenkins-bot:
[mediawiki/extensions/PdfHandler@REL1_29] Fix for pdfinfo changes in poppler-utils 0.48

https://gerrit.wikimedia.org/r/429363

gerritbot added a comment.Apr 30 2018, 8:27 PM

Change 429362 merged by jenkins-bot:
[mediawiki/extensions/PdfHandler@REL1_30] Fix for pdfinfo changes in poppler-utils 0.48

https://gerrit.wikimedia.org/r/429362

gerritbot added a comment.Apr 30 2018, 8:54 PM

Change 429877 merged by Brion VIBBER:
[mediawiki/extensions/PdfHandler@REL1_28] Fix for pdfinfo changes in poppler-utils 0.48

https://gerrit.wikimedia.org/r/429877

• Ramsey-WMF moved this task from Untriaged to Tracking on the Multimedia board.May 7 2018, 3:57 PM
• Vvjjkkii renamed this task from PDF file has "0 x 0 pixels" and no thumbnail when shown on mediawiki.org but works fine on Commons to n4daaaaaaa.Jul 1 2018, 1:13 AM
• Vvjjkkii removed • brion as the assignee of this task.
• Vvjjkkii triaged this task as High priority.
• Vvjjkkii added projects: CheckUser, Connected-Open-Heritage-Batch-uploads (RAÄ-KMB_1_2017-02), Tamil-Sites, Gamepress, Hashtags, Jade, KartoEditor, Language-2018-Apr-June, New-Editor-Experiences, Mail, TCB-Team (now WMDE-TechWish).
• Vvjjkkii updated the task description. (Show Details)
• Vvjjkkii removed subscribers: gerritbot, Aklapper.
Wong128hk renamed this task from n4daaaaaaa to PDF file has "0 x 0 pixels" and no thumbnail when shown on mediawiki.org but works fine on Commons.Jul 1 2018, 6:15 AM
Wong128hk assigned this task to • brion.
Wong128hk raised the priority of this task from High to Needs Triage.
Wong128hk removed projects: TCB-Team (now WMDE-TechWish), Mail, New-Editor-Experiences, Language-2018-Apr-June, KartoEditor, Jade, Hashtags, Gamepress, Tamil-Sites, Connected-Open-Heritage-Batch-uploads (RAÄ-KMB_1_2017-02), CheckUser.
Wong128hk updated the task description. (Show Details)
Wong128hk added subscribers: gerritbot, Aklapper.
Aklapper added a comment.Apr 8 2019, 11:16 AM

https://www.mediawiki.org/wiki/File:Mobile_Page_Issues_Research.pdf shows a thumbnail and correct size data nowadays.

Can this task be closed as resolved?

Aklapper closed this task as Resolved.May 4 2019, 10:29 PM
Aklapper removed a project: Patch-For-Review.
In T193200#5092947, @Aklapper wrote:

https://www.mediawiki.org/wiki/File:Mobile_Page_Issues_Research.pdf shows a thumbnail and correct size data nowadays.

Can this task be closed as resolved?

No reply, hence assuming yes. Feel free to reopen if there is work left to do or if this still happens somewhere.

Yann mentioned this in T298423: DjVu thumbnails not displayed on Wikisource.Jan 1 2022, 12:16 PM
Yann reopened this task as Open.Jan 23 2022, 5:37 PM
Yann subscribed.

Hi, It just happens now: https://commons.wikimedia.org/wiki/File:The_Collected_Works_of_Mahatma_Gandhi,_vol._2.pdf
I get an error message saying "The wiki is in read-only mode."

Yann added a comment.Jan 27 2022, 9:13 AM

Another one: https://commons.wikimedia.org/wiki/File:Gandhi_-_Dakshin_Afrika_Ke_Satyagraha_(Hindi).pdf

TheDJ closed this task as Resolved.EditedFeb 4 2022, 11:35 PM
TheDJ subscribed.

Please do not reopen tickets which have been closed for a long time and instead file new tickets. Symptoms while similar can have very different causes and should thus be handles on a case by case basis.

Yann reopened this task as Open.May 31 2022, 1:57 PM

Again here: https://commons.wikimedia.org/wiki/File:The_Collected_Works_of_Mahatma_Gandhi,_vol._97.pdf

Aklapper removed • brion as the assignee of this task.Sep 26 2022, 10:25 AM

Removing task assignee due to inactivity as this open task has been assigned for more than two years. See the email sent to the task assignee on August 22nd, 2022.
Please assign this task to yourself again if you still realistically [plan to] work on this task - it would be welcome!
If this task has been resolved in the meantime, or should not be worked on ("declined"), please update its task status via "Add Action… 🡒 Change Status".
Also see https://www.mediawiki.org/wiki/Bug_management/Assignee_cleanup for tips how to best manage your individual work in Phabricator. Thanks!

TheDJ closed this task as Resolved.Sep 26 2022, 12:01 PM
TheDJ claimed this task.

This original issue was fixed. Separate problems sharing the same symptom should be filed as separate tickets.

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL