Thumbor: Error reading image metadata: Failed to read image data
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	• Gilles
	Oct 12 2017, 1:38 PM

Description

This error is very frequent, maybe it's related to the recent switch to exiv2?

"The memory contains data of an unknown image type" is also very frequent

Details

	Project	Branch	Lines +/-	Subject
	operations/debs/python-thumbor-wikimedia	master	+117 -38	Upgrade to 1.11
	operations/debs/python-thumbor-wikimedia	master	+26 -3	Upgrade to 1.7

Customize query in gerrit

Revisions and Commits

rTHMBREXT Thumbor Plugins
		rTHMBREXTc9188c0e1125 Version bump
	D951	rTHMBREXT44e72e7e12ff Disable Thumbor’s built-in EXIF processing
		rTHMBREXT2b1b705feea1 Avoid log noise coming from pyexiv2

Related Objects

Mentioned In: T179954: Thumbor errors should contain a trackable request id
T183907: Thumbor 500 while thumbnailing some webm files
T185485: Measure time spent by Thumbor connecting to and reading from Poolcounter
T185483: Measure time spent by Thumbor connecting to and reading from Memcache
T185478: Measure time spent by Thumbor connecting to and reading from Swift
Mentioned Here: T179954: Thumbor errors should contain a trackable request id
T183907: Thumbor 500 while thumbnailing some webm files
T185478: Measure time spent by Thumbor connecting to and reading from Swift
T185483: Measure time spent by Thumbor connecting to and reading from Memcache
T185485: Measure time spent by Thumbor connecting to and reading from Poolcounter

Event Timeline

• Gilles created this task.Oct 12 2017, 1:38 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptOct 12 2017, 1:38 PM

Yes, they're coming from exiv2. I need to check if they're merely spewing into the log or if they're really causing requests to fail.

Seems like just noise coming from the pyexiv2 library, writing to the error log. The actual exception is caught by the code.

• Gilles triaged this task as Low priority.Oct 13 2017, 8:33 AM

I'm going to wait until there's a more compelling reason to push a new version. As it stands those noisy messages can easily be filtered out in Logstash.

• Gilles added a commit: rTHMBREXT2b1b705feea1: Avoid log noise coming from pyexiv2.Oct 13 2017, 8:37 AM

• Gilles moved this task from Inbox, needs triage to Doing (old) on the Performance-Team board.Oct 18 2017, 7:14 PM

• Gilles moved this task from Doing (old) to Blocked (old) on the Performance-Team board.Oct 23 2017, 9:48 AM

Change 386348 had a related patch set uploaded (by Gilles; owner: Gilles):
[operations/debs/python-thumbor-wikimedia@master] Upgrade to 1.7

https://gerrit.wikimedia.org/r/386348

gerritbot added a project: Patch-For-Review.Oct 25 2017, 9:31 AM

Change 386348 merged by Filippo Giunchedi:
[operations/debs/python-thumbor-wikimedia@master] Upgrade to 1.7

https://gerrit.wikimedia.org/r/386348

Didn't fix it...

• Gilles removed a project: Patch-For-Review.Oct 25 2017, 2:25 PM

Just figured out that it's coming from Thumbor itself, which does its own EXIF parsing using pyexiv2: https://github.com/thumbor/thumbor/blob/b55e24aea7b162f91ab626f6c936a973c9421139/thumbor/engines/__init__.py#L175

• Gilles added a revision: D951: Disable Thumbor’s built-in EXIF processing.Jan 23 2018, 11:16 AM

• Gilles added a project: Patch-For-Review.Jan 23 2018, 11:16 AM

• Gilles added a commit: rTHMBREXT44e72e7e12ff: Disable Thumbor’s built-in EXIF processing.Jan 31 2018, 12:18 PM

• Gilles removed a project: Patch-For-Review.Jan 31 2018, 12:18 PM

• Gilles added a commit: rTHMBREXTc9188c0e1125: Version bump.Feb 1 2018, 11:06 AM

Change 407412 had a related patch set uploaded (by Gilles; owner: Gilles):
[operations/debs/python-thumbor-wikimedia@master] Upgrade to 1.11

https://gerrit.wikimedia.org/r/407412

gerritbot added a project: Patch-For-Review.Feb 1 2018, 11:08 AM

Change 407412 merged by Filippo Giunchedi:
[operations/debs/python-thumbor-wikimedia@master] Upgrade to 1.11

https://gerrit.wikimedia.org/r/407412

• Gilles removed a project: Patch-For-Review.Feb 1 2018, 4:41 PM

Mentioned in SAL (#wikimedia-operations) [2018-02-02T09:57:08Z] <godog> roll-upgrade thumbor to 1.11 - T178072 T185478 T185483 T185485 T183907 T179954

Stashbot mentioned this in T185478: Measure time spent by Thumbor connecting to and reading from Swift.Feb 2 2018, 9:57 AM

Stashbot mentioned this in T185483: Measure time spent by Thumbor connecting to and reading from Memcache.

Stashbot mentioned this in T185485: Measure time spent by Thumbor connecting to and reading from Poolcounter.

Stashbot mentioned this in T183907: Thumbor 500 while thumbnailing some webm files.

Stashbot mentioned this in T179954: Thumbor errors should contain a trackable request id.

• Gilles closed this task as Resolved.Feb 2 2018, 11:00 AM

Thumbor: Error reading image metadata: Failed to read image dataClosed, ResolvedPublicActions