Page MenuHomePhabricator

Thumbor 504s on a few images Mediawiki 500s on
Closed, ResolvedPublic

Description

Nov 15 07:28:38 ms-fe1001 proxy-server: HTTP status code mismatch. Mediawiki: 500 Thumbor: 504 URL: http://upload.wikimedia.org/wikipedia/commons/thumb/4/4b/1610_Douai_Old_Testament.pdf/page59-6722px-1610_Douai_Old_Testament.pdf.jpg
Nov 15 07:45:48 ms-fe1001 proxy-server: HTTP status code mismatch. Mediawiki: 500 Thumbor: 504 URL: http://upload.wikimedia.org/wikipedia/commons/thumb/0/0c/BoschTheCrucifixionOfStJulia.jpg/32768px-BoschTheCrucifixionOfStJulia.jpg
Nov 15 07:45:57 ms-fe1001 proxy-server: HTTP status code mismatch. Mediawiki: 500 Thumbor: 504 URL: http://upload.wikimedia.org/wikipedia/commons/thumb/0/0c/BoschTheCrucifixionOfStJulia.jpg/32768px-BoschTheCrucifixionOfStJulia.jpg
Nov 15 09:26:37 ms-fe1001 proxy-server: HTTP status code mismatch. Mediawiki: 500 Thumbor: 504 URL: http://upload.wikimedia.org/wikipedia/commons/thumb/4/4b/1610_Douai_Old_Testament.pdf/page83-6722px-1610_Douai_Old_Testament.pdf.jpg
Nov 15 09:54:27 ms-fe1001 proxy-server: HTTP status code mismatch. Mediawiki: 500 Thumbor: 504 URL: http://upload.wikimedia.org/wikipedia/commons/thumb/2/25/%D0%9C%D0%B0%D0%BD%D0%B4%D0%B5%D0%BB%D1%8C%D1%88%D1%82%D0%B0%D0%BC_%D0%9E.%D0%AD._%D0%9A%D0%B0%D0%BC%D0%B5%D0%BD%D1%8C_%281913%29.pdf/page6-6164px-%D0%9C%D0%B0%D0%BD%D0%B4%D0%B5%D0%BB%D1%8C%D1%88%D1%82%D0%B0%D0%BC_%D0%9E.%D0%AD._%D0%9A%D0%B0%D0%BC%D0%B5%D0%BD%D1%8C_%281913%29.pdf.jpg
Nov 15 11:20:11 ms-fe1001 proxy-server: HTTP status code mismatch. Mediawiki: 500 Thumbor: 504 URL: http://upload.wikimedia.org/wikipedia/commons/thumb/c/c9/Le_Bain_Turc,_by_Jean_Auguste_Dominique_Ingres,_from_C2RMF_retouched.jpg/8192px-Le_Bain_Turc,_by_Jean_Auguste_Dominique_Ingres,_from_C2RMF_retouched.jpg
Nov 15 11:21:27 ms-fe1001 proxy-server: HTTP status code mismatch. Mediawiki: 500 Thumbor: 504 URL: http://upload.wikimedia.org/wikipedia/commons/thumb/c/c9/Le_Bain_Turc,_by_Jean_Auguste_Dominique_Ingres,_from_C2RMF_retouched.jpg/8192px-Le_Bain_Turc,_by_Jean_Auguste_Dominique_Ingres,_from_C2RMF_retouched.jpg
Nov 15 11:46:49 ms-fe1001 proxy-server: HTTP status code mismatch. Mediawiki: 500 Thumbor: 504 URL: http://upload.wikimedia.org/wikipedia/en/thumb/b/ba/Rahansvirtues.gif/275px-Rahansvirtues.gif

Could be the same issue as T150746 and T150753?

Event Timeline

We seem to be dealing mostly with giant images here.

1610_Douai_Old_Testament.pdf, seen in T150746, crops up again. Except this time it makes Mediawiki 500. And without surprise, it gives us the timeout value Mediawiki actually goes by, which is approximately 2 minutes. At least for PDFs. I'll try to find where the value is defined to check if a different time limit is applied to different types.

I think that this difference is fine, both backends fail because those files take too long to render. We might want to consider matching timeout values between thumbor and mediawiki.

Actually, I've seen it 500 in 30ish seconds now, so the 2 minutes thing might have been random. The process gets killed in Mediawiki's case, which would suggest the OOM killer. Having seen it take 2 minutes and 5 seconds in one case, I still wonder if Mediawiki has any time limit for its own processing.

The GIF: https://upload.wikimedia.org/wikipedia/en/b/ba/Rahansvirtues.gif is interesting because Thumbor takes a long time to render it, while Mediawiki errors on it immediately. It's not huge, animated or anything. Probably corrupt in some way, but it would be better if Thumbor failed just as fast as Mediawiki.

I believe I've found the few bugs where Thumbor was hanging for illegitimate reasons. Everything else here is a case of Thumbor taking a very long time to render a thumbnail (because of the nature of the original). But Mediawiki fails to render those thumbnails as well. It's possible that those 500s from Mediawiki are from controlled timeouts, but the error message doesn't make that clear.