Hello, 3 files still in the waiting list since yesterday, and no upload on commons after yesterday 21:10.
Is there a problem with the bot (again).
Thanks for your help
Description
Description
Related Objects
Related Objects
- Mentioned In
- T332981: IA-Upload lagging since yesterday
- Mentioned Here
- T307956: IA-upload: Drop phetools dependency
Event Timeline
Comment Actions
I've restarted the jobs for monographiedelobservatoiredunice, derveaux-annales-religieuses-de-la-ville-de-comines-1856, raynaud-les-cornes-du-faune-1890, and yeastaproblem05kinggoog. Let's see if they fail again for the same reasons.
Comment Actions
Latter three are failing because of phetools:
- raynaud-les-cornes-du-faune-1890
- yeastaproblem05kinggoog
- derveaux-annales-religieuses-de-la-ville-de-comines-1856
This is a known issue, and will be fixed by T307956.
The first one is failing with the following error:
[2023-04-27T06:24:01.400323+00:00] LOG.DEBUG: Converting /ia-upload/jobqueue/monographiedelobservatoiredunice/Monographie de l'observatoire du Nice_jp2/Monographie de l'observatoire du Nice_0000.jp2... [] [] [2023-04-27T06:24:01.400422+00:00] LOG.DEBUG: Converting /ia-upload/jobqueue/monographiedelobservatoiredunice/Monographie de l'observatoire du Nice_jp2/Monographie de l'observatoire du Nice_0001.jp2... [] [] [2023-04-27T06:24:01.400471+00:00] LOG.DEBUG: ...to /ia-upload/jobqueue/monographiedelobservatoiredunice/build/monographiedelobservatoiredunice_p1.jpg [] [] [2023-04-27T06:24:07.674221+00:00] LOG.CRITICAL: Command "convert -resize 1500x1500 "/ia-upload/jobqueue/monographiedelobservatoiredunice/Monographie de l'observatoire du Nice_jp2/Monographie de l'observatoire du Nice_0001.jp2" "/ia-upload/jobqueue/monographiedelobservatoiredunice/build/monographiedelobservatoiredunice_p1.jpg" 2>&1" exited with code 1: convert-im6.q16: cache resources exhausted `/ia-upload/jobqueue/monographiedelobservatoiredunice/Monographie de l'observatoire du Nice_jp2/Monographie de l'observatoire du Nice_0001.jp2' @ error/cache.c/OpenPixelCache/4083. convert-im6.q16: no images defined `/ia-upload/jobqueue/monographiedelobservatoiredunice/build/monographiedelobservatoiredunice_p1.jpg' @ error/convert.c/ConvertImageCommand/3258. [] []
It's this command that's failing, e.g.:
$ convert -resize 1500x1500 /ia-upload/jobqueue/monographiedelobservatoiredunice/Monographie\ de\ l\'observatoire\ du\ Nice_jp2/Monographie\ de\ l\'observatoire\ du\ Nice_0001.jp2 ~/test.jpg convert-im6.q16: cache resources exhausted `/ia-upload/jobqueue/monographiedelobservatoiredunice/Monographie de l'observatoire du Nice_jp2/Monographie de l'observatoire du Nice_0001.jp2' @ error/cache.c/OpenPixelCache/4083. convert-im6.q16: no images defined `/home/samwilson/test.jpg' @ error/convert.c/ConvertImageCommand/3258.
It's running out of memory. I'll increase imagemagick's limit.
$ identify -list policy Path: /etc/ImageMagick-6/policy.xml Policy: Resource name: disk value: 1GiB Policy: Resource name: map value: 2GiB Policy: Resource name: memory value: 2GiB Policy: Resource name: area value: 128MB Policy: Resource name: height value: 16KP Policy: Resource name: width value: 16KP
Comment Actions
Info about the failing image:
$ identify /ia-upload/jobqueue/monographiedelobservatoiredunice/Monographie\ de\ l\'observatoire\ du\ Nice_jp2/Monographie\ de\ l\'observatoire\ du\ Nice_0001.jp2 /ia-upload/jobqueue/monographiedelobservatoiredunice/Monographie de l'observatoire du Nice_jp2/Monographie de l'observatoire du Nice_0001.jp2 JP2 9852x14122 9852x14122+0+0 8-bit sRGB 0.000u 0:00.000
So the area of that image is 9852 x 14122 or 139129944, which is larger than the configured 128MB. I've upped that to 256, and the conversion now runs correctly. I've reset the ia-upload job, and let's see if it runs properly now.
Comment Actions
That file has now been successfully uploaded: https://commons.wikimedia.org/wiki/File:Charles_Garnier_-_Monographie_de_l%27Observatoire_de_Nice.djvu
I think this is resolved now. :-)