API query times out
Open, LowPublic
Actions

Description

A specific API query that my bot is trying to run is timing out. I've tried to run about 15 times and it reliably times out every time.

https://commons.wikimedia.org/w/api.php?list=allimages&ailimit=max&action=query&continue=-||&aistart=20191007000000&aiend=20191007235959&aisort=timestamp&aidir=newer&aiprop=user|sha1|size|dimensions|mime|timestamp|comment|metadata&aicontinue=20191007083149|Stift_Klosterneuburg_A3.jpg&format=php&servedby=&requestid=1141644342

A sample response:

Request from [redacted] via cp1079 cp1079, Varnish XID 918790924

Related Objects
Search...

Status	Assigned	Task
Open	None	T56037 ForeignAPIRepo / InstantCommons should fetch multiple-density thumbnails in one request
Open	None	T69323 MultimediaViewer "HTML embed" shouldn't default to original (unsuitably large)
Resolved	Jdlrobson	T103362 Try to get rid of mobileview call for regular pages
Open	None	T56035 API imageinfo should allow fetching multiple thumbnail sizes
Open	None	T40891 MediaWiki API 2.0 (tracking)
Open	None	T35226 prop=imageinfo: give empty tag for files without metadata
Resolved	cscott	T56844 Image / media handling (tracking)
Duplicate	cscott	T51896 In Parsoid and MW API, implement handling for file types that do not have thumbnails, such as audio ogg files
Open	None	T66491 Media Viewer does not contain link to local file description page
Open	None	T118653 Return local description page in imageinfo API
Open	None	T86611 API does not fail gracefully when data is too large
Open	None	T36951 Output filekey for prop=stashimageinfo
Open	None	T30559 limit/start/end param of prop=imageinfo are for a list of titles
Resolved	Umherirrender	T91461 Inconsistent value for "suppressed" field in API
Duplicate	None	T101400 This result was truncated because it would otherwise be larger than the limit of 12,582,912 bytes
Open	None	T101457 imageinfo should return info for other files when one file gets a iiurlparamnormal error.
Declined	None	T112045 Parsoid lacks support for mustRender in the non-extension DataAccesses
Open	None	T122716 Using imageinfo and videoinfo together in one API request throws error
Open	None	T132946 Deprecate videoinfo
Open	None	T176673 Add iidir option for prop=imageinfo
Open	None	T38220 The stashimageinfo module shouldn't be a prop querymodule (it doesn't accept titles and doesn't work with generators)
Open	None	T89971 ApiQueryImageInfo is crufty, needs rewrite
Open	None	T235011 API query times out

Event Timeline

Magog_the_Ogre created this task.Oct 9 2019, 12:53 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptOct 9 2019, 12:53 AM

Note: if you run this query as a normal user, it will succeed. It only fails when logged in as a bot or administrator with the higher limits.

Reedy added projects: MediaWiki-API, Performance Issue.Oct 9 2019, 12:54 AM

Restricted Application added a project: Platform Engineering. · View Herald TranscriptOct 9 2019, 12:54 AM

I see only four log entries for this request (specifically, for requests containing "Stift_Klosterneuburg_A3" in the URI) in the past 24 hours. Two indicate the same error as in T187759: API is returning 500 status code. One indicates that the query was being slow to execute. And one seems to be indicating that a 500 response was returned.

It's possible that for the other attempts the "too slow to execute" happened before it got to the point of exceeding memory usage, although I'd expect to see log entries for all those too.

Masumrezarock100 added a subscriber: Masumrezarock100.Oct 12 2019, 4:24 AM

daniel triaged this task as Low priority.Oct 15 2019, 8:29 PM

daniel edited projects, added Platform Team Workboards (Clinic Duty Team); removed Platform Engineering.

WDoranWMF moved this task from Inbox to Backlog on the Platform Team Workboards (Clinic Duty Team) board.Oct 31 2019, 8:55 PM

AMooney added a project: Platform Engineering (Icebox).Mar 13 2020, 1:24 PM

CCicalese_WMF removed a project: Platform Team Workboards (Clinic Duty Team).Mar 13 2020, 1:32 PM

Aklapper removed a subscriber: Anomie.Oct 16 2020, 5:02 PM