Use a random timestamp on Special:NewFiles on Commons doesn't loads the page (504 Gateway Timeout)
Closed, ResolvedPublic
Actions

Assigned To

None

Authored By

	Trizek-WMF
	Apr 24 2017, 12:10 PM

Description

https://commons.wikimedia.org/w/index.php?title=Special:NewFiles&dir=prev&offset=20170102215054&limit=500 don't loads
https://commons.wikimedia.org/w/index.php?title=Special:NewFiles&dir=prev&offset=20160520124303&limit=500 don't loads
https://commons.wikimedia.org/w/index.php?title=Special:NewFiles&dir=prev&offset=20060730182009&limit=500 loads

Reported (among many things) by a user who review Commons files and bookmark the link when he has done the job but wants to resume it later. He reports that the link are broken since March 24.

Event Timeline

Trizek-WMF created this task.Apr 24 2017, 12:10 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptApr 24 2017, 12:10 PM

What does "don't work" and "broken" mean? For the first link, page loads here and shows some content.
Clarifying Actual outcome and Expected outcome is very welcome in tasks.

In T163681#3205853, @Aklapper wrote:

What does "don't work" and "broken" mean? For the first link, page loads here and shows some content.

Ha. Not here and not for the user.

Again, what does that mean? Do you get a blank page? Does the page never finish loading? Something else?
What does the "Network" tab of the browser's developer tools say? (Loading time for the first link is about 95 seconds with a cold cache.)
If you have a Linux machine, does wget https:\/\/commons.wikimedia.org/w/index.php?title=Special:NewFiles\&dir=prev\&offset=20170102215054\&limit=500 (or curl) work to download the file?

Network informations:
https://commons.wikimedia.org/w/index.php?title=Special:NewFiles&dir=prev&offset=20170102215054&limit=500 took 34.58 seconds to load
https://commons.wikimedia.org/w/index.php?title=Special:NewFiles&dir=prev&offset=20160520124303&limit=500 is 504 Gateway Time-out, twice
https://commons.wikimedia.org/w/index.php?title=Special:NewFiles&dir=prev&offset=20060730182009&limit=500 took 13.25 seconds to load

Trizek-WMF renamed this task from Use a ransom timestamp on Special:NewFiles on Commons doesn't loads the page to Use a random timestamp on Special:NewFiles on Commons doesn't loads the page.Apr 24 2017, 4:52 PM

Aklapper renamed this task from Use a random timestamp on Special:NewFiles on Commons doesn't loads the page to Use a random timestamp on Special:NewFiles on Commons doesn't loads the page (504 Gateway Timeout).Apr 26 2017, 2:06 PM

Aklapper added a project: WMF-General-or-Unknown.

The user reports the following error:

[WX89UgpAMEwAAE2Ve0oAAABN] 2017-07-31 14:24:29: Erreur fatale de type « Wikimedia\Rdbms\DBQueryError »

When we profile a request, we see a request asks one full minute:

SlowTimer [60046ms] at runtime/ext_mysql: slow query: SELECT /* IndexPager::buildQueryInfo (NewFilesPager) */ img_name,img_user,img_timestamp FROM image LEFT JOIN user_groups ON (ug_group = 'bot' AND (ug_user = img_user) AND (ug_expiry IS NULL OR ug_expiry >= '20170801095005')) WHERE (ug_group IS NULL) AND (img_timestamp>'20160520124303') ORDER BY img_timestamp LIMIT 501

• 1978Gage2001 moved this task from Triage to In progress on the DBA board.Dec 11 2017, 9:45 AM

Marostegui moved this task from In progress to Triage on the DBA board.Dec 11 2017, 11:06 AM

Since 24th April 2017 till now there have been changes on the indexes of the image table and also user_groups have now a PK which wasn't there before.
The URLs listed on this task they all work now pretty fast, and so does the reported query at T163681#3488759 even on a cold replica (codfw):

SELECT /* IndexPager::buildQueryInfo (NewFilesPager) */ img_name,img_user,img_timestamp FROM image LEFT JOIN user_groups ON (ug_group = 'bot' AND (ug_user = img_user) AND (ug_expiry IS NULL OR ug_expiry >= '20170801095005')) WHERE (ug_group IS NULL) AND (img_timestamp>'20160520124303') ORDER BY img_timestamp LIMIT 501;
(snip)
501 rows in set (2.16 sec)

So I am going to consider this resolved.

Feel free to reopen if you feel it is needed!
Thanks for the report

Aklapper added a project: MediaWiki-Page-history.Sep 20 2019, 7:47 PM

Use a random timestamp on Special:NewFiles on Commons doesn't loads the page (504 Gateway Timeout)Closed, ResolvedPublicActions

Description

Event Timeline

Use a random timestamp on Special:NewFiles on Commons doesn't loads the page (504 Gateway Timeout)
Closed, ResolvedPublic
Actions