interwiki.py for categories in core is significantly slower than in compat
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	JAnD
	Jun 10 2015, 6:45 PM

Description

Comparison of core and compat

compat:
interwiki.py -family:wiktionary -subcatsr:Angličtina -cleanup -async -whenneeded:5 -lang:cs

ca 10 min

core:
pwb.py interwiki.py -family:wiktionary -subcatsr:Angličtina -cleanup -async -whenneeded:5 -lang:cs
ca 15 min

when running for main namespace with -wiktionary, core is quicker, but for categories is it reverse.

Mentioned Here: T109077: Performance decreased saving pages for sites with non-alphabetical code interwiki sort (interwiki_putfirst specified)

JAnD raised the priority of this task from to High.

JAnD updated the task description. (Show Details)

JAnD subscribed.

Restricted Application added subscribers: Aklapper, Unknown Object (MLST). · View Herald TranscriptJun 10 2015, 6:45 PM

I noticed it myself yesterday. The process seems to hang when retrieving pages from a wiki.
I.e., just after showing messages such as:

Retrieving 26 pages from wiktionary:pt.

Possibly fixed along with T109077

Most likely fixed if/when these changes get merged:

Also:

https://gerrit.wikimedia.org/r/#/c/237445/ (already merged; less CPU usage and time for categories)

Seems fixed with the given patches