KeyError: allpages for interwiki
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	JAnD
	Oct 29 2014, 10:53 AM

Description

interwiki.py -async -family:wiktionary -cleanup -continue -array:50 -query:30 -untranslated
...

NOTE: The first unfinished subject is [[cs:Kategorie:Finština]]
NOTE: Number of pages queued is 30, trying to add 30 more.
Dump cs (wiktionary) written.
Traceback (most recent call last):
  File "D:\Py\interwiki.py", line 2665, in <module>
    main()
  File "D:\Py\interwiki.py", line 2639, in main
    bot.run()
  File "D:\Py\interwiki.py", line 2358, in run
    self.queryStep()
  File "D:\Py\interwiki.py", line 2331, in queryStep
    self.oneQuery()
  File "D:\Py\interwiki.py", line 2299, in oneQuery
    site = self.selectQuerySite()
  File "D:\Py\interwiki.py", line 2270, in selectQuerySite
    self.generateMore(globalvar.maxquerysize - mycount)
  File "D:\Py\interwiki.py", line 2178, in generateMore
    page = self.pageGenerator.next()
  File "D:\Py\pagegenerators.py", line 1104, in CombinedPageGenerator
    for page in generator:
  File "D:\Py\pagegenerators.py", line 549, in AllpagesPageGenerator
    includeredirects=includeredirects):
  File "D:\Py\wikipedia.py", line 8559, in allpages
    warning = data['warnings']['allpages']['*']
KeyError: 'allpages'

Version: compat-(1.0)
Severity: critical

Details

Reference: bz72667

Related Objects

Mentioned In: T101524: Many parts of compat will break when used on Wikimedia servers on July 1, 2015
rPWBO84d84a9541eb: Fix KeyError: allpages for interwiki.
T74749: API Warning for continue parameter
Mentioned Here: T74786: KeyError in AllpagesPageGenerator

Event Timeline

• bzimport raised the priority of this task from to Needs Triage.Nov 22 2014, 4:00 AM

• bzimport added a project: Pywikibot-interwiki.py.

• bzimport set Reference to bz72667.

• bzimport added a subscriber: Unknown Object (????).

JAnD created this task.Oct 29 2014, 10:53 AM

No news on this?

This warning is what is causing the exception:

print data['warnings']

>

{u'query': {u'*': u"Formatting of continuation data will be changing soon. To co
ntinue using the current formatting, use the 'rawcontinue' parameter. To begin u
sing the new format, pass an empty string for 'continue' in the initial query."}
}

Malafaya, I suggest that you try to migrate from compat to core.
More contributors fixing bugs in core than in compat.

I'm giving it another try. Things seem to be smoother in the initial setup now.
But I reopened bug 71115, because that same problema is happening in core now (again?).

OK, I gave 'core' a try but whereas 'compat' works fine with closed wikis, 'core' does not and halts everytime an interwiki (a working one) for such wikis is found (see my previous comment). So currently I have no working interwiki bot for Wiktionaries. Thanks anyway.

Aklapper added a project: Pywikibot-compat.Nov 27 2014, 4:01 PM

Change 176910 had a related patch set uploaded (by Malafaya):
Fix for bug T74667

https://gerrit.wikimedia.org/r/176910

Patch-For-Review

jayvdb assigned this task to Malafaya.Dec 2 2014, 12:44 PM

jayvdb triaged this task as High priority.

jayvdb updated the task description. (Show Details)

jayvdb set Security to None.

jayvdb removed a subscriber: Unknown Object (????).

jayvdb mentioned this in T74749: API Warning for continue parameter.Dec 2 2014, 12:49 PM

T74786 looks like the same problem

jayvdb moved this task from Backlog to compat problems on the Pywikibot-interwiki.py board.Dec 5 2014, 4:17 AM