Page MenuHomePhabricator

When running in autonomous mode, interwiki.py should ignore links to non-existant languages or add them to autonomous_problems.dat and carry on instead of crashing
Closed, DuplicatePublic

Description

Some examples:

pywikibot.exceptions.UnknownSite: Language 'eml' does not exist in family wiktionary
<class 'pywikibot.exceptions.UnknownSite'>
CRITICAL: Closing network session.
pywikibot.exceptions.UnknownSite: Language 'ltg' does not exist in family wiktionary
<class 'pywikibot.exceptions.UnknownSite'>
CRITICAL: Closing network session.
pywikibot.exceptions.UnknownSite: Language 'crh' does not exist in family wiktionary
<class 'pywikibot.exceptions.UnknownSite'>
CRITICAL: Closing network session.

When it's crashing, I have two options, manually remove the wrong link or if it's a link to Incubator or something, add the page in a skipfile, and restart.

On Wiktionaries, where there is between 500k and 2M+ pages, it's really time-consuming...

Thanks.

(I'm using pywikibot 2.0rc4, python 2.7.9 and Debian GNU/Linux)