Page MenuHomePhabricator
Create Task
Maniphest T435023

Unsupported Languages aa, ar in wpbeta
Closed, ResolvedPublicBUG REPORT
Actions

Description

test_allpages_langlinks_enabled, test_pagelanglinks and testLinks fails for wpbeta:

======================================================================
ERROR: test_allpages_langlinks_enabled (tests.site_generators_tests.TestSiteGenerators)
Test allpages with langlinks enabled.
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/runner/work/pywikibot/pywikibot/tests/site_generators_tests.py", line 391, in test_allpages_langlinks_enabled
    self.assertNotEqual(page.langlinks(), [])
  File "/home/runner/work/pywikibot/pywikibot/pywikibot/page/_basepage.py", line 1812, in langlinks
    self._langlinks = set(self.iterlanglinks(include_obsolete=True))
  File "/home/runner/work/pywikibot/pywikibot/pywikibot/site/_generators.py", line 925, in pagelanglinks
    link = pywikibot.Link.langlinkUnsafe(linkdata['lang'],
  File "/home/runner/work/pywikibot/pywikibot/pywikibot/page/_links.py", line 592, in langlinkUnsafe
    link._site = pywikibot.Site(lang, source.family.name)
  File "/home/runner/work/pywikibot/pywikibot/pywikibot/__init__.py", line 274, in Site
    _sites[key] = interface(code=code, fam=fam, user=user)
  File "/home/runner/work/pywikibot/pywikibot/pywikibot/site/_apisite.py", line 129, in __init__
    super().__init__(code, fam, user)
  File "/home/runner/work/pywikibot/pywikibot/pywikibot/site/_basesite.py", line 120, in __init__
    raise UnknownSiteError(error_msg)
pywikibot.exceptions.UnknownSiteError: Language 'ar' does not exist in family wpbeta

======================================================================
ERROR: test_pagelanglinks (tests.site_generators_tests.TestSiteGenerators)
Test Site.pagelanglinks.
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/runner/work/pywikibot/pywikibot/tests/site_generators_tests.py", line 291, in test_pagelanglinks
    for ll in self.site.pagelanglinks(self.mainpage):
  File "/home/runner/work/pywikibot/pywikibot/pywikibot/site/_generators.py", line 925, in pagelanglinks
    link = pywikibot.Link.langlinkUnsafe(linkdata['lang'],
  File "/home/runner/work/pywikibot/pywikibot/pywikibot/page/_links.py", line 592, in langlinkUnsafe
    link._site = pywikibot.Site(lang, source.family.name)
  File "/home/runner/work/pywikibot/pywikibot/pywikibot/__init__.py", line 274, in Site
    _sites[key] = interface(code=code, fam=fam, user=user)
  File "/home/runner/work/pywikibot/pywikibot/pywikibot/site/_apisite.py", line 129, in __init__
    super().__init__(code, fam, user)
  File "/home/runner/work/pywikibot/pywikibot/pywikibot/site/_basesite.py", line 120, in __init__
    raise UnknownSiteError(error_msg)
pywikibot.exceptions.UnknownSiteError: Language 'aa' does not exist in family wpbeta

======================================================================
ERROR: testLinks (tests.page_tests.TestPageObject)
Test the different types of links from a page.
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/runner/work/pywikibot/pywikibot/tests/page_tests.py", line 559, in testLinks
    for p in mainpage.langlinks():
  File "/home/runner/work/pywikibot/pywikibot/pywikibot/page/_basepage.py", line 1812, in langlinks
    self._langlinks = set(self.iterlanglinks(include_obsolete=True))
  File "/home/runner/work/pywikibot/pywikibot/pywikibot/site/_generators.py", line 925, in pagelanglinks
    link = pywikibot.Link.langlinkUnsafe(linkdata['lang'],
  File "/home/runner/work/pywikibot/pywikibot/pywikibot/page/_links.py", line 592, in langlinkUnsafe
    link._site = pywikibot.Site(lang, source.family.name)
  File "/home/runner/work/pywikibot/pywikibot/pywikibot/__init__.py", line 274, in Site
    _sites[key] = interface(code=code, fam=fam, user=user)
  File "/home/runner/work/pywikibot/pywikibot/pywikibot/site/_apisite.py", line 129, in __init__
    super().__init__(code, fam, user)
  File "/home/runner/work/pywikibot/pywikibot/pywikibot/site/_basesite.py", line 120, in __init__
    raise UnknownSiteError(error_msg)
pywikibot.exceptions.UnknownSiteError: Language 'aa' does not exist in family wpbeta

Details

Related Changes in Gerrit:
SubjectAuthorRepoBranchLines +/-
tests: Add Wikipedia Beta Cluster familyMahveotmpywikibot/coremaster+72 -53
families: Add support for all existing Beta Cluster wikisXqtpywikibot/coremaster+366 -116
Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedBUG REPORTXqtT435023 Unsupported Languages aa, ar in wpbeta
 ResolvedXqtT225892 Support all existing beta cluster wikis

Event Timeline

Xqt created this task.Sun, Aug 16, 9:59 AM
Restricted Application added subscribers: pywikibot-bugs-list, hubaishan, Gerges, Aklapper. · View Herald TranscriptSun, Aug 16, 9:59 AM
Xqt triaged this task as High priority.Sun, Aug 16, 10:05 AM
Xqt moved this task from Backlog to Test failures on the Pywikibot-tests board.
Restricted Application added a subscriber: alaa. · View Herald TranscriptSun, Aug 16, 10:05 AM
Xqt added a comment.Sun, Aug 16, 11:33 AM

There were read timeouts to download all the sites:

Run if  [ wpbeta == wpbeta ]; then
  if  [ wpbeta == wpbeta ]; then
    python pwb.py generate_family_file http://en.wikipedia.beta.wmcloud.org/ wpbeta y
  fi
  shell: /usr/bin/bash -e {0}
  env:
    PYWIKIBOT_TEST_RUNNING: 1
    PYWIKIBOT_USERNAME: Pywikibot-test
    pythonLocation: /opt/hostedtoolcache/Python/3.9.25/x64
    PKG_CONFIG_PATH: /opt/hostedtoolcache/Python/3.9.25/x64/lib/pkgconfig
    Python_ROOT_DIR: /opt/hostedtoolcache/Python/3.9.25/x64
    Python2_ROOT_DIR: /opt/hostedtoolcache/Python/3.9.25/x64
    Python3_ROOT_DIR: /opt/hostedtoolcache/Python/3.9.25/x64
    LD_LIBRARY_PATH: /opt/hostedtoolcache/Python/3.9.25/x64/lib
    HTTP_PROXY: socks5h://127.0.0.1:1080
    HTTPS_PROXY: socks5h://127.0.0.1:1080
    ALL_PROXY: socks5h://127.0.0.1:1080
    NO_PROXY: 
Generating family file from http://en.wikipedia.beta.wmcloud.org/

==================================
API url: https://en.wikipedia.beta.wmcloud.org/w/api.php
MediaWiki version: 1.47.0-alpha
==================================

Determining other sites...aa ar bn ca crh cs de en en-rtl eo es fa fr he hi ja ko nl pl ru
simple sq sr sv uk vi zh
Loading 27 wikis... 
  * aa... SOCKSHTTPSConnectionPool(host='aa.wikipedia.beta.wmcloud.org', port=443): Read timed out. (read timeout=45)
  * ar... SOCKSHTTPSConnectionPool(host='ar.wikipedia.beta.wmcloud.org', port=443): Read timed out. (read timeout=45)
  * bn... downloaded
  * ca... SOCKSHTTPSConnectionPool(host='ca.wikipedia.beta.wmcloud.org', port=443): Read timed out. (read timeout=45)
...
Xqt lowered the priority of this task from High to Low.Sun, Aug 16, 11:59 AM
Xqt added a subtask: T225892: Support all existing beta cluster wikis.Tue, Aug 18, 12:00 PM
gerritbot added a comment.Tue, Aug 18, 2:49 PM

Change #1326856 had a related patch set uploaded (by Mahveotm; author: Mahveotm):

[pywikibot/core@master] families: Add Wikipedia Beta Cluster family

https://gerrit.wikimedia.org/r/1326856

gerritbot added a project: Patch-For-Review.Tue, Aug 18, 2:49 PM
Mahveotm raised the priority of this task from Low to Medium.Tue, Aug 18, 2:59 PM
Mahveotm moved this task from Backlog to Needs Review on the Pywikibot board.
Xqt added a subscriber: Mahveotm.Sun, Aug 23, 4:20 PM

@Mahveotm: I think a better approach is to solve the subtask T225892 first; I am working on it.

Mahveotm changed the task status from Open to Stalled.Mon, Aug 24, 10:03 AM
gerritbot added a comment.Sat, Aug 29, 5:16 PM

Change #1327506 had a related patch set uploaded (by Xqt; author: Xqt):

[pywikibot/core@master] families: Add support for all existing Beta Cluster wikis

https://gerrit.wikimedia.org/r/1327506

gerritbot added a comment.Sat, Aug 29, 6:01 PM

Change #1326856 abandoned by Mahveotm:

[pywikibot/core@master] tests: Add Wikipedia Beta Cluster family

https://gerrit.wikimedia.org/r/1326856

Xqt changed the task status from Stalled to Open.Sat, Aug 29, 6:54 PM
Xqt closed this task as Resolved.Sat, Sep 5, 2:19 PM
Xqt claimed this task.
Xqt closed subtask T225892: Support all existing beta cluster wikis as Resolved.
gerritbot added a comment.Sat, Sep 5, 2:21 PM

Change #1327506 merged by jenkins-bot:

[pywikibot/core@master] families: Add support for all existing Beta Cluster wikis

https://gerrit.wikimedia.org/r/1327506

Maintenance_bot removed a project: Patch-For-Review.Sat, Sep 5, 2:30 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits