Page MenuHomePhabricator

site_generators_tests -v TestSiteGenerators.test_all_links fails on several wikis
Open, Stalled, Needs TriagePublicBUG REPORT

Description

site_generators_tests -v TestSiteGenerators.test_all_links fails on several wikis for two days or more.

D:\pwb\GIT\core>pwb -site:wikipedia:de site_generators_tests -v TestSiteGenerators.test_all_links
tests: max_retries reduced from 15 to 1
test_all_links (__main__.TestSiteGenerators.test_all_links)
Test the site.alllinks() method. ... ERROR
 46.650s
======================================================================
ERROR: test_all_links (__main__.TestSiteGenerators.test_all_links)
Test the site.alllinks() method.
----------------------------------------------------------------------
Traceback (most recent call last):
  File "D:\pwb\GIT\core\tests\site_generators_tests.py", line 340, in test_all_links
    fwd = list(mysite.alllinks(total=10))
          ~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\pwb\GIT\core\pywikibot\site\_generators.py", line 1013, in alllinks
    for link in algen:
    ...<3 lines>...
        yield p
  File "<frozen _collections_abc>", line 356, in __next__
  File "D:\pwb\GIT\core\pywikibot\tools\collections.py", line 279, in send
    return next(self._started_gen)
           ~~~~^^^^^^^^^^^^^^^^^^^
  File "D:\pwb\GIT\core\pywikibot\data\api\_generators.py", line 607, in generator
    self.data = self.request.submit()
                ~~~~~~~~~~~~~~~~~~~^^
  File "D:\pwb\GIT\core\pywikibot\data\api\_requests.py", line 1284, in submit
    self._data = super().submit()
                 ~~~~~~~~~~~~~~^^
  File "D:\pwb\GIT\core\pywikibot\data\api\_requests.py", line 993, in submit
    response, use_get = self._http_request(use_get, uri, body, headers,
                        ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
                                           paramstring)
                                           ^^^^^^^^^^^^
  File "D:\pwb\GIT\core\pywikibot\data\api\_requests.py", line 684, in _http_request
    response = http.request(self.site, uri=uri,
               ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
                            method='GET' if use_get else 'POST',
                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
                            data=data, headers=headers, **kwargs)
                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\pwb\GIT\core\pywikibot\comms\http.py", line 283, in request
    r = fetch(baseuri, headers=headers, **kwargs)
        ~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\pwb\GIT\core\pywikibot\comms\http.py", line 457, in fetch
    callback(response)
    ~~~~~~~~^^^^^^^^^^
  File "D:\pwb\GIT\core\pywikibot\comms\http.py", line 333, in error_handling_callback
    raise ServerError(response)
pywikibot.exceptions.ServerError: HTTPSConnectionPool(host='de.wikipedia.org', port=443): Read timed out. (read timeout=45)

----------------------------------------------------------------------
Ran 1 test in 48.283s

FAILED (errors=1)

It works for wikisource:zh and wikipedia:en. Pywikibot tests for MacOS is failing; wikipedia:de is used here as default site.

Event Timeline

Change 1009308 had a related patch set uploaded (by Xqt; author: Xqt):

[pywikibot/core@master] [tests] Skip TestSiteGenerators test_all_links for wikipedia:de

https://gerrit.wikimedia.org/r/1009308

Change 1009308 merged by jenkins-bot:

[pywikibot/core@master] [tests] Skip TestSiteGenerators test_all_links for wikipedia:de

https://gerrit.wikimedia.org/r/1009308

Xqt changed the subtype of this task from "Task" to "Bug Report".Mar 6 2024, 6:26 PM
Xqt removed a project: Patch-For-Review.
Xqt moved this task from Backlog to Upstream issues on the Pywikibot board.
Xqt moved this task from Backlog to Upstream issues on the Pywikibot-tests board.

Now it fails for en-wiki too.

Change #1020927 had a related patch set uploaded (by Xqt; author: Xqt):

[pywikibot/core@master] [tests] slinks fails for en-wiki too

https://gerrit.wikimedia.org/r/1020927

Change #1020927 merged by jenkins-bot:

[pywikibot/core@master] [tests] alllinks fails for en-wiki too

https://gerrit.wikimedia.org/r/1020927

Change #1022005 had a related patch set uploaded (by Xqt; author: Xqt):

[pywikibot/core@master] [fix] user filter_unique in Site.alllinks() for MW >= 1.43

https://gerrit.wikimedia.org/r/1022005

Change #1022005 merged by jenkins-bot:

[pywikibot/core@master] [fix] use filter_unique() in Site.alllinks() for MW >= 1.43

https://gerrit.wikimedia.org/r/1022005

Change #1022450 had a related patch set uploaded (by Xqt; author: Xqt):

[pywikibot/core@master] [tests] Use subTest for TestSiteGenerators.test_all_links

https://gerrit.wikimedia.org/r/1022450

Change #1022450 merged by jenkins-bot:

[pywikibot/core@master] [tests] Use subTest for TestSiteGenerators.test_all_links

https://gerrit.wikimedia.org/r/1022450

Change #1022453 had a related patch set uploaded (by Xqt; author: Xqt):

[pywikibot/core@master] [bugfix] circumvent problems with unique and prefix parameters (T359425)

https://gerrit.wikimedia.org/r/1022453

Change #1022453 merged by jenkins-bot:

[pywikibot/core@master] [bugfix] circumvent problems with unique and prefix parameters (T359425)

https://gerrit.wikimedia.org/r/1022453

Change #1022468 had a related patch set uploaded (by Xqt; author: Xqt):

[pywikibot/core@master] [bugfix] use alfrom instead of alstart option un alllinks()

https://gerrit.wikimedia.org/r/1022468

Change #1022468 merged by jenkins-bot:

[pywikibot/core@master] [bugfix] use alfrom instead of alstart option un alllinks()

https://gerrit.wikimedia.org/r/1022468

Change #1022548 had a related patch set uploaded (by Xqt; author: Xqt):

[pywikibot/core@master] [fix] Increase read timeout for alllinks tests.

https://gerrit.wikimedia.org/r/1022548

Change #1022548 merged by jenkins-bot:

[pywikibot/core@master] [fix] Increase read timeout for alllinks tests.

https://gerrit.wikimedia.org/r/1022548

Xqt changed the task status from Open to Stalled.Sun, Apr 21, 10:40 AM
Xqt claimed this task.

Waiting until underlying task is completed.