Page MenuHomePhabricator

Travis test fails for wikidata:wikidata site
Closed, ResolvedPublicBUG REPORT

Description

Travis test fails for wikidata:wikidata site during tests of site_tests.TestLogEvents.test_logevents

See https://travis-ci.org/wikimedia/pywikibot/jobs/523004363

Probalbly a urllib3 issue which was updated few days ago?
https://pypi.org/project/urllib3/#history

Microsoft Windows [Version 6.1.7601]
Copyright (c) 2009 Microsoft Corporation. Alle Rechte vorbehalten.

C:\pwb\GIT\core>pwb site_tests -v TestLogEvents.test_logevents
tests: max_retries reduced from 15 to 1
test_logevents (__main__.TestLogEvents)
Test logevents method. ... ERROR: Traceback (most recent call last):
  File "C:\python37\lib\site-packages\urllib3\connectionpool.py", line 384, in _
make_request
    six.raise_from(e, None)
  File "<string>", line 2, in raise_from
  File "C:\python37\lib\site-packages\urllib3\connectionpool.py", line 380, in _
make_request
    httplib_response = conn.getresponse()
  File "C:\python37\lib\http\client.py", line 1321, in getresponse
    response.begin()
  File "C:\python37\lib\http\client.py", line 296, in begin
    version, status, reason = self._read_status()
  File "C:\python37\lib\http\client.py", line 257, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "C:\python37\lib\socket.py", line 589, in readinto
    return self._sock.recv_into(b)
  File "C:\python37\lib\ssl.py", line 1049, in recv_into
    return self.read(nbytes, buffer)
  File "C:\python37\lib\ssl.py", line 908, in read
    return self._sslobj.read(len, buffer)
socket.timeout: The read operation timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\python37\lib\site-packages\requests\adapters.py", line 445, in send
    timeout=timeout
  File "C:\python37\lib\site-packages\urllib3\connectionpool.py", line 638, in u
rlopen
    _stacktrace=sys.exc_info()[2])
  File "C:\python37\lib\site-packages\urllib3\util\retry.py", line 367, in incre
ment
    raise six.reraise(type(error), error, _stacktrace)
  File "C:\python37\lib\site-packages\urllib3\packages\six.py", line 686, in rer
aise
    raise value
  File "C:\python37\lib\site-packages\urllib3\connectionpool.py", line 600, in u
rlopen
    chunked=chunked)
  File "C:\python37\lib\site-packages\urllib3\connectionpool.py", line 386, in _
make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "C:\python37\lib\site-packages\urllib3\connectionpool.py", line 306, in _
raise_timeout
    raise ReadTimeoutError(self, url, "Read timed out. (read timeout=%s)" % time
out_value)
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='www.wikidata.org'
, port=443): Read timed out. (read timeout=45)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\pwb\GIT\core\pywikibot\data\api.py", line 1744, in _http_request
    body=body, headers=headers)
  File "C:\pwb\GIT\core\pywikibot\tools\__init__.py", line 1738, in wrapper
    return obj(*__args, **__kw)
  File "C:\pwb\GIT\core\pywikibot\comms\http.py", line 324, in request
    r = fetch(baseuri, method, params, body, headers, **kwargs)
  File "C:\pwb\GIT\core\pywikibot\comms\http.py", line 527, in fetch
    error_handling_callback(request)
  File "C:\pwb\GIT\core\pywikibot\comms\http.py", line 412, in error_handling_ca
llback
    raise request.data
  File "C:\pwb\GIT\core\pywikibot\comms\http.py", line 391, in _http_process
    **http_request.kwargs)
  File "C:\python37\lib\site-packages\requests\sessions.py", line 512, in reques
t
    resp = self.send(prep, **send_kwargs)
  File "C:\python37\lib\site-packages\requests\sessions.py", line 622, in send
    r = adapter.send(request, **kwargs)
  File "C:\python37\lib\site-packages\requests\adapters.py", line 526, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='www.wikidata.org', po
rt=443): Read timed out. (read timeout=45)

WARNING: Waiting 5 seconds before retrying.
ERROR: Traceback (most recent call last):
  File "C:\python37\lib\site-packages\urllib3\connectionpool.py", line 384, in _
make_request
    six.raise_from(e, None)
  File "<string>", line 2, in raise_from
  File "C:\python37\lib\site-packages\urllib3\connectionpool.py", line 380, in _
make_request
    httplib_response = conn.getresponse()
  File "C:\python37\lib\http\client.py", line 1321, in getresponse
    response.begin()
  File "C:\python37\lib\http\client.py", line 296, in begin
    version, status, reason = self._read_status()
  File "C:\python37\lib\http\client.py", line 257, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "C:\python37\lib\socket.py", line 589, in readinto
    return self._sock.recv_into(b)
  File "C:\python37\lib\ssl.py", line 1049, in recv_into
    return self.read(nbytes, buffer)
  File "C:\python37\lib\ssl.py", line 908, in read
    return self._sslobj.read(len, buffer)
socket.timeout: The read operation timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\python37\lib\site-packages\requests\adapters.py", line 445, in send
    timeout=timeout
  File "C:\python37\lib\site-packages\urllib3\connectionpool.py", line 638, in u
rlopen
    _stacktrace=sys.exc_info()[2])
  File "C:\python37\lib\site-packages\urllib3\util\retry.py", line 367, in incre
ment
    raise six.reraise(type(error), error, _stacktrace)
  File "C:\python37\lib\site-packages\urllib3\packages\six.py", line 686, in rer
aise
    raise value
  File "C:\python37\lib\site-packages\urllib3\connectionpool.py", line 600, in u
rlopen
    chunked=chunked)
  File "C:\python37\lib\site-packages\urllib3\connectionpool.py", line 386, in _
make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "C:\python37\lib\site-packages\urllib3\connectionpool.py", line 306, in _
raise_timeout
    raise ReadTimeoutError(self, url, "Read timed out. (read timeout=%s)" % time
out_value)
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='www.wikidata.org'
, port=443): Read timed out. (read timeout=45)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\pwb\GIT\core\pywikibot\data\api.py", line 1744, in _http_request
    body=body, headers=headers)
  File "C:\pwb\GIT\core\pywikibot\tools\__init__.py", line 1738, in wrapper
    return obj(*__args, **__kw)
  File "C:\pwb\GIT\core\pywikibot\comms\http.py", line 324, in request
    r = fetch(baseuri, method, params, body, headers, **kwargs)
  File "C:\pwb\GIT\core\pywikibot\comms\http.py", line 527, in fetch
    error_handling_callback(request)
  File "C:\pwb\GIT\core\pywikibot\comms\http.py", line 412, in error_handling_ca
llback
    raise request.data
  File "C:\pwb\GIT\core\pywikibot\comms\http.py", line 391, in _http_process
    **http_request.kwargs)
  File "C:\python37\lib\site-packages\requests\sessions.py", line 512, in reques
t
    resp = self.send(prep, **send_kwargs)
  File "C:\python37\lib\site-packages\requests\sessions.py", line 622, in send
    r = adapter.send(request, **kwargs)
  File "C:\python37\lib\site-packages\requests\adapters.py", line 526, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='www.wikidata.org', po
rt=443): Read timed out. (read timeout=45)

 95.410s ERROR

======================================================================
ERROR: test_logevents (__main__.TestLogEvents)
Test logevents method.
----------------------------------------------------------------------
Traceback (most recent call last):
  File ".\tests\site_tests.py", line 1265, in test_logevents
    le = list(mysite.logevents(total=10))
  File "C:\pwb\GIT\core\pywikibot\data\api.py", line 2807, in __iter__
    self.data = self.request.submit()
  File "C:\pwb\GIT\core\pywikibot\data\api.py", line 1985, in submit
    paramstring)
  File "C:\pwb\GIT\core\pywikibot\data\api.py", line 1766, in _http_request
    self.wait()
  File "C:\pwb\GIT\core\pywikibot\data\api.py", line 2087, in wait
    raise TimeoutError('Maximum retries attempted without success.')
pywikibot.exceptions.TimeoutError: Maximum retries attempted without success.

----------------------------------------------------------------------
Ran 1 test in 96.030s

FAILED (errors=1)

C:\pwb\GIT\core>

Event Timeline

Xqt updated the task description. (Show Details)

Same problem for this simple statement:

s = pywikibot.Site('wikidata', 'wikidata')
list(s.logevents(user=s.user(), total=3))
Xqt changed the subtype of this task from "Task" to "Bug Report".Apr 22 2019, 3:18 PM
Anomie subscribed.

From the MediaWiki perspective, this is a duplicate of T220999: Slow query "ApiQueryLogEvents::execute" after actor rollout, which should roll out with the train next week unless someone backports it on Monday.

I'm going to close this as a duplicate since it doesn't seem there's anything for you to do in pywikibot about it, but feel free to reopen if you disagree.

Change 507244 had a related patch set uploaded (by Xqt; owner: Xqt):
[pywikibot/core@master] [tests] Temporary deactivate wikidata default site tests

https://gerrit.wikimedia.org/r/507244

Reopened to keep track of deactivating tests

Change 507244 merged by jenkins-bot:
[pywikibot/core@master] [tests] Temporary deactivate wikidata default site tests

https://gerrit.wikimedia.org/r/507244

Change 507245 had a related patch set uploaded (by Xqt; owner: Xqt):
[pywikibot/core@master] [tests] Revert "Temporary deactivate wikidata default site tests"

https://gerrit.wikimedia.org/r/507245

Xqt lowered the priority of this task from High to Low.Apr 30 2019, 5:56 AM
Xqt claimed this task.

Change 507245 merged by jenkins-bot:
[pywikibot/core@master] [tests] Revert "Temporary deactivate wikidata default site tests"

https://gerrit.wikimedia.org/r/507245