@jayvdb obviously the only common factor is that it fails on ar.wp because otherwise that isn't tested (because socketIO_client is not installed).

The only obvious reason I can think of is a lack of changes, but that's not very likely. The warning 'No handlers could be found for logger "socketIO_client"' should not be related (it's juts a message when something gets logged with socketIO_client as logger).

Is there a way to run tests with -debug, and to view the debug log?

It seems that on Python 3, pagegenerator_tests are not run at all: T86455: Pagegenerator_tests not run on Python 3

Okay, never mind. It's just skipped:

skipped 'socketIO_client not available'

https://travis-ci.org/wikimedia/pywikibot-core/jobs/45743556#L1031

@valhallasw: Afaik there were tests for Travis but because of security reasons that was removed again.

Would be interested if someone has that problem locally. I never had a stalled test because of it (although I test a lot on Python 3 where that test is skipped so I'm probably not testing it enough).

But it happens quite often on Travis so it should've affected others locally already (at least a few times). Isn't it multithreading? Maybe a deadlock?

In T85716#968702, @XZise wrote:

@jayvdb obviously the only common factor is that it fails on ar.wp because otherwise that isn't tested (because socketIO_client is not installed).

I think this test is also run on all setup.py tests (i.e. enwp and arwp.) It isnt using same flags as the script tests. It is just:

test_deps.extend(extra_deps['rcstream'])

Ah right I confused the script_deps as them because those are only installed on arwp.

Note that T85717 is about our undiagnosed test stalling problem; T85716 is about any diagnosed upstream bugs.

py3 builds skip this test because the released version doesnt import in py3

$ python3.4
Python 3.4.0 (default, Apr 11 2014, 13:05:18) 
[GCC 4.8.2] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import socketIO_client
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/local/lib/python3.4/dist-packages/socketIO_client/__init__.py", line 6, in <module>
    from urlparse import urlparse
ImportError: No module named 'urlparse'

The fix has been pulled three days ago:

https://github.com/invisibleroads/socketIO-client/pull/60

But that fix hasnt been released onto pypi:

https://pypi.python.org/pypi/socketIO-client

I believe they are gearing up to release a new version on pypi.

I couldnt see any open ticket about the remaining issue which hasnt disappeared, being that it is not yielding the expected number of items. e.g.
https://travis-ci.org/jayvdb/pywikibot-core/jobs/50748333
It has been doing that intermittently since T85717 was fixed.

Change 190719 had a related patch set uploaded (by Merlijn van Deen):
RCStream: Ignore changes after total is reached

https://gerrit.wikimedia.org/r/190719

Patch-For-Review

Change 190719 merged by jenkins-bot:
RCStream: Ignore changes after total is reached

https://gerrit.wikimedia.org/r/190719

py2.6 is broken by websocket-client

https://github.com/liris/websocket-client/issues/151

In T85716#1058115, @jayvdb wrote:

py2.6 is broken by websocket-client

https://github.com/liris/websocket-client/issues/151

and fixed!

Probably an upstream issue: T91961

It is sort of an upstream issue but with the requests dependency T91394. There is also another problem because since socketIO_client version 0.6.1 it (apparently) only supports socket.io protocol 1.0 while stream.wikimedia.org is using 0.9. That causes the 404 errors in the recent builds. When you install 0.5.5 (the version before that) it works. See also T91393.

Change 195537 had a related patch set uploaded (by XZise):
[FIX] socketIO: Use older version to support WMF

https://gerrit.wikimedia.org/r/195537

Change 195537 merged by jenkins-bot:
[FIX] socketIO: Use older version to support WMF

https://gerrit.wikimedia.org/r/195537

Change 203625 had a related patch set uploaded (by John Vandenberg):
test: skip test if socketIO-version >= 0.6.1

https://gerrit.wikimedia.org/r/203625

Change 203625 merged by jenkins-bot:
test: skip test if socketIO-version >= 0.6.1

https://gerrit.wikimedia.org/r/203625

This initial batch of upstream issues have all been merged upstream. No assignee, as there were many patches by various people, some patches sent upstream and some local. \o/

T91393 is still an outstanding issue.