Page MenuHomePhabricator

multiprocessor nosetests don't work
Closed, DeclinedPublic

Description

I've tried various settings of _multiprocess_can_split_ and _multiprocess_shared_ ; all result in the following.

$ nosetests-3.3 --processes=2 --process-timeout=20 --process-restartworker -v tests.wikibase_tests.TestJSON

test_itempage_json (tests.wikibase_tests.TestJSON) ... ERROR
test_json_diff (tests.wikibase_tests.TestJSON) ... ERROR

ERROR: test_itempage_json (tests.wikibase_tests.TestJSON)

Traceback (most recent call last):

File "/usr/lib/python3.3/site-packages/nose/plugins/multiprocess.py", line 812, in run
  test(orig)
File "/usr/lib/python3.3/site-packages/nose/case.py", line 46, in __call__
  return self.run(*arg, **kwarg)
File "/usr/lib/python3.3/site-packages/nose/case.py", line 134, in run
  self.runTest(result)
File "/usr/lib/python3.3/site-packages/nose/case.py", line 152, in runTest
  test(result)
File "/usr/lib64/python3.3/unittest/case.py", line 529, in __call__
  return self.run(*args, **kwds)
File "/usr/lib64/python3.3/unittest/case.py", line 475, in run
  self._executeTestPart(self.setUp, outcome)
File "/usr/lib64/python3.3/unittest/case.py", line 422, in _executeTestPart
  function()
File ".../tests/wikibase_tests.py", line 895, in setUp
  self.wdp = pywikibot.ItemPage(wikidata, 'Q60')
File ".../pywikibot/page.py", line 3087, in __init__
  ns=site.item_namespace)
File ".../pywikibot/site.py", line 4887, in item_namespace
  self._cache_entity_namespaces()
File ".../pywikibot/site.py", line 4868, in _cache_entity_namespaces
  for namespace in self.namespaces().values():
File ".../pywikibot/site.py", line 2149, in namespaces
  self._build_namespaces()
File ".../pywikibot/site.py", line 2010, in _build_namespaces
  is_mw114 = LV(self.version()) >= LV('1.14')
File ".../pywikibot/site.py", line 2094, in version
  version = self.siteinfo.get('generator', expiry=1).split(' ')[1]
File ".../pywikibot/site.py", line 1192, in get
  preloaded = self._get_general(key, expiry)
File ".../pywikibot/site.py", line 1138, in _get_general
  default_info = self._get_siteinfo(props, expiry)
File ".../pywikibot/site.py", line 1066, in _get_siteinfo
  data = request.submit()
File ".../pywikibot/data/api.py", line 828, in submit
  self._data = super(CachedRequest, self).submit()
File ".../pywikibot/data/api.py", line 584, in submit
  headers=headers, body=body)
File ".../pywikibot/tools.py", line 529, in wrapper
  return obj(*__args, **__kw)
File ".../pywikibot/comms/http.py", line 249, in request
  time.sleep(0.1)
File "/usr/lib/python3.3/site-packages/nose/plugins/multiprocess.py", line 276, in signalhandler
  raise TimedOutException()

nose.plugins.multiprocess.TimedOutException: 'test_itempage_json (tests.wikibase_tests.TestJSON)'

ERROR: test_json_diff (tests.wikibase_tests.TestJSON)

Traceback (most recent call last):

File ".../tests/wikibase_tests.py", line 895, in setUp
  self.wdp = pywikibot.ItemPage(wikidata, 'Q60')
File ".../pywikibot/page.py", line 3087, in __init__
  ns=site.item_namespace)
File ".../pywikibot/site.py", line 4894, in item_namespace
  % self)

pywikibot.exceptions.EntityTypeUnknownException: DataSite("wikidata", "wikidata") does not support entity type "item"


Ran 2 tests in 20.152s

FAILED (errors=2)


Version: core-(2.0)
Severity: minor
URL: http://nose.readthedocs.org/en/latest/plugins/multiprocess.html

Details

Reference
bz72609

Event Timeline

bzimport raised the priority of this task from to Needs Triage.Nov 22 2014, 3:56 AM
bzimport added a project: Pywikibot-tests.
bzimport set Reference to bz72609.
bzimport added a subscriber: Unknown Object (????).

The timeout is probably another import deadlock. We should really kill our homebuilt http machinery...

Enterprisey renamed this task from multiprocessor nosetests doesnt work to multiprocessor nosetests don't work.Nov 30 2014, 12:42 AM
Enterprisey set Security to None.
Enterprisey removed a subscriber: Unknown Object (????).