BUB 503: AttributeError: 'module' object has no attribute 'python_2_unicode_compatible'
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Nemo_bis
	Sep 1 2016, 9:56 PM

Description

https://tools.wmflabs.org/bub/ 503s. Reported by https://twitter.com/giovannidamiola/status/771448122371219456

tools.bub@tools-bastion-03:~$ webservice start
Traceback (most recent call last):
  File "/usr/local/bin/webservice", line 7, in <module>
    from toollabs.webservice.backends import Backend, GridEngineBackend, KubernetesBackend
  File "/usr/lib/python2.7/dist-packages/toollabs/webservice/backends/__init__.py", line 3, in <module>
    from toollabs.webservice.backends.kubernetesbackend import KubernetesBackend
  File "/usr/lib/python2.7/dist-packages/toollabs/webservice/backends/kubernetesbackend.py", line 3, in <module>
    import pykube
  File "/usr/lib/python2.7/dist-packages/pykube/__init__.py", line 8, in <module>
    from .objects import (  # noqa
  File "/usr/lib/python2.7/dist-packages/pykube/objects.py", line 16, in <module>
    @six.python_2_unicode_compatible
AttributeError: 'module' object has no attribute 'python_2_unicode_compatible'

Related Objects

Mentioned In: T147350: Change Python hashbang to `#! /usr/bin/env python -E -s` for user-facing tools
Mentioned Here: T147350: Change Python hashbang to `#! /usr/bin/env python -E -s` for user-facing tools

Event Timeline

Nemo_bis created this task.Sep 1 2016, 9:56 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptSep 1 2016, 9:56 PM

Nemo_bis renamed this task from AttributeError: 'module' object has no attribute 'python_2_unicode_compatible' to BUB 503: AttributeError: 'module' object has no attribute 'python_2_unicode_compatible'.Sep 2 2016, 7:48 AM

Nemo_bis updated the task description. (Show Details)

BUB has been down for almost one month now due to this Labs bug.

This is because the user seems to have modified their PYTHONPATH in their bashrc to something else:

tools.bub@tools-bastion-03:~$ echo $PYTHONPATH
:/data/project/bub/public_html/BUB/digi-lib:/data/project/bub/public_html/BUB/utils

Default changes to PYTHONPATH will cause system python scripts / libraries to stop working, as you can see. Please reset that and it should work fine.

zhuyifei1999 subscribed.Sep 27 2016, 5:55 AM

Yann subscribed.Sep 28 2016, 9:09 PM

valhallasw mentioned this in T147350: Change Python hashbang to `#! /usr/bin/env python -E -s` for user-facing tools.Oct 4 2016, 7:52 PM

If you don't want to remove your PYTHONPATH setting, you can use

python -E -s `which webservice` start

instead. I've done so for you now.

This just happened again. One of the maintainers needs to sort out the PYTHONPATH issue :)

yuvipanda reopened this task as Open.Nov 21 2016, 11:00 PM

scfc merged a task: T131700: jsub/jstart take 60 s due to /usr/local/bin/log-command-invocation CPU hunger.Dec 5 2016, 5:00 AM

scfc added a subscriber: • chasemp.

The long invocation time for jsub, webservice, etc. comes IMHO as a side-effect of this task (or T147350 for the general case); example:

tools.bub@tools-services-02:~$ time webservice restart
Traceback (most recent call last):
  File "/usr/local/bin/webservice", line 7, in <module>
    from toollabs.webservice.backends import Backend, GridEngineBackend, KubernetesBackend
  File "/usr/lib/python2.7/dist-packages/toollabs/webservice/backends/__init__.py", line 3, in <module>
    from toollabs.webservice.backends.kubernetesbackend import KubernetesBackend
  File "/usr/lib/python2.7/dist-packages/toollabs/webservice/backends/kubernetesbackend.py", line 3, in <module>
    import pykube
  File "/usr/lib/python2.7/dist-packages/pykube/__init__.py", line 8, in <module>
    from .objects import (  # noqa
  File "/usr/lib/python2.7/dist-packages/pykube/objects.py", line 16, in <module>
    @six.python_2_unicode_compatible
AttributeError: 'module' object has no attribute 'python_2_unicode_compatible'

real    1m44.094s
user    0m0.323s
sys     0m7.950s
tools.bub@tools-services-02:~$ time python -E -s `which webservice` restart
Your job is not running, starting.

real    0m1.692s
user    0m0.186s
sys     0m0.151s
tools.bub@tools-services-02:~$

This works now thanks to T147350:

tools.bub@tools-bastion-03:~$ time webservice restart
Restarting webservice...............

real    0m17.059s
user    0m0.354s
sys     0m0.400s
tools.bub@tools-bastion-03:~$

I had initially read:

In T144554#2659470, @yuvipanda wrote:
This is because the user seems to have modified their PYTHONPATH in their bashrc to something else:
tools.bub@tools-bastion-03:~$ echo $PYTHONPATH
:/data/project/bub/public_html/BUB/digi-lib:/data/project/bub/public_html/BUB/utils
Default changes to PYTHONPATH will cause system python scripts / libraries to stop working, as you can see. Please reset that and it should work fine.

to mean that all changes to PYTHONPATH cause failures. That was apparently not the problem here: Calling the old webservice with PYTHONPATH unset exhibited the same behaviour. The problem was caused by user-installed Python modules like /data/project/bub/.local/lib/python2.7/site-packages/six-1.4.1-py2.7.egg that shadowed the system module python-six 1.9.0-1~trusty1, used by python-pykube. So the part of T147350 that fixed this issue was #!/usr/bin/python -s, not #!/usr/bin/python -E.

Restricted Application added a project: User-bd808. · View Herald TranscriptDec 7 2016, 1:23 AM

bd808 moved this task from To Do to Done on the User-bd808 board.Jan 7 2017, 12:19 AM

bd808 moved this task from Done to Archive on the User-bd808 board.Jan 7 2017, 12:21 AM

• Phabricator_maintenance removed a subscriber: yuvipanda.Jun 7 2017, 6:40 PM

BUB 503: AttributeError: 'module' object has no attribute 'python_2_unicode_compatible'Closed, ResolvedPublicActions

Description

Related Objects

Event Timeline

BUB 503: AttributeError: 'module' object has no attribute 'python_2_unicode_compatible'
Closed, ResolvedPublic
Actions