Starting point will be to check if Python 2 packages listed in profile::analytics::cluster::packages::statistics are needed by our users or not. This task should also check if any python2-only-virtualenv-related package is needed by researchers/product-analysts.
Use cases:
- keras is not available for python3, on the other side scikit-learn is.
- tensorflow runs in both: https://www.tensorflow.org/install/pip?lang=python2#nav-buttons-1
- pytorch runs in both.
Packages to remove from puppet (python2 versions):
require_package ([
'virtualenv',
'libapache2-mod-python',
'python-mysqldb',
'python-boto',
'python-netaddr',
'python-pymysql',
'python-virtualenv',
'python-dev',
'python-protobuf',
'python-unidecode',
'python-oauth2client',
'python-oauthlib',
'python-requests-oauthlib',
'python-google-api',
])
require_package(
'ipython',
'python-sympy',
'python-matplotlib',
'python-tk',
'python-geoip',
'python-geoip2',
'python-pandas',
'python-pycountry',
'python-scipy',
'python-requests',
'python-dateutil',
'python-docopt',
'python-numpy',
'python-sklearn',
'python-yaml',
)Python2 packages currently installed on:
- stat1004
libpython-dev:amd64,libpython-stdlib:amd64,python-apt,python-apt-common,python-babel,python-babel-localedata,python-backports-shutil-get-terminal-size,python-blinker,python-boto,python-cffi-backend,python-chardet,python-concurrent.futures,python-configobj,python-configparser,python-confluent-kafka,python-cryptography,python-cycler,python-dateutil,python-dbus,python-debtcollector,python-decorator,python-dev,python-dnspython,python-docopt,python-docutils,python-enum34,python-etcd,python-funcsigs,python-functools32,python-geoip,python-geoip2,python-gevent,python-google-api,python-greenlet,python-httplib2,python-idna,python-ipaddress,python-ipython,python-ipython-genutils,python-iso8601,python-jinja2,python-joblib,python-jsonschema,python-jwt,python-kafka,python-kazoo,python-keyring,python-keystoneauth1,python-keystoneclient,python-lxml,python-markupsafe,python-matplotlib,python-matplotlib-data,python-maxminddb,python-minimal,python-mock,python-monotonic,python-mpmath,python-msgpack,python-mysqldb,python-netaddr,python-netifaces,python-numpy,python-oauth2client,python-oauthlib,python-openssl,python-oslo.config,python-oslo.i18n,python-oslo.serialization,python-oslo.utils,python-pandas,python-pandas-lib,python-pathlib2,python-pbr,python-pexpect,python-pickleshare,python-pip-whl,python-pkg-resources,python-positional,python-prometheus-client,python-prompt-toolkit,python-protobuf,python-psutil,python-ptyprocess,python-pyasn1,python-pyasn1-modules,python-pycountry,python-pygments,python-pykafka,python-pymysql,python-pyparsing,python-requests,python-requests-oauthlib,python-rfc3986,python-roman,python-rsa,python-scipy,python-secretstorage,python-setuptools,python-simplegeneric,python-six,python-sklearn,python-sklearn-lib,python-snappy,python-sqlalchemy,python-statsd,python-stevedore,python-subprocess32,python-swiftclient,python-sympy,python-tabulate,python-tk,python-traitlets,python-tz,python-ua-parser,python-unidecode,python-uritemplate,python-urllib3,python-virtualenv,python-wcwidth,python-wrapt,python-yaml,python-zmq
- notebook1003
libpython-dev:amd64,libpython-stdlib:amd64,python-apt,python-apt-common,python-babel-localedata,python-backports-shutil-get-terminal-size,python-blinker,python-boto,python-cffi-backend,python-chardet,python-concurrent.futures,python-configobj,python-configparser,python-confluent-kafka,python-cryptography,python-cycler,python-dateutil,python-decorator,python-dev,python-dnspython,python-docopt,python-enum34,python-etcd,python-funcsigs,python-functools32,python-geoip,python-geoip2,python-gevent,python-google-api,python-greenlet,python-httplib2,python-idna,python-ipaddress,python-ipython,python-ipython-genutils,python-jinja2,python-joblib,python-jsonschema,python-jwt,python-kafka,python-kazoo,python-lxml,python-markupsafe,python-matplotlib,python-matplotlib-data,python-maxminddb,python-minimal,python-mock,python-mpmath,python-mysqldb,python-netaddr,python-netifaces,python-numpy,python-oauth2client,python-oauthlib,python-openssl,python-pandas,python-pandas-lib,python-pathlib2,python-pbr,python-pexpect,python-pickleshare,python-pip-whl,python-pkg-resources,python-prometheus-client,python-prompt-toolkit,python-protobuf,python-psutil,python-ptyprocess,python-pyasn1,python-pyasn1-modules,python-pycountry,python-pygments,python-pykafka,python-pymysql,python-pyparsing,python-requests,python-requests-oauthlib,python-rsa,python-scipy,python-setuptools,python-simplegeneric,python-six,python-sklearn,python-sklearn-lib,python-snappy,python-sqlalchemy,python-statsd,python-subprocess32,python-sympy,python-tabulate,python-tk,python-traitlets,python-tz,python-ua-parser,python-unidecode,python-uritemplate,python-urllib3,python-virtualenv,python-wcwidth,python-yaml,python-zmq,