When I follow these instructions (either for Python 3.7 or Python 3.5), I get the following error when I attempt to install the fastText package. The likely issue with this package is that it requires the "right" C++ compiler: https://github.com/facebookresearch/fastText/blob/master/README.md#requirements. Based on what I'm seeing in the error output below and from some searching, I'd also guess that the issue is the C++ compiling (but obviously I could be wrong).
This is for the wiki-topic tool: https://tools.wmflabs.org/admin/tool/wiki-topic
Notably, I did have fastText installed and working in my virtualenv that I set up back in the Fall. I can't be certain anymore what that environment was, but it likely would have been whatever was default back then.
Error output:
(venv) tools.wiki-topic@interactive:~$ pip install fasttext Collecting fasttext Using cached fasttext-0.9.2.tar.gz (68 kB) Collecting numpy Downloading numpy-1.18.4-cp35-cp35m-manylinux1_x86_64.whl (20.0 MB) |████████████████████████████████| 20.0 MB 25 kB/s Requirement already satisfied: pybind11>=2.2 in ./www/python/venv/lib/python3.5/site-packages (from fasttext) (2.5.0) Requirement already satisfied: setuptools>=0.7.0 in ./www/python/venv/lib/python3.5/site-packages (from fasttext) (33.1.1) Building wheels for collected packages: fasttext Building wheel for fasttext (setup.py) ... error ERROR: Command errored out with exit status 1: command: /data/project/wiki-topic/www/python/venv/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-rg55f9c8/fasttext/setup.py'"'"'; __file__='"'"'/tmp/pip-install-rg55f9c8/fasttext/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-imv3npxt cwd: /tmp/pip-install-rg55f9c8/fasttext/ Complete output (43 lines): running bdist_wheel running build running build_py creating build creating build/lib.linux-x86_64-3.5 creating build/lib.linux-x86_64-3.5/fasttext copying python/fasttext_module/fasttext/__init__.py -> build/lib.linux-x86_64-3.5/fasttext copying python/fasttext_module/fasttext/FastText.py -> build/lib.linux-x86_64-3.5/fasttext creating build/lib.linux-x86_64-3.5/fasttext/util copying python/fasttext_module/fasttext/util/util.py -> build/lib.linux-x86_64-3.5/fasttext/util copying python/fasttext_module/fasttext/util/__init__.py -> build/lib.linux-x86_64-3.5/fasttext/util creating build/lib.linux-x86_64-3.5/fasttext/tests copying python/fasttext_module/fasttext/tests/test_script.py -> build/lib.linux-x86_64-3.5/fasttext/tests copying python/fasttext_module/fasttext/tests/test_configurations.py -> build/lib.linux-x86_64-3.5/fasttext/tests copying python/fasttext_module/fasttext/tests/__init__.py -> build/lib.linux-x86_64-3.5/fasttext/tests running build_ext creating tmp x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -g -fdebug-prefix-map=/build/python3.5-3.5.3=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/data/project/wiki-topic/www/python/venv/include -I/usr/include/python3.5m -c /tmp/tmptzto_aap.cpp -o tmp/tmptzto_aap.o -std=c++14 cc1plus: warning: command line option ‘-Wstrict-prototypes’ is valid for C/ObjC but not for C++ x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -g -fdebug-prefix-map=/build/python3.5-3.5.3=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/data/project/wiki-topic/www/python/venv/include -I/usr/include/python3.5m -c /tmp/tmp1qswjr6z.cpp -o tmp/tmp1qswjr6z.o -fvisibility=hidden cc1plus: warning: command line option ‘-Wstrict-prototypes’ is valid for C/ObjC but not for C++ building 'fasttext_pybind' extension creating build/temp.linux-x86_64-3.5 creating build/temp.linux-x86_64-3.5/python creating build/temp.linux-x86_64-3.5/python/fasttext_module creating build/temp.linux-x86_64-3.5/python/fasttext_module/fasttext creating build/temp.linux-x86_64-3.5/python/fasttext_module/fasttext/pybind creating build/temp.linux-x86_64-3.5/src x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -g -fdebug-prefix-map=/build/python3.5-3.5.3=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/data/project/wiki-topic/www/python/venv/lib/python3.5/site-packages/pybind11/include -I/data/project/wiki-topic/www/python/venv/lib/python3.5/site-packages/pybind11/include -Isrc -I/data/project/wiki-topic/www/python/venv/include -I/usr/include/python3.5m -c python/fasttext_module/fasttext/pybind/fasttext_pybind.cc -o build/temp.linux-x86_64-3.5/python/fasttext_module/fasttext/pybind/fasttext_pybind.o -DVERSION_INFO="0.9.2" -std=c++14 -fvisibility=hidden cc1plus: warning: command line option ‘-Wstrict-prototypes’ is valid for C/ObjC but not for C++ python/fasttext_module/fasttext/pybind/fasttext_pybind.cc: In lambda function: python/fasttext_module/fasttext/pybind/fasttext_pybind.cc:345:35: warning: comparison between signed and unsigned integer expressions [-Wsign-compare] for (int32_t i = 0; i < vocab_freq.size(); i++) { ~~^~~~~~~~~~~~~~~~~~~ python/fasttext_module/fasttext/pybind/fasttext_pybind.cc: In lambda function: python/fasttext_module/fasttext/pybind/fasttext_pybind.cc:359:35: warning: comparison between signed and unsigned integer expressions [-Wsign-compare] for (int32_t i = 0; i < labels_freq.size(); i++) { ~~^~~~~~~~~~~~~~~~~~~~ x86_64-linux-gnu-gcc: internal compiler error: Killed (program cc1plus) Please submit a full bug report, with preprocessed source if appropriate. See <file:///usr/share/doc/gcc-6/README.Bugs> for instructions. error: command 'x86_64-linux-gnu-gcc' failed with exit status 4 ---------------------------------------- ERROR: Failed building wheel for fasttext