Page MenuHomePhabricator

ores-beta is down
Closed, ResolvedPublic

Description

ores-beta.wmflabs.org gives 500 now.
Service is up but logs says "--- no python application found, check your startup logs for errors ---"
And in syslog:

May 18 19:50:40 deployment-ores-web uwsgi[29525]: Traceback (most recent call last):
May 18 19:50:40 deployment-ores-web uwsgi[29525]: File "/srv/deployment/ores/deploy/ores_wsgi.py", line 21, in <module>
May 18 19:50:40 deployment-ores-web uwsgi[29525]: application = server.configure(config)
May 18 19:50:40 deployment-ores-web uwsgi[29525]: File "./ores/wsgi/server.py", line 23, in configure
May 18 19:50:41 deployment-ores-web uwsgi[29525]: score_processor = ScoreProcessor.from_config(config, sp_name)
May 18 19:50:41 deployment-ores-web uwsgi[29525]: File "./ores/score_processors/score_processor.py", line 158, in from_config
May 18 19:50:41 deployment-ores-web uwsgi[29525]: return Class.from_config(config, name)
May 18 19:50:41 deployment-ores-web uwsgi[29525]: File "./ores/score_processors/celery.py", line 233, in from_config
May 18 19:50:41 deployment-ores-web uwsgi[29525]: for name in section['scoring_contexts']}
May 18 19:50:41 deployment-ores-web uwsgi[29525]: File "./ores/score_processors/celery.py", line 233, in <dictcomp>
May 18 19:50:41 deployment-ores-web uwsgi[29525]: for name in section['scoring_contexts']}
May 18 19:50:41 deployment-ores-web uwsgi[29525]: File "./ores/scoring_contexts/scoring_context.py", line 141, in from_config
May 18 19:50:41 deployment-ores-web uwsgi[29525]: scorer_model = ScorerModel.from_config(config, key)
May 18 19:50:41 deployment-ores-web uwsgi[29525]: File "/srv/ores/venv/lib/python3.4/site-packages/revscoring/scorer_models/scorer_model.py", line 96, in from_config
May 18 19:50:41 deployment-ores-web uwsgi[29525]: File "/srv/ores/venv/lib/python3.4/site-packages/revscoring/scorer_models/scorer_model.py", line 160, in from_config
May 18 19:50:41 deployment-ores-web uwsgi[29525]: File "/srv/ores/venv/lib/python3.4/site-packages/revscoring/scorer_models/scorer_model.py", line 73, in load
May 18 19:50:41 deployment-ores-web uwsgi[29525]: ImportError: No module named 'revscoring.features.wikibase'

Related Objects

StatusSubtypeAssignedTask
ResolvedLadsgroup
ResolvedLadsgroup

Event Timeline

Super sleepy now but I'll take a look at it soon-ish

halfak@deployment-ores-web:/srv$ source ores/venv/bin/activate
(venv)halfak@deployment-ores-web:/srv$ python
Python 3.4.2 (default, Oct  8 2014, 10:45:20) 
[GCC 4.9.1] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import revscoring
>>> revscoring.__version__
'1.2.4'
>>> from revscoring.features import wikibase
>>>
(venv)halfak@deployment-ores-web:/srv/deployment/ores/deploy$ python
Python 3.4.2 (default, Oct  8 2014, 10:45:20) 
[GCC 4.9.1] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> from revscoring.scorer_models import MLScorerModel
>>> model = MLScorerModel.load(open("submodules/editquality/models/wikidatawiki.damaging.gradient_boosting.model"))
>>>

It brought back up by simply a manual restart. Per what I can see, the restart was made too soon.

With b633f87, we moved forward but still Scap doesn't understand sort of checks. Per my discussion with @thcipriani in IRC today, I want to make this explicit in the scap3 itself.