Phe's Match&Split bot shows as "match_and_split robot is not running. Please try again later."
https://phetools.toolforge.org/match_and_split.php
It was slowly grinding to a halt yesterday (possibly coincident with the MW deploy train hitting the Wikisourcen), and has been completely down all day today.
Could someone with tool access give it a little kick?
@Aklapper Indeed. Community-Tech was added as their Toolforge group account is one of the four accounts set as admin for the phetools Toolforge project.
I think we're only concerned with phetools/credits.py because it is used by WS Export. I'm afraid we can't help with the issue here. Sorry!
@Candalua That leaves you as the only admin on phetools with any likelihood of having the spare cycles to look at this (Phe and Tpt are highly unlikely to be available for this any time soon). Any chance you could poke around here a bit?
Alternately, could you give me a pointer on the process you followed to be added to the project? While PHP and Python aren't quite my cuppa, I can certainly do basic *nix debugging and HUP any process that needs a kick (“This is how we fix problem on Russian space station!”).
@Xover I'm not familiar with the match&split tool, normally I just tend to the statistics tool. However I added you to the project, any help that you can contribute is more than welcome.
@Candalua Thanks!
I took a quick peek and it looks like the problem is that pywikibot (which match_and_split.py imports) was updated to a version that requires Python 3.x on October 1st, and the phetools codebase is executing under Python 2.x. The code uses syntax that Python 3.x chokes on, so we can't simply sub in python3 in phe/run_service.sh.
I'll try to dig a bit further tomorrow and see if there are any workarounds short of porting phetools to Python 3.x wholesale.
The quickest fix would be to use the py2 version of pywikibot.
For Toolforge shared: Instead of using /shared/pywikibot/core_stable [most recent release] (or /shared/pywikibot/core [nightly updates from master]) use /shared/pywikibot/core_python2 [final python2 release].
For other sources: use a version < 4.0
@JJMC89 Thanks!
I switched the environment to point at /shared/pywikibot/core_python2 and that seems to have been sufficient for match_and_split, but the codebase for all the tools is pretty tightly integrated so it may yet turn out that this breaks other parts of phetools.
In particular, phetools was using a local copy of httplib2 whose provenance I am uncertain of (it now uses the system-provided version); and a local copy of the pywikibot scripts/ directory that may or may not have local modifications.
I'll try to do some testing on the other components to verify that they too work with this change.
This task is strictly speaking stale: the problem here was fixed a long time ago, then Match&Split broke again due to T280806, and has now been ported (more or less) to Pywikibot 6.x and Python 3. And while my ability to commit to owning phetools in toto is limited, I now have access to the tools account and have dug around in the code enough that if anything breaks then please tag me in and I'll see what I can do.