I looked into this some time ago.

This should have been as easy as re-running the provisioning scripts, but it will not, for the reasons described in https://lists.wikimedia.org/pipermail/cloud/2019-February/000535.html Until now, our provisioning worked 'by accident', by virtue of the bastion hosts using the same Python runtime as the grid hosts, which will not be the case anymore.

Seems like we need to do this manually >_>

Did T216365 − worked fairly smoothly (albeit completely manual >_>)

Mentioned in SAL (#wikimedia-cloud) [2019-03-22T21:40:43Z] <Lokal_Profil> Manually starting harvesting job to ensure migration (T216364) worked

PHP API seems to be working fine.

Started a manual harvest to see if that will work.... it didn't.

I'm getting ImportError: No module named datetime as part of the attempt to import pywikibot. Manually importing pywikibot in the venv works fine though. I did note that runing pip list in the venv doesn't show the same pywikibot version as the one it attempts to install through our requirements file. I believe it's the local pywikibot copy which is interfering.

Similarly updating the statistics seems to fail Call to undefined function mysql_connect() in /mnt/nfs/labstore-secondary-tools-project/heritage/heritage/api/includes/Database.php:150

I kept the old venv in venv_trusty for now if we need to compare anything. It can be nuked when no longer needed.

Note that I dropped the -l release=trusty flag from the jsub job as I assume this is the grid being shut down.

mysql_connect() seems deprecated but we are running 5.6 just as before so not sure what would have caused the change.

I hit the datetime thing in the Python for wikiloves as well. I did the following steps on heritage:

• rm -rf .venv venv
• webservice --backend=kubernetes python2 shell
• ./bin/build-python.sh

Seems to have worked :)

Ah. Since I just renamed the old venv i missed the .venv.

Did this also make the statistics bit work?

In T216364#5052139, @Lokal_Profil wrote:

Did this also make the statistics bit work?

Is there anything left to do in this task?

Change 532253 had a related patch set uploaded (by Jean-Frédéric; owner: Jean-Frédéric):
[labs/tools/heritage@master] Base Python bot Dockerfile on debian:jessie instead of ubuntu

https://gerrit.wikimedia.org/r/532253

Change 532253 merged by jenkins-bot:
[labs/tools/heritage@master] Base Python bot Dockerfile on debian:jessie instead of ubuntu

https://gerrit.wikimedia.org/r/532253

Mentioned in SAL (#wikimedia-cloud) [2019-08-26T21:09:25Z] <JeanFred> Deploy latest from Git master: 0aac903, 1b3db24, cca0978, 88a754a, d93b940, a571c03, 1839191, 0591ddc, 6728961, f1e82c5, 222780b, 30813e8, e1a2422, 94ddd2d, c6f7694, e019c8a, 089ff87, 3efdc7e, 033ff27, f0fdecb, 2e35e27, ba68f7b, 975f530, 58c8f34, 8f30ee7 (T231152), a39179f, 00d50e0 (T216364), 0c0108e, afb11ea, ec66b4f, 8d23f1e,