My apologies if this ticket comes as a surprise to you. In order to ensure WMCS can provide a stable, secure and supported platform, it’s important we migrate away from GridEngine. I want to assure you that while it is WMCS’s intention to shutdown GridEngine as outlined in the blog post https://techblog.wikimedia.org/2022/03/14/toolforge-and-grid-engine/, a shutdown date for GridEngine has not yet been set. The goal of the migration is to migrate as many tools as possible onto kubernetes and ensure as smooth a transition as possible for everyone. Once the majority of tools have migrated, discussion on a shutdown date is more appropriate. See T314664: [infra] Decommission the Grid Engine infrastructure.

As noted in https://techblog.wikimedia.org/2022/03/16/toolforge-gridengine-debian-10-buster-migration/ some use cases are already supported by kubernetes and should be migrated. If your tool can migrate, please do plan a migration. Reach out if you need help or find you are blocked by missing features. Most of all, WMCS is here to support you.

However, it’s possible your tool needs a mixed runtime environment or some other features that aren't yet present in https://techblog.wikimedia.org/2022/03/18/toolforge-jobs-framework/. We’d love to hear of this or any other blocking issues so we can work with you once a migration path is ready. Thanks for your hard work as volunteers and help in this migration!

I tried to migrate my script. As it requires the requests python package I needed to create a new venv. I followed the Instructions at https://wikitech.wikimedia.org/wiki/Help:Toolforge/Python#Kubernetes_python_jobs but when running the command "chmod ug+x bootstrap_venv.sh" I get the response "chmod: changing permissions of 'bootstrap_venv.sh': Operation not permitted". I am logged in as the tool(become toolname).

In T319602#8305687, @GPSLeo wrote:

I tried to migrate my script. As it requires the requests python package I needed to create a new venv. I followed the Instructions at https://wikitech.wikimedia.org/wiki/Help:Toolforge/Python#Kubernetes_python_jobs but when running the command "chmod ug+x bootstrap_venv.sh" I get the response "chmod: changing permissions of 'bootstrap_venv.sh': Operation not permitted". I am logged in as the tool(become toolname).

$ sudo become botleo
$ ls -alh bootstrap_venv.sh
-rw-r--r-- 1 gpsleo tools.botleo 294 Oct 10  2022 bootstrap_venv.sh

That file is owned by your user and not the tool. This is likely the result of copying files into the tool's $HOME via scp or similar means. We have a local take command that is meant to fix things like this:

$ take bootstrap_venv.sh
$ ls -alh bootstrap_venv.sh
-rw-r--r-- 1 tools.botleo tools.botleo 294 Oct 10  2022 bootstrap_venv.sh
$ chmod ug+x bootstrap_venv.sh
$ ls -alh bootstrap_venv.sh
-rwxr-xr-- 1 tools.botleo tools.botleo 294 Oct 10  2022 bootstrap_venv.sh

You should be set to continue on with your attempts now.

HI @GPSLeo, did you try again to migrate the tool? Are you finding any issues?

This tool has been disabled from running on the Grid.

If you are the maintainer and you want this re-enabled so that you can work on migrating it off the grid, please reach out to the cloud admins on the mailing list(cloud-admin@lists.wikimedia.org)

However, please note that according to the timeline shared, on the 14th of March 2024, the grid infrastructure will be shut down.