Maniphest T319823

Migrate itnsyn from Toolforge GridEngine to Toolforge Kubernetes
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	komla
	Oct 6 2022, 8:02 PM

Description

Kindly migrate your tool(https://grid-deprecation.toolforge.org/t/itnsyn) from Toolforge GridEngine to Toolforge Kubernetes.

Toolforge GridEngine is getting deprecated.
See: https://techblog.wikimedia.org/2022/03/14/toolforge-and-grid-engine/

Please note that a volunteer may perform this migration if this has not been done after some time.
If you have already migrated this tool, kindly mark this as resolved.

If you would rather shut down this tool, kindly do so and mark this as resolved.

Useful Resources:
Migrating Jobs from GridEngine to Kubernetes
https://wikitech.wikimedia.org/wiki/Help:Toolforge/Jobs_framework#Grid_Engine_migration
Migrating Web Services from GridEngine to Kubernetes
https://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#Move_a_grid_engine_webservice
Python
https://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#Rebuild_virtualenv_for_python_users

Related Objects
Search...

Status	Assigned	Task
Resolved	Shizhao	T332477 Migrate Shizhao's tools from Toolforge GridEngine to Toolforge Kubernetes
Resolved	Shizhao	T319823 Migrate itnsyn from Toolforge GridEngine to Toolforge Kubernetes
Invalid	None	T332571 Request increased quota for itnsyn Toolforge tool

Event Timeline

komla created this task.Oct 6 2022, 8:02 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptOct 6 2022, 8:02 PM

My apologies if this ticket comes as a surprise to you. In order to ensure WMCS can provide a stable, secure and supported platform, it’s important we migrate away from GridEngine. I want to assure you that while it is WMCS’s intention to shutdown GridEngine as outlined in the blog post https://techblog.wikimedia.org/2022/03/14/toolforge-and-grid-engine/, a shutdown date for GridEngine has not yet been set. The goal of the migration is to migrate as many tools as possible onto kubernetes and ensure as smooth a transition as possible for everyone. Once the majority of tools have migrated, discussion on a shutdown date is more appropriate. See T314664: [infra] Decommission the Grid Engine infrastructure.

As noted in https://techblog.wikimedia.org/2022/03/16/toolforge-gridengine-debian-10-buster-migration/ some use cases are already supported by kubernetes and should be migrated. If your tool can migrate, please do plan a migration. Reach out if you need help or find you are blocked by missing features. Most of all, WMCS is here to support you.

However, it’s possible your tool needs a mixed runtime environment or some other features that aren't yet present in https://techblog.wikimedia.org/2022/03/18/toolforge-jobs-framework/. We’d love to hear of this or any other blocking issues so we can work with you once a migration path is ready. Thanks for your hard work as volunteers and help in this migration!

Shizhao mentioned this in T332477: Migrate Shizhao's tools from Toolforge GridEngine to Toolforge Kubernetes.Mar 18 2023, 3:00 PM

JJMC89 added a parent task: T332477: Migrate Shizhao's tools from Toolforge GridEngine to Toolforge Kubernetes.Mar 19 2023, 5:10 PM

tools.itnsyn@tools-sgebastion-10:~$ toolforge-jobs list
Job name:    Job type:              Status:
-----------  ---------------------  -------------------------------------
setup-venv   normal                 Unable to start, out of quota for cpu

Has been in this state for more than 12 hours...

Shizhao added a comment.Mar 20 2023, 8:02 AM

This comment was removed by Shizhao.

run toolforge-jobs flush
rerun toolforge-jobs run setup-venv --command $HOME/pwb_venv.sh --image python3.9 --wait

still “out of quota for cpu”

tools.itnsyn@tools-sgebastion-10:~$ toolforge-jobs list
Job name:    Job type:    Status:
-----------  -----------  -------------------------------------
setup-venv   normal       Unable to start, out of quota for cpu

ref https://wikitech.wikimedia.org/wiki/Help:Toolforge/Pywikibot

在T319823#8708722中，@Shizhao写道：

run toolforge-jobs flush

rerun toolforge-jobs run setup-venv --command $HOME/pwb_venv.sh --image python3.9 --wait

still “out of quota for cpu”

After stop webservice, run job, work ok.

It seems that if I run webservice and job at the same time, I may exceed the CPU quota?
For this tool account, I need to run 1 webservice and run 2 jobs regularly...

May require Toolforge (Quota-requests) ?

Shizhao mentioned this in T332571: Request increased quota for itnsyn Toolforge tool.Mar 20 2023, 12:38 PM

Shizhao added a subtask: T332571: Request increased quota for itnsyn Toolforge tool.

Shizhao changed the task status from Open to Stalled.Mar 20 2023, 12:42 PM

Shizhao claimed this task.

komla moved this task from Backlog to Open Question on the Grid-Engine-to-K8s-Migration board.Mar 20 2023, 11:43 PM

Current migration status: T332571#8710328