Page MenuHomePhabricator

migrate Pywikibot from Toolforge Stretch Grid Engine to Toolforge Kubernetes
Closed, ResolvedPublic

Description

Hello,

We are reaching out to you because you are listed as one of the maintainers of PYWIKIBOT project.

We announced earlier[0] that long term support for Debian Stretch will cease in June, 2022.
We therefore need to shut down all Stretch hosts including Stretch Grid Engine before the end of support date to ensure that Toolforge remains a secure platform.

You should move the PYWIKIBOT project away from Stretch Grid Engine before the deadline[1]
You have two options:

  • migrate from Toolforge Stretch Grid Engine to Toolforge Kubernetes[2].
  • migrate from Toolforge Stretch Grid Engine to Toolforge Buster Grid Engine.[3]

You should be aware that our ultimate goal is to deprecate Grid Engine
entirely and replace it with Kubernetes, so we encourage you to move to Kubernetes if you can.

We have also published a series of blogposts explaining further the reasoning behind this action[4]

If you have any peculiar challenges that prevent you from migrating away from Stretch, kindly share this here.
You can also reach out via any of our communication channels[5]

[0] https://lists.wikimedia.org/hyperkitty/list/cloud-announce@lists.wikimedia.org/thread/EPJFISC52T7OOEFH5YYMZNL57O4VGSPR/
[1] https://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#Timeline
[2] https://wikitech.wikimedia.org/wiki/News/Toolforge_Stretch_deprecation#Move_a_grid_engine_webservice
[3] https://wikitech.wikimedia.org/wiki/Help:Toolforge/Jobs_framework#Grid_Engine_migration
[4] https://techblog.wikimedia.org/2022/03/14/toolforge-and-grid-engine/
[5] https://wikitech.wikimedia.org/wiki/Portal:Toolforge/About_Toolforge#Communication_and_support

Thanks

Seyram Komla Sapaty
Developer Advocate
Wikimedia Cloud Services

Event Timeline

I am not very familiar with toolforge and linux. Can someone take over?

It looks like I managed to launch pywikibot on Kubernetes, special thanks to @JJMC89.

I have added some examples to the help page:
https://wikitech.wikimedia.org/w/index.php?title=Help%3AToolforge%2FPywikibot&type=revision&diff=1967824&oldid=1954677

It looks like I managed to launch pywikibot on Kubernetes, special thanks to @JJMC89.

That's really great. Many thanks. Is the web page published by Kubernetes then?
https://pywikibot.toolforge.org/

It looks like I managed to launch pywikibot on Kubernetes, special thanks to @JJMC89.

That's really great. Many thanks. Is the web page published by Kubernetes then?
https://pywikibot.toolforge.org/

I don’t have access to pywikibot project as I remember, can’t check it.

I was talking about migrating in principle and the way to do it

FWIW, pywikibot project being on grid engine has nothing to do with being able to run pywikibot in k8s in toolforge. It builds some set of tools to build nightly downloadable tarballs and other stuff. It doesn't run pywikibot per se.

FWIW, pywikibot project being on grid engine has nothing to do with being able to run pywikibot in k8s in toolforge. It builds some set of tools to build nightly downloadable tarballs and other stuff. It doesn't run pywikibot per se.

You are right.
I just used this topic as I think most of the pywikibot owners on toolforge got the same message and I wasn’t able to find any manual

Xqt triaged this task as Low priority.Apr 16 2022, 6:16 AM
Xqt raised the priority of this task from Low to Medium.May 9 2022, 4:50 AM
Xqt claimed this task.

Pywikibot runs on Buster now which is enough.

Looking forward the T249787 to solving this issue.