Work out how we're going to have "production-like" versions of the wikifunctions evaluator and orchestrator services in Beta Cluster
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Jdforrester-WMF
	Aug 19 2021, 10:01 PM

Description

A large part of these services' design is around their k8s-ness, which is absent in Beta Cluster, so we'll probably have to do something else (unless a k8s-on-Beta-Cluster option is going to be built?).

Details

Subject	Repo	Branch	Lines +/-
Initial Beta Cluster deployment of Wikifunctions: IV - IS-Labs	operations/mediawiki-config	master	+6 -0
Initial Beta Cluster deployment of Wikifunctions: III - CS	operations/mediawiki-config	master	+19 -8
Initial Beta Cluster deployment of Wikifunctions: II - Services	operations/mediawiki-config	master	+9 -1
Initial Beta Cluster deployment of Wikifunctions: I - IS	operations/mediawiki-config	master	+5 -0

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Resolved	DVrandecic	T261469 Launch demonstration system
Resolved	• Gilles	T261341 Performance review of Wikifunctions
Resolved	ori	T284162 Create a Beta Cluster version of Wikifunctions.org
Resolved	Jdforrester-WMF	T289315 Work out how we're going to have "production-like" versions of the wikifunctions evaluator and orchestrator services in Beta Cluster
Invalid	None	T295477 Request creation of deployment-prep-k8s VPS project

Event Timeline

Jdforrester-WMF created this task.Aug 19 2021, 10:01 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptAug 19 2021, 10:01 PM

Jdforrester-WMF moved this task from Phase ζ to Launch Beta Cluster wikifunctions.org on the Abstract Wikipedia team board.Aug 20 2021, 4:04 PM

Jdforrester-WMF edited projects, added Abstract Wikipedia team; removed Abstract Wikipedia team (Phase ζ).

Jdforrester-WMF triaged this task as High priority.Sep 8 2021, 4:20 PM

OK, so my not-very-high-end plan is to have a Toolforge account, wikilambda-beta, in which an orchestrator and evaluator are continuously running and updated to HEAD, and which are pointed at by the default extension configuration. This way local developers, CI, and the Beta Cluster will all use these services 'out of the box'.

Jdforrester-WMF claimed this task.Nov 5 2021, 6:58 PM

In T289315#7486318, @Jdforrester-WMF wrote:

OK, so my not-very-high-end plan is to have a Toolforge account, wikilambda-beta, in which an orchestrator and evaluator are continuously running and updated to HEAD, and which are pointed at by the default extension configuration. This way local developers, CI, and the Beta Cluster will all use these services 'out of the box'.

Having a tool with a by-desing RCE feature would likely violate Toolforge rule #6.

In T289315#7486337, @Majavah wrote:

In T289315#7486318, @Jdforrester-WMF wrote:

OK, so my not-very-high-end plan is to have a Toolforge account, wikilambda-beta, in which an orchestrator and evaluator are continuously running and updated to HEAD, and which are pointed at by the default extension configuration. This way local developers, CI, and the Beta Cluster will all use these services 'out of the box'.

Having a tool with a by-desing RCE feature would likely violate Toolforge rule #6.

OK, a WMCS service then, and we'll have to build the whole k8s cluster too. Ah well.

Filed as T295477: Request creation of deployment-prep-k8s VPS project.

Jdforrester-WMF added a subtask: T295477: Request creation of deployment-prep-k8s VPS project.Nov 10 2021, 3:19 PM

Jdforrester-WMF closed subtask T295477: Request creation of deployment-prep-k8s VPS project as Invalid.Nov 12 2021, 5:45 PM

Mentioned in SAL (#wikimedia-releng) [2021-11-16T17:32:00Z] <James_F> Added deployment-docker-wikifunctions01 to deployment-prep for T289315

Change 740791 had a related patch set uploaded (by Jforrester; author: Jforrester):

[operations/mediawiki-config@master] Initial Beta Cluster deployment of Wikifunctions: I - IS

https://gerrit.wikimedia.org/r/740791

Change 740792 had a related patch set uploaded (by Jforrester; author: Jforrester):

[operations/mediawiki-config@master] Initial Beta Cluster deployment of Wikifunctions: II - Services

https://gerrit.wikimedia.org/r/740792

Change 740793 had a related patch set uploaded (by Jforrester; author: Jforrester):

[operations/mediawiki-config@master] Initial Beta Cluster deployment of Wikifunctions: III - CS

https://gerrit.wikimedia.org/r/740793

Change 740794 had a related patch set uploaded (by Jforrester; author: Jforrester):

[operations/mediawiki-config@master] Initial Beta Cluster deployment of Wikifunctions: IV - IS-Labs

https://gerrit.wikimedia.org/r/740794

Change 740791 merged by jenkins-bot:

[operations/mediawiki-config@master] Initial Beta Cluster deployment of Wikifunctions: I - IS

https://gerrit.wikimedia.org/r/740791

Mentioned in SAL (#wikimedia-operations) [2021-11-29T17:18:25Z] <jforrester@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Initial Beta Cluster deployment of Wikifunctions: I - IS for T289315 (duration: 00m 55s)

Change 740792 merged by jenkins-bot:

[operations/mediawiki-config@master] Initial Beta Cluster deployment of Wikifunctions: II - Services

https://gerrit.wikimedia.org/r/740792

Mentioned in SAL (#wikimedia-operations) [2021-11-29T17:22:22Z] <jforrester@deploy1002> Synchronized wmf-config/ProductionServices.php: Initial Beta Cluster deployment of Wikifunctions: II - Services for T289315 (duration: 00m 55s)

Change 740793 merged by jenkins-bot:

[operations/mediawiki-config@master] Initial Beta Cluster deployment of Wikifunctions: III - CS

https://gerrit.wikimedia.org/r/740793

Mentioned in SAL (#wikimedia-operations) [2021-11-29T17:40:45Z] <jforrester@deploy1002> Synchronized wmf-config/CommonSettings.php: Initial Beta Cluster deployment of Wikifunctions: III - CS for T289315 (duration: 00m 55s)