Page MenuHomePhabricator

Make catalyst build / selenium tests blocking in evaluator gitlab pipeline
Closed, ResolvedPublic3 Estimated Story Points

Description

Background:
Right now a catalyst env is being built and selenium tests are being run on each push to the Wikilambda gerritt repo, and we also want that catalyst build and selenium tests to run in the evaluator pipeline as well. This is for the work on the evaluator.

Acceptance criteria:
In gitlab have a  job that does the deployment
The job deploys catalyst
Then there should be another job that runs the selenium tests
If those pass then continue with the rest of the pipeline as normal (the build that ships to production)

note: T394558 should be worked on first, and then once that block of work is complete then work on this related task.

Event Timeline

jeena edited projects, added Catalyst (Kulupu Olin); removed Catalyst.
thcipriani set the point value for this task to 3.Jul 21 2025, 4:21 PM
thcipriani edited projects, added Catalyst (akesi npa); removed Catalyst (Kulupu Olin).
thcipriani moved this task from Backlog to Ready on the Catalyst (akesi npa) board.
jeena changed the task status from Open to In Progress.Jul 23 2025, 11:25 PM
jeena moved this task from Ready to In progress on the Catalyst (akesi npa) board.
DSantamaria changed the task status from In Progress to Open.Jul 24 2025, 12:59 PM
DSantamaria changed the task status from Open to In Progress.
thcipriani changed the task status from In Progress to Stalled.Aug 5 2025, 5:18 PM
thcipriani edited projects, added Catalyst (Radar); removed Catalyst (akesi npa).
thcipriani subscribed.

Stalling this from the Catalyst side, waiting updates to tests from Abstract Wiki folks in function-evaluator.

Let us know if there's anything you need @vaughnwalters

Stalling this from the Catalyst side, waiting updates to tests from Abstract Wiki folks in function-evaluator.

Let us know if there's anything you need @vaughnwalters

Thanks @thcipriani, yeah as you've noted it looks like this task is blocked until T399348 is resolved.

I'd love for Vaughn to take the lead making this happen here, so that he knows how to adjust blocking/unblocking tests in Gitlab. Would he need to work with Jeena/James to do that?

Jdforrester-WMF changed the task status from Stalled to In Progress.Jan 8 2026, 7:07 PM

@Jdforrester-WMF thinking we should move this back to stalled again until the OOM error in the orchestrator pipeline is remedied?

Change #1229568 had a related patch set uploaded (by Jforrester; author: Jforrester):

[operations/deployment-charts@master] wikifunctions: Upgrade evaluators from 2026-01-07-132938 to 2026-01-15-194836

https://gerrit.wikimedia.org/r/1229568

Change #1229568 merged by jenkins-bot:

[operations/deployment-charts@master] wikifunctions: Upgrade evaluators from 2026-01-07-132938 to 2026-01-15-194836

https://gerrit.wikimedia.org/r/1229568