Page MenuHomePhabricator

Run some full end-to-end browser integration tests on Beta Cluster Wikifunctions now it exists
Open, Needs TriagePublic

Description

For other critical extensions, on top of the blocking-CI selenium tests which stop us from landing changes that break our tests, we also have daily jobs that run on the Beta Cluster with the full gamut of production code, e.g. for AdvancedSearch or VisualEditor. It would be a good step for peace of mind to do the same for WikiLambda / Wikifunctions.

Event Timeline

Change 803330 had a related patch set uploaded (by Jforrester; author: Jforrester):

[mediawiki/extensions/WikiLambda@master] [DNM] Use Beta Cluster by default and wire-up end-to-end tests

https://gerrit.wikimedia.org/r/803330

Change 803330 merged by jenkins-bot:

[mediawiki/extensions/WikiLambda@master] Use Beta Cluster by default and wire-up end-to-end tests

https://gerrit.wikimedia.org/r/803330

Jdforrester-WMF renamed this task from Run some full end-to-end browser integration tests on Beta Cluster Wikifunctions once it exists to Run some full end-to-end browser integration tests on Beta Cluster Wikifunctions now it exists.Oct 25 2022, 6:52 PM

Change 856646 had a related patch set uploaded (by Stef Dunlap; author: Stef Dunlap):

[integration/config@master] WikiLambda: run e2e tests daily on betacluster

https://gerrit.wikimedia.org/r/856646

Change 858394 had a related patch set uploaded (by Jforrester; author: Jforrester):

[integration/config@master] jjb: Define selenium-daily-betawikifunctions-WikiLambda

https://gerrit.wikimedia.org/r/858394

Change 858394 merged by jenkins-bot:

[integration/config@master] jjb: Define selenium-daily-betawikifunctions-WikiLambda

https://gerrit.wikimedia.org/r/858394

Change 856646 merged by jenkins-bot:

[integration/config@master] Zuul: [mediawiki/extensions/WikiLambda] Disable selenium tests

https://gerrit.wikimedia.org/r/856646

Mentioned in SAL (#wikimedia-releng) [2022-11-21T14:54:56Z] <James_F> Zuul: [mediawiki/extensions/WikiLambda] Disable selenium tests for T294388

Change 859088 had a related patch set uploaded (by Jforrester; author: Jforrester):

[mediawiki/extensions/WikiLambda@master] package: Define 'selenium-daily' job, for now same as all tests

https://gerrit.wikimedia.org/r/859088

Change 859088 merged by jenkins-bot:

[mediawiki/extensions/WikiLambda@master] package: Define 'selenium-daily' job, for now same as all tests

https://gerrit.wikimedia.org/r/859088

The selenium-daily-betawikifunctions-WikiLambda job is deployed and running. Can this task be resolved or is there something left to do?

The selenium-daily-betawikifunctions-WikiLambda job is deployed and running. Can this task be resolved or is there something left to do?

We should probably actually have some end-to-end tests first. :-) It looks like T321932 will land first.

Sorry, I didn't take a good look. Looks like existing tests are really basic.