Page MenuHomePhabricator

browsertests: configure Zuul
Closed, ResolvedPublic


This is a sub project of bug 53697

It covers setting up the Zuul configuration to trigger browser tests. From the wiki page:

The exact workflow would need to be figured out with the VisualEditor team. A first step would be to run the browser tests after a change has been merged and report back in Gerrit for their information.
At first we will only want to run browser tests after a change has been merged. This let us load the system progressively without disrupting the VisualEditor authors.

We can later on make Zuul report back in Gerrit a message stating the result of the tests, that will raise awareness among developers and they can work on fixing the unsuccessful tests. Additionally, we can have the browser tests to be triggered on every patchset, the labs instance load will have to be carefully monitored.

Once tests are properly passing and the setup has been proven useful, we can make Zuul to block patchsets not passing the browser tests. The developers would then be required to fix the code or the test to have their change merged in

Version: wmf-deployment
Severity: enhancement



Event Timeline

bzimport raised the priority of this task from to Medium.Nov 22 2014, 2:05 AM
bzimport set Reference to bz54387.

CCing Željko Filipin on any continuous bug related to browsertests. Main tracking bug is: bug 53697, see

Being added on an ongoing basis. Already added the ULS browser tests in the Zuul 'test' pipeline.