Page MenuHomePhabricator

Setup a daily job on jenkins to run ReadingLists tests
Open, Stalled, MediumPublic3 Estimated Story Points

Description

Background

Changes in MediaWiki core have potential to break the ReadingLists extension. (see T403560)

Goal

We need a way to either prevent this from happening (e.g. gate-and-submit) or be notified when the ReadingLIsts tests on the master branch are broken.

Developer notes

Options:

  1. Add ReadingLists extension to the gate-and-submit job, but this has many downsides, especially that it involves running the tests for patches on all extensions.
  2. Define a more fine grained set of dependencies (e.g. Vector, Minerva and core) which should have ReadingLists tests run as a less onerous version of gate-and-submit. This is not possible at the moment. See https://phabricator.wikimedia.org/T404403
  3. Setup a daily job on jenkins to run ReadingLists tests. (e.g. as if a patch was submitted to the ReadingLists extension). If the tests are failing, then an email and slack notification(s) should be sent.

Having a daily test job for ReadingLists is the most feasible to be alerted to any breakage in tests so that engineers can fix the issue.

Acceptance criteria for done

  • Clarify option
    • Reach out to developer experience team? #developer-experience / releng
  • Implement favorable option

Event Timeline

aude triaged this task as High priority.Oct 1 2025, 6:26 PM
Jdlrobson-WMF lowered the priority of this task from High to Medium.Oct 15 2025, 5:16 PM
bwang updated the task description. (Show Details)
bwang raised the priority of this task from Medium to High.Mar 18 2026, 5:43 PM
bwang set the point value for this task to 3.
bwang moved this task from Needs refinement to Ready for sprint on the Reader Experience Team board.
Volker_E subscribed.

Regarding option 1.: This option doesn't sound feasible to me. There has been predecessors to my knowledge where such setup is a) slowing down development for everyone else and b) has also negatively impacted velocity widely.

HFan-WMF lowered the priority of this task from High to Medium.Mar 25 2026, 6:12 PM
HFan-WMF subscribed.

Setting to "Medium" in the context of current sprint.

Regarding option 2 and "is not possible at the moment": The dependency might be able to have introduced, for example https://gerrit.wikimedia.org/r/plugins/gitiles/integration/config/+/refs/heads/master/zuul/dependencies.yaml#1623 In my understanding it could check a new Vector patch against RL master and vice versa.

For option 2, dependencies.yaml only defines which other extensions (e.g. BetaFeatures) need to be cloned when tests are run for a particular extension (e.g. ReadingLists). This does not cause tests to run for these other extensions when there is a change in ReadingLists.

Addressing https://phabricator.wikimedia.org/T404403 would help make this possible and it would be ideal if we can have this capability.

I am looking further at feasibility of option 2 and think it is possible:

https://phabricator.wikimedia.org/T404403#11789407

Both option 2 and option 3 would require to check with the release engineering team to make sure they support the approach. I would like to try option 2.

I put together a proof of concept for implementing option 2, as described in https://phabricator.wikimedia.org/T404403#11793824

I would like that approach if possible

LMora-WMF changed the task status from Open to Stalled.Apr 7 2026, 5:05 PM
HFan-WMF changed the task status from Stalled to Open.Apr 12 2026, 3:20 AM
HFan-WMF moved this task from Incoming to Ready for sprint on the Reader Experience Team board.

I think we want to do https://phabricator.wikimedia.org/T404403 instead. Either approach requires support from release engineering or whichever team maintains the CI infrastructure.

There is a proof of concept patch for T404403: https://gerrit.wikimedia.org/r/c/integration/config/+/1268556

aude changed the task status from Open to Stalled.Apr 13 2026, 4:39 PM