Page MenuHomePhabricator

Ensure Wikibase search e2e tests don't break for other extensions
Open, Needs TriagePublic5 Estimated Story Points

Description

Wikibase's api-testing CI job has WikibaseCirrusSearch enabled and includes OpenSearch, and some of the search-related e2e tests depend on this setup. There were a few instances (see e.g. T418086) where we forgot to add guard clauses to skip those tests for other extensions with an insufficient CI setup, which caused CI failures downstream.

We want to run api-testing without OpenSearch in our existing secondary GH Actions CI. Test failures will be notified via e-mail to wikidata-ci-status@wikimedia.de.

This applies to the GraphQL searchItems field and the Wikibase REST search endpoints.

Event Timeline

@Jakob_WMDE thank you very much. I have a non technical suggestion for something else:

  • check the tests every Friday afternoon

while CI tests are not essential, it simplifies work and organization on the weekends if tests run.

PS: I wanted to quantify the problem a bit. This year I got 1775 emails from gerrit and 57 contain the word recheck. As most of the logs are gone, it is pointless to analyze this further. My feeling is that in 50% of the cases recheck solved the problem and in the other 50% there was a problem in the ci pipeline. (Not everything was caused by wikibase tests.)

Silvan_WMDE set the point value for this task to 5.Apr 7 2026, 12:25 PM
Silvan_WMDE moved this task from Polished to Ready for planning on the Wikibase Reuse Team board.
Silvan_WMDE subscribed.

For testing: fork the wikibase repo to your personal GitHub account and modify GH actions there. Possibly use https://github.com/nektos/act to test locally.