Page MenuHomePhabricator

Skip fixed-site tests in redundant CI default-site runs
Closed, ResolvedPublicFeature

Description

Description:
Some CI jobs differ only in the configured default site (e.g. wikipedia:en
and wikisource:zh). Tests derived from DefaultSiteTestCase should run in
each job because they verify the configured default site.

However, tests with fixed family/code (or a predefined sites
configuration) always run against the same wiki and therefore execute
identical test cases multiple times.

Introduce an environment variable to skip these fixed-site tests in redundant
default-site CI runs. This should reduce CI runtime without reducing overall
test coverage.

Event Timeline

Xqt triaged this task as Low priority.

Change #1317658 had a related patch set uploaded (by Xqt; author: Xqt):

[pywikibot/core@master] Add PYWIKIBOT_TEST_DEFAULT_ONLY environment variable

https://gerrit.wikimedia.org/r/1317658

Change #1317660 had a related patch set uploaded (by Xqt; author: Xqt):

[pywikibot/core@master] tests: use PYWIKIBOT_TEST_DEFAULT_ONLY with wikisource:zh

https://gerrit.wikimedia.org/r/1317660

Change #1317658 merged by jenkins-bot:

[pywikibot/core@master] Add PYWIKIBOT_TEST_DEFAULT_ONLY environment variable

https://gerrit.wikimedia.org/r/1317658

Change #1317660 merged by Xqt:

[pywikibot/core@master] tests: use PYWIKIBOT_TEST_DEFAULT_ONLY with wikisource:zh

https://gerrit.wikimedia.org/r/1317660