Page MenuHomePhabricator

Change Example test suite to run against current release
Closed, ResolvedPublic

Description

Situation: Currently when any changes made to our images require updates in our tests, the Example tests suite will fail as it relies upon the most recently distributed images to DockerHub. As we implement our new versioning changes (including adding related CHANGELOGs, etc), we should be able to handle this better through prerelease builds which get distributed to DockerHub and which the Example can be set to run against.

Solution: This should fix itself as we establish the release procedure and tooling to support our new version/release scheme. This ticket exists to double check this is true once we get to that point.

Currently, as a workaround, individual tests which do not pass in Example for this reasons can simply be ignored for that test suite.

Event Timeline

lojo_wmde renamed this task from Resolve Example testing against current release to Resolve issues with testing Example suite against current release.Apr 2 2024, 10:41 AM

This issue is partly resolved by changing the Example test suite to test against the current builds like the other test suites https://github.com/wmde/wikibase-release-pipeline/pull/652). It is my opinion that this setup makes for the best test + release workflow for now with regards to the Example configuration. However, the question of how to test that the right tags were specified to get to the DockerHub builds (that at the time of finalising a release are not yet released).

lojo_wmde changed the task status from Open to In Progress.Apr 20 2024, 8:12 AM
lojo_wmde moved this task from In Review to Doing on the Wikibase Suite Team (Sprint-∞) board.
lojo_wmde renamed this task from Resolve issues with testing Example suite against current release to Change Example test suite to run against current release.Apr 22 2024, 7:27 AM
lojo_wmde moved this task from Doing to In Review on the Wikibase Suite Team (Sprint-∞) board.