Our current tests are confirming integration of MedaiWiki plugins, and the interoperability of the services we provide. This is valuable, however some higher level "smoke tests" specifically targeting the Docker / Docker Compose setup we distribute should be considered (e.g. confirming the right things happen on start/stop, down/up in a compose setup, updating an image between minor versions of our distribution, etc). These sorts of scenarios are debatably at the heart of our product currently, as we are mostly at this time packaging things into Docker image distributions. Worth nothin is that along with current refactoring of our distribution, we are deprecating our Upgrade test suite which was testing in this area--but ineffectually. The sort of tests I'm thinking about would mostly be putting the services up, checking that everything is healthy and basically responding on the service as expected (a bit deeper than a health check), and then taking them back down--testing for any issues along the way.

also wondering if there's an opportunity here to consider cloud's testing needs.