Most of our CI tests have been converted from integration tests (frequently involving network calls) to unit tests (running against a mocked web server where applicable). We should convert the remaining tests with network calls to self-contained unit tests (or delete them if redundant), and isolate the long-running screenshot tests in apps-android-wikipedia-periodic-test. This will allow us to maximize the per-revision testing in CI and to merge patches with greater confidence.
Description
Description
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | • Mholloway | T169917 Run translation tests in the per-revision CI jobs | |||
| Invalid | None | T169918 Limit apps-android-wikipedia-periodic-test to only the screenshot tests |
Event Timeline
Comment Actions
Note after some magic happened, the job runs in ~ 11 minutes (was 45 minutes) \o/ ( T150623 )
Comment Actions
The Jenkins job invokes scripts/apps-android-wikipedia-periodic-test which is directly in the apps/android/wikipedia git repo.
#!/usr/bin/env bash set -euo pipefail export ANDROID_HOME="${ANDROID_HOME:-$PWD/.sdk}" ./gradlew clean checkstyle lintAlphaRelease testAllAlphaRelease scripts/diff-screenshots
So I guess you can pass gradle a different goal and that would drop the integration tests.