Several tests cannot be run with JJB without specific setup steps (config change and sql query). They are tagged @smoke but not @integration. Using the LocalSettings.php in tests/browser to do this.
tests/browser/features/ui_links.feature
7: @smoke
17: @smoke
tests/browser/features/language.feature
11: @smoke
We should update the LocalSettings.php file in the browser tests directory to take care of the SQL query and licensing tests so that these run.
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | zeljkofilipin | T91669 Make browser tests voting for all repos of WMF deployed code | |||
| Resolved | zeljkofilipin | T55697 [EPIC] trigger browser tests from Gerrit (tracking) | |||
| Resolved | • Jhernandez | T104315 [GOAL]: Set up testing environments that run browser tests on all patches. | |||
| Resolved | Jdlrobson | T100293 [EPIC] Run browser tests against every MobileFrontend/Gather patch | |||
| Resolved | Jdlrobson | T107587 Migrating mobile browser tests to JJB | |||
| Resolved | Jdlrobson | T107910 Migrate languages and ui links browser tests to JJB |
Change 229019 had a related patch set uploaded (by Jdlrobson):
WIP: Other tests that do not pass
@phuedx @bmansurov @rmoen @Jdlrobson Are we going to be able to do this or should we just skip them?
It'd be nice to know what to do to clean up the blocked epic if we can.
We can now provide a custom configuration that gets included during the Jenkins build. I guess we can run a SQL query as well as setting configuration variables…
Change 235636 had a related patch set uploaded (by Jdlrobson):
QA: Run language browser tests per commit
Anyone have any ideas with how to get https://gerrit.wikimedia.org/r/235635 to pass? What am I doing wrong in the LocalSettings.php? There seems to be a permissioning issue... @dduvall @phuedx @bmansurov any ideas? I'm sure I'm missing something obvious.
So I renamed my LocalSettings and setup a new wiki using a new database qa.
I ran the tests locally and they did indeed fail the first time however I noticed that on navigating around the wiki the privacy link was visible on some pages. I'm thus assuming this is down to cached pages and have switched from testing against the main page to testing against a non-cached non-existence page. Fingers crossed https://gerrit.wikimedia.org/r/235635 and https://gerrit.wikimedia.org/r/235636 will pass.