Page MenuHomePhabricator

AdvancedSearch tests fail in Quickstart
Closed, ResolvedPublicBUG REPORT

Description

1~/Documents/gitlab/test-platform/mediawiki-quickstart$ time SILENT=1 VERBOSE=1 ./run_selenium_tests "extensions/AdvancedSearch/tests/selenium/*specs/**/*.js" ".*"
2
3Ensuring Selenium ready...
4
5Installing Selenium browser binary...
6Chromium 98.0.4758.0
7
8Execution of 5 workers started at 2025-01-28T12:16:51.258Z
9
10[0-0] RUNNING in chrome - /extensions/AdvancedSearch/tests/selenium/specs/advancedSearch.js
11[0-0] PASSED in chrome - /extensions/AdvancedSearch/tests/selenium/specs/advancedSearch.js
12[0-1] RUNNING in chrome - /extensions/AdvancedSearch/tests/selenium/specs/defaultNamespaces.js
13[0-1] PASSED in chrome - /extensions/AdvancedSearch/tests/selenium/specs/defaultNamespaces.js
14[0-2] RUNNING in chrome - /extensions/AdvancedSearch/tests/selenium/specs/namespaces.js
15[0-2] PASSED in chrome - /extensions/AdvancedSearch/tests/selenium/specs/namespaces.js
16[0-3] RUNNING in chrome - /extensions/AdvancedSearch/tests/selenium/specs/paginationLinks.js
17[0-3] TypeError in "Advanced Search.adds search parameters to pagination links"
18TypeError: Cannot read properties of undefined (reading 'waitForExist')
19 at Context.<anonymous> (/var/www/html/w/extensions/AdvancedSearch/tests/selenium/specs/paginationLinks.js:13:62)
20 at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
21[0-3] FAILED in chrome - /extensions/AdvancedSearch/tests/selenium/specs/paginationLinks.js
22[0-4] RUNNING in chrome - /extensions/AdvancedSearch/tests/selenium/specs/searchSubmit.js
23[0-4] PASSED in chrome - /extensions/AdvancedSearch/tests/selenium/specs/searchSubmit.js
24
25 "spec" Reporter:
26------------------------------------------------------------------
27[Chrome 98.0.4758.0 linux #0-0] Running: Chrome (v98.0.4758.0) on linux
28[Chrome 98.0.4758.0 linux #0-0] Session ID: bfebd1d5-92b0-43ba-845d-56cf421f64cc
29[Chrome 98.0.4758.0 linux #0-0]
30[Chrome 98.0.4758.0 linux #0-0] » /extensions/AdvancedSearch/tests/selenium/specs/advancedSearch.js
31[Chrome 98.0.4758.0 linux #0-0] Advanced Search
32[Chrome 98.0.4758.0 linux #0-0] ✓ inserts advanced search elements on search page
33[Chrome 98.0.4758.0 linux #0-0]
34[Chrome 98.0.4758.0 linux #0-0] 1 passing (14s)
35------------------------------------------------------------------
36[Chrome 98.0.4758.0 linux #0-1] Running: Chrome (v98.0.4758.0) on linux
37[Chrome 98.0.4758.0 linux #0-1] Session ID: 2c18b13d-e3b6-4c1f-910a-90e84978d17d
38[Chrome 98.0.4758.0 linux #0-1]
39[Chrome 98.0.4758.0 linux #0-1] » /extensions/AdvancedSearch/tests/selenium/specs/defaultNamespaces.js
40[Chrome 98.0.4758.0 linux #0-1] Advanced Search
41[Chrome 98.0.4758.0 linux #0-1] ✓ allows logged-in users to remember the selection of namespaces for future searches
42[Chrome 98.0.4758.0 linux #0-1] ✓ selects the users default namespaces when logged in
43[Chrome 98.0.4758.0 linux #0-1] ✓ selects the namespaces from the URL
44[Chrome 98.0.4758.0 linux #0-1]
45[Chrome 98.0.4758.0 linux #0-1] 3 passing (6.3s)
46------------------------------------------------------------------
47[Chrome 98.0.4758.0 linux #0-2] Running: Chrome (v98.0.4758.0) on linux
48[Chrome 98.0.4758.0 linux #0-2] Session ID: 6fe8bdd7-3859-45d4-b4fc-2964500832ff
49[Chrome 98.0.4758.0 linux #0-2]
50[Chrome 98.0.4758.0 linux #0-2] » /extensions/AdvancedSearch/tests/selenium/specs/namespaces.js
51[Chrome 98.0.4758.0 linux #0-2] AdvancedSearch
52[Chrome 98.0.4758.0 linux #0-2] ✓ namespace selection
53[Chrome 98.0.4758.0 linux #0-2] ✓ re-adds filetype namespace after search when file type option has been selected but namespace has been removed
54[Chrome 98.0.4758.0 linux #0-2] ✓ adds/removes the namespace tag when the namespace option is clicked
55[Chrome 98.0.4758.0 linux #0-2]
56[Chrome 98.0.4758.0 linux #0-2] 3 passing (7.8s)
57------------------------------------------------------------------
58[Chrome 98.0.4758.0 linux #0-3] Running: Chrome (v98.0.4758.0) on linux
59[Chrome 98.0.4758.0 linux #0-3] Session ID: e9df38b3-15d3-4a35-bd88-7dad607fe6cc
60[Chrome 98.0.4758.0 linux #0-3]
61[Chrome 98.0.4758.0 linux #0-3] » /extensions/AdvancedSearch/tests/selenium/specs/paginationLinks.js
62[Chrome 98.0.4758.0 linux #0-3] Advanced Search
63[Chrome 98.0.4758.0 linux #0-3] ✖ adds search parameters to pagination links
64[Chrome 98.0.4758.0 linux #0-3]
65[Chrome 98.0.4758.0 linux #0-3] 1 failing (2.4s)
66[Chrome 98.0.4758.0 linux #0-3]
67[Chrome 98.0.4758.0 linux #0-3] 1) Advanced Search adds search parameters to pagination links
68[Chrome 98.0.4758.0 linux #0-3] Cannot read properties of undefined (reading 'waitForExist')
69[Chrome 98.0.4758.0 linux #0-3] TypeError: Cannot read properties of undefined (reading 'waitForExist')
70[Chrome 98.0.4758.0 linux #0-3] at Context.<anonymous> (/var/www/html/w/extensions/AdvancedSearch/tests/selenium/specs/paginationLinks.js:13:62)
71[Chrome 98.0.4758.0 linux #0-3] at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
72------------------------------------------------------------------
73[Chrome 98.0.4758.0 linux #0-4] Running: Chrome (v98.0.4758.0) on linux
74[Chrome 98.0.4758.0 linux #0-4] Session ID: 4f0c9719-9376-40e0-90d3-4c503e554541
75[Chrome 98.0.4758.0 linux #0-4]
76[Chrome 98.0.4758.0 linux #0-4] » /extensions/AdvancedSearch/tests/selenium/specs/searchSubmit.js
77[Chrome 98.0.4758.0 linux #0-4] Advanced Search
78[Chrome 98.0.4758.0 linux #0-4] ✓ submits the search on enter when there is no text in "These Words" field
79[Chrome 98.0.4758.0 linux #0-4] ? submits the search with the specific chosen language
80[Chrome 98.0.4758.0 linux #0-4] - submits the search with the specific chosen language
81[Chrome 98.0.4758.0 linux #0-4]
82[Chrome 98.0.4758.0 linux #0-4] 1 passing (2.7s)
83[Chrome 98.0.4758.0 linux #0-4] 1 skipped
84
85
86Spec Files: 4 passed, 1 failed, 5 total (100% completed) in 00:00:55
87
88SILENT=1 VERBOSE=1 ./run_selenium_tests ".*" 0.27s user 0.18s system 0% cpu 1:10.81 total

Event Timeline

thiemowmde changed the subtype of this task from "Task" to "Bug Report".

Change #1132407 had a related patch set uploaded (by Thiemo Kreuz (WMDE); author: Thiemo Kreuz (WMDE)):

[mediawiki/extensions/AdvancedSearch@master] Use waitForExist correctly

https://gerrit.wikimedia.org/r/1132407

Change #1132681 had a related patch set uploaded (by Thiemo Kreuz (WMDE); author: Thiemo Kreuz (WMDE)):

[mediawiki/extensions/CirrusSearch@master] Fix "cannot access before initialization" mistake

https://gerrit.wikimedia.org/r/1132681

Change #1132681 merged by jenkins-bot:

[mediawiki/extensions/CirrusSearch@master] Fix "cannot access before initialization" mistake

https://gerrit.wikimedia.org/r/1132681

Change #1132407 merged by jenkins-bot:

[mediawiki/extensions/AdvancedSearch@master] Use waitForExist correctly

https://gerrit.wikimedia.org/r/1132407

@zeljkofilipin, I believe this is fixed. Unfortunately I don't know how to verify if the MediaWiki-Quickstart (Docker) CI works again. Can you do this?

mediawiki-quickstart runs selenium tests at https://quickstart-ci-components.wmcloud.org/

According to CI, the tests are passing:

Stages
1 - Fresh install of Mediawiki
2 - Component installation
3 - Component Selenium tests exist
4 - Component Selenium tests (via 'run_component_selenium_tests')
5 - Component Selenium tests (via 'run_selenium_tests')

                                                     Stages
-----------------------------------------------------------------
   #   Component                                  1  2  3  4  5  
-----------------------------------------------------------------

   1   extensions/AbuseFilter                     ✓  ✓  ✓  ✓  ✓  
   2   extensions/AchievementBadges               ✓  ✓  ✓  x  x  
   3   extensions/AdvancedSearch                  ✓  ✓  ✓  ✓  ✓  
...
zeljkofilipin moved this task from Backlog to Finishing touches on the Test Platform (Tria 3) board.

More CI output:

...
Running Selenium tests for 'extensions/AdvancedSearch' via 'run_component_selenium_tests "extensions/AdvancedSearch"'...

Ensuring Selenium ready...

⏲ 00:00
Installing Selenium browser binary...
Chromium 98.0.4758.0 

> selenium-test
> wdio tests/selenium/wdio.conf.js


Execution of 5 workers started at 2025-04-01T10:11:51.838Z

[0-0] RUNNING in chrome - /tests/selenium/specs/advancedSearch.js
[0-3] RUNNING in chrome - /tests/selenium/specs/paginationLinks.js
[0-1] RUNNING in chrome - /tests/selenium/specs/defaultNamespaces.js
[0-2] RUNNING in chrome - /tests/selenium/specs/namespaces.js
[0-3] PASSED in chrome - /tests/selenium/specs/paginationLinks.js
[0-4] RUNNING in chrome - /tests/selenium/specs/searchSubmit.js
[0-4] PASSED in chrome - /tests/selenium/specs/searchSubmit.js
[0-1] PASSED in chrome - /tests/selenium/specs/defaultNamespaces.js
[0-0] PASSED in chrome - /tests/selenium/specs/advancedSearch.js
[0-2] PASSED in chrome - /tests/selenium/specs/namespaces.js

 "spec" Reporter:
------------------------------------------------------------------
[Chrome 98.0.4758.0 linux #0-3] Running: Chrome (v98.0.4758.0) on linux
[Chrome 98.0.4758.0 linux #0-3] Session ID: cd57e899-7262-4e3f-9af4-a939c2721035
[Chrome 98.0.4758.0 linux #0-3]
[Chrome 98.0.4758.0 linux #0-3] » /tests/selenium/specs/paginationLinks.js
[Chrome 98.0.4758.0 linux #0-3] Advanced Search
[Chrome 98.0.4758.0 linux #0-3]    ✓ adds search parameters to pagination links
[Chrome 98.0.4758.0 linux #0-3]
[Chrome 98.0.4758.0 linux #0-3] 1 passing (10.5s)
------------------------------------------------------------------
[Chrome 98.0.4758.0 linux #0-4] Running: Chrome (v98.0.4758.0) on linux
[Chrome 98.0.4758.0 linux #0-4] Session ID: 4f218930-2bfa-4f39-baa1-2c9b20e72ce0
[Chrome 98.0.4758.0 linux #0-4]
[Chrome 98.0.4758.0 linux #0-4] » /tests/selenium/specs/searchSubmit.js
[Chrome 98.0.4758.0 linux #0-4] Advanced Search
[Chrome 98.0.4758.0 linux #0-4]    ✓ submits the search on enter when there is no text in "These Words" field
[Chrome 98.0.4758.0 linux #0-4]    ? submits the search with the specific chosen language
[Chrome 98.0.4758.0 linux #0-4]    - submits the search with the specific chosen language
[Chrome 98.0.4758.0 linux #0-4]
[Chrome 98.0.4758.0 linux #0-4] 1 passing (4s)
[Chrome 98.0.4758.0 linux #0-4] 1 skipped
------------------------------------------------------------------
[Chrome 98.0.4758.0 linux #0-1] Running: Chrome (v98.0.4758.0) on linux
[Chrome 98.0.4758.0 linux #0-1] Session ID: 9e7d87d4-90cb-4b34-913f-145cf2439e23
[Chrome 98.0.4758.0 linux #0-1]
[Chrome 98.0.4758.0 linux #0-1] » /tests/selenium/specs/defaultNamespaces.js
[Chrome 98.0.4758.0 linux #0-1] Advanced Search
[Chrome 98.0.4758.0 linux #0-1]    ✓ allows logged-in users to remember the selection of namespaces for future searches
[Chrome 98.0.4758.0 linux #0-1]    ✓ selects the users default namespaces when logged in
[Chrome 98.0.4758.0 linux #0-1]    ✓ selects the namespaces from the URL
[Chrome 98.0.4758.0 linux #0-1]
[Chrome 98.0.4758.0 linux #0-1] 3 passing (18.2s)
------------------------------------------------------------------
[Chrome 98.0.4758.0 linux #0-0] Running: Chrome (v98.0.4758.0) on linux
[Chrome 98.0.4758.0 linux #0-0] Session ID: 8e289264-c1ef-4063-bbc0-62b8d7c10afd
[Chrome 98.0.4758.0 linux #0-0]
[Chrome 98.0.4758.0 linux #0-0] » /tests/selenium/specs/advancedSearch.js
[Chrome 98.0.4758.0 linux #0-0] Advanced Search
[Chrome 98.0.4758.0 linux #0-0]    ✓ inserts advanced search elements on search page
[Chrome 98.0.4758.0 linux #0-0]
[Chrome 98.0.4758.0 linux #0-0] 1 passing (20.2s)
------------------------------------------------------------------
[Chrome 98.0.4758.0 linux #0-2] Running: Chrome (v98.0.4758.0) on linux
[Chrome 98.0.4758.0 linux #0-2] Session ID: b7b36538-2264-4ecd-9c1c-56c25351cdb7
[Chrome 98.0.4758.0 linux #0-2]
[Chrome 98.0.4758.0 linux #0-2] » /tests/selenium/specs/namespaces.js
[Chrome 98.0.4758.0 linux #0-2] AdvancedSearch
[Chrome 98.0.4758.0 linux #0-2]    ✓ namespace selection
[Chrome 98.0.4758.0 linux #0-2]    ✓ re-adds filetype namespace after search when file type option has been selected but namespace has been removed
[Chrome 98.0.4758.0 linux #0-2]    ✓ adds/removes the namespace tag when the namespace option is clicked
[Chrome 98.0.4758.0 linux #0-2]
[Chrome 98.0.4758.0 linux #0-2] 3 passing (21.3s)


Spec Files:	 5 passed, 5 total (100% completed) in 00:00:24 

⏲ 00:30

Running Selenium tests for 'extensions/AdvancedSearch' via 'run_selenium_tests "extensions/AdvancedSearch/tests/selenium/*specs/**/*.js" ".*"'...

Ensuring Selenium ready...

⏲ 00:00
Chromium 98.0.4758.0 

Execution of 5 workers started at 2025-04-01T10:12:19.410Z

[0-0] RUNNING in chrome - /extensions/AdvancedSearch/tests/selenium/specs/advancedSearch.js
[0-0] PASSED in chrome - /extensions/AdvancedSearch/tests/selenium/specs/advancedSearch.js
[0-1] RUNNING in chrome - /extensions/AdvancedSearch/tests/selenium/specs/defaultNamespaces.js
[0-1] PASSED in chrome - /extensions/AdvancedSearch/tests/selenium/specs/defaultNamespaces.js
[0-2] RUNNING in chrome - /extensions/AdvancedSearch/tests/selenium/specs/namespaces.js
[0-2] PASSED in chrome - /extensions/AdvancedSearch/tests/selenium/specs/namespaces.js
[0-3] RUNNING in chrome - /extensions/AdvancedSearch/tests/selenium/specs/paginationLinks.js
[0-3] PASSED in chrome - /extensions/AdvancedSearch/tests/selenium/specs/paginationLinks.js
[0-4] RUNNING in chrome - /extensions/AdvancedSearch/tests/selenium/specs/searchSubmit.js
[0-4] PASSED in chrome - /extensions/AdvancedSearch/tests/selenium/specs/searchSubmit.js

 "spec" Reporter:
------------------------------------------------------------------
[Chrome 98.0.4758.0 linux #0-0] Running: Chrome (v98.0.4758.0) on linux
[Chrome 98.0.4758.0 linux #0-0] Session ID: 5654152e-1441-40f3-b92b-e888d3ae55e7
[Chrome 98.0.4758.0 linux #0-0]
[Chrome 98.0.4758.0 linux #0-0] » /extensions/AdvancedSearch/tests/selenium/specs/advancedSearch.js
[Chrome 98.0.4758.0 linux #0-0] Advanced Search
[Chrome 98.0.4758.0 linux #0-0]    ✓ inserts advanced search elements on search page
[Chrome 98.0.4758.0 linux #0-0]
[Chrome 98.0.4758.0 linux #0-0] 1 passing (7.7s)
------------------------------------------------------------------
[Chrome 98.0.4758.0 linux #0-1] Running: Chrome (v98.0.4758.0) on linux
[Chrome 98.0.4758.0 linux #0-1] Session ID: 75451909-8ea4-4f8c-b353-83dc3e673b82
[Chrome 98.0.4758.0 linux #0-1]
[Chrome 98.0.4758.0 linux #0-1] » /extensions/AdvancedSearch/tests/selenium/specs/defaultNamespaces.js
[Chrome 98.0.4758.0 linux #0-1] Advanced Search
[Chrome 98.0.4758.0 linux #0-1]    ✓ allows logged-in users to remember the selection of namespaces for future searches
[Chrome 98.0.4758.0 linux #0-1]    ✓ selects the users default namespaces when logged in
[Chrome 98.0.4758.0 linux #0-1]    ✓ selects the namespaces from the URL
[Chrome 98.0.4758.0 linux #0-1]
[Chrome 98.0.4758.0 linux #0-1] 3 passing (4.9s)
------------------------------------------------------------------
[Chrome 98.0.4758.0 linux #0-2] Running: Chrome (v98.0.4758.0) on linux
[Chrome 98.0.4758.0 linux #0-2] Session ID: 133f6b7b-4364-48e8-9ec4-455cbf3e7c78
[Chrome 98.0.4758.0 linux #0-2]
[Chrome 98.0.4758.0 linux #0-2] » /extensions/AdvancedSearch/tests/selenium/specs/namespaces.js
[Chrome 98.0.4758.0 linux #0-2] AdvancedSearch
[Chrome 98.0.4758.0 linux #0-2]    ✓ namespace selection
[Chrome 98.0.4758.0 linux #0-2]    ✓ re-adds filetype namespace after search when file type option has been selected but namespace has been removed
[Chrome 98.0.4758.0 linux #0-2]    ✓ adds/removes the namespace tag when the namespace option is clicked
[Chrome 98.0.4758.0 linux #0-2]
[Chrome 98.0.4758.0 linux #0-2] 3 passing (7.8s)
------------------------------------------------------------------
[Chrome 98.0.4758.0 linux #0-3] Running: Chrome (v98.0.4758.0) on linux
[Chrome 98.0.4758.0 linux #0-3] Session ID: 61f4f365-739f-4ce2-aaf2-bf33b00642a5
[Chrome 98.0.4758.0 linux #0-3]
[Chrome 98.0.4758.0 linux #0-3] » /extensions/AdvancedSearch/tests/selenium/specs/paginationLinks.js
[Chrome 98.0.4758.0 linux #0-3] Advanced Search
[Chrome 98.0.4758.0 linux #0-3]    ✓ adds search parameters to pagination links
[Chrome 98.0.4758.0 linux #0-3]
[Chrome 98.0.4758.0 linux #0-3] 1 passing (1.4s)
------------------------------------------------------------------
[Chrome 98.0.4758.0 linux #0-4] Running: Chrome (v98.0.4758.0) on linux
[Chrome 98.0.4758.0 linux #0-4] Session ID: a97f305e-1ea0-47b4-87dd-9be0cffa8e6a
[Chrome 98.0.4758.0 linux #0-4]
[Chrome 98.0.4758.0 linux #0-4] » /extensions/AdvancedSearch/tests/selenium/specs/searchSubmit.js
[Chrome 98.0.4758.0 linux #0-4] Advanced Search
[Chrome 98.0.4758.0 linux #0-4]    ✓ submits the search on enter when there is no text in "These Words" field
[Chrome 98.0.4758.0 linux #0-4]    ? submits the search with the specific chosen language
[Chrome 98.0.4758.0 linux #0-4]    - submits the search with the specific chosen language
[Chrome 98.0.4758.0 linux #0-4]
[Chrome 98.0.4758.0 linux #0-4] 1 passing (2s)
[Chrome 98.0.4758.0 linux #0-4] 1 skipped


Spec Files:	 5 passed, 5 total (100% completed) in 00:00:32 

⏲ 00:35
...