Popups Selenium tests daily targeting beta cluster
Closed, ResolvedPublic
Actions

Description

Now the Popups browser tests are written into Node we would like to run it daily.

Looking in integration/config the selenium-RelatedArticles-jessie job doesn't look too reusable. How can we set up a daily job targeting the beta cluster?

Details

	Subject	Repo	Branch	Lines +/-
	Refactor selenium-RelatedArticles-jessie job selenium-{name}-jessie job template	integration/config	master	+18 -5
	[labs] Unconditionally enable popups for anonymous users on beta cluster	operations/mediawiki-config	master	+3 -5

Customize query in gerrit

Related Objects
Search...

Status	Subtype	Assigned	Task
Resolved		Jdlrobson	T162936 Improve developer happiness in reading web maintained extensions
Declined		None	T162256 [EPIC] Port Selenium tests from Ruby to Node.js on Reading Web extensions
Resolved		zeljkofilipin	T164024 Rewrite Related pages browser tests in Node.js
Duplicate		Jdlrobson	T160238 Rewrite MobileFrontend and Page previews automated browser tests in Node.js
Declined		None	T174018 Port Minerva's 7 Ruby-based browser tests to Selenium Node.js
Resolved		Jdlrobson	T190710 Minerva Ruby and Node.js browser tests running side by side
Resolved		None	T179190 Run Selenium Cucumber tests in CI
Resolved		awight	T199116 Quibble should run `npm install` and `npm run selenium-test` for each extension/skin that has Selenium tests
Duplicate		Legoktm	T225330 Commit package-lock.json files everywhere
Resolved		hashar	T229033 wdio-cucumber-framework fails on NodeJS due to fibers@2.x under nodejs10
Resolved		zeljkofilipin	T232495 selenium-daily-beta-CirrusSearch is broken
Resolved		hashar	T229065 Quibble extension selenium test fails with: gyp ERR! stack Error: Can't find Python executable "python", you can set the PYTHON env variable.
Open		None	T199939 Audit tests/selenium/LocalSettings.php file aiming at possibly deprecating the feature
Resolved	PRODUCTION ERROR	Jdlrobson	T219920 CI tests disabled: Steps that require login are disabled and should be restored.
Resolved		Jdlrobson	T220658 Minerva browser tests must be configured to run on the mobile domain
Resolved		Jdrewniak	T220659 Enable a MobileFrontend daily Selenium build
Open		None	T221579 Port "Page actions menu when anonymous.Receive notification message - Watchlist Icon" browser test to Node.js from Ruby
Open		None	T245250 Review MinervaNeue Selenium tests
Resolved		None	T246881 +2 for Edtadros for mediawiki/skins/MinervaNeue
Resolved		zeljkofilipin	T251543 MinervaNeue Selenium tests fail when targeting MediaWiki-Docker
Resolved		Edtadros	T177261 Remove QuickSurveys browser tests written in Ruby
Declined		None	T177260 Rewrite disabled MobileFrontend browser tests to phpunit tests and Node.js browser tests
Resolved		Jdlrobson	T181509 [Spike 8hrs] Document missing (?) features of the Node.js automated browser testing stack
Resolved		zeljkofilipin	T139740 Port Selenium tests from Ruby to Node.js
Resolved		zeljkofilipin	T158052 Set up Selenium tests in Node.js for RelatedArticles extension
Resolved		Jdlrobson	T177262 [subtask] Rewrite Page Previews browser tests in Node.js
Resolved		zeljkofilipin	T179546 Popups Selenium tests daily targeting beta cluster
Resolved		zeljkofilipin	T179406 Documentation for selenium-RelatedArticles-jessie

Event Timeline

Jdlrobson created this task.Nov 1 2017, 10:43 PM

Jdlrobson added a project: Release-Engineering-Team.

greg edited projects, added Browser-Tests, Release-Engineering-Team (Backlog); removed Release-Engineering-Team.Nov 1 2017, 10:46 PM

zeljkofilipin claimed this task.Nov 2 2017, 10:30 AM

zeljkofilipin moved this task from Backlog 🪒 to Deep work 🌊 on the User-zeljkofilipin board.

zeljkofilipin moved this task from Backlog to Kanban on the Release-Engineering-Team board.

zeljkofilipin edited projects, added Release-Engineering-Team (Kanban); removed Release-Engineering-Team (Backlog).

zeljkofilipin moved this task from Backlog to In-progress on the Release-Engineering-Team (Kanban) board.

zeljkofilipin added a parent task: T139740: Port Selenium tests from Ruby to Node.js.Nov 2 2017, 12:30 PM

zeljkofilipin added a subtask: T179406: Documentation for selenium-RelatedArticles-jessie.

Test job: https://integration.wikimedia.org/ci/job/selenium-Popups-jessie-T179546/

All green, looking how to implement it in JJB.

https://integration.wikimedia.org/ci/job/selenium-Popups-jessie-T179546/7/console

+ MEDIAWIKI_USER='Selenium user'
+ MW_SERVER=https://en.wikipedia.beta.wmflabs.org:443
+ MW_SCRIPT_PATH=/w
+ ./node_modules/.bin/wdio tests/selenium/wdio.conf.jenkins.js --spec extensions/Popups/tests/selenium/specs/previews.js
Starting ChromeDriver 2.27 (undefined) on port 4444
Only local connections are allowed.

------------------------------------------------------------------
[chrome #0-0] Session ID: 482368f24a872bddf177d2369e7bb141
[chrome #0-0] Spec: /home/jenkins/workspace/selenium-Popups-jessie-T179546/src/extensions/Popups/tests/selenium/specs/previews.js
[chrome #0-0] Running: chrome
[chrome #0-0]
[chrome #0-0]   Dwelling on a valid link
[chrome #0-0]
[chrome #0-0]   Dwelling on a valid link
[chrome #0-0]       ✓ I should see a preview
[chrome #0-0]       ✓ Abandoning link hides preview
[chrome #0-0]
[chrome #0-0]
[chrome #0-0] 2 passing (7s)
[chrome #0-0]

Change 388081 had a related patch set uploaded (by Zfilipin; owner: Zfilipin):
[integration/config@master] Refactor selenium-RelatedArticles-jessie job selenium-{name}-jessie job template

https://gerrit.wikimedia.org/r/388081

gerritbot added a project: Patch-For-Review.Nov 2 2017, 4:29 PM

I am not sure why to job fails: https://integration.wikimedia.org/ci/view/Selenium/job/selenium-Popups-jessie/1/

Change 388127 had a related patch set uploaded (by Jdlrobson; owner: Jdlrobson):
[operations/mediawiki-config@master] [labs] Unconditionally enable popups for anonymous users on beta cluster

https://gerrit.wikimedia.org/r/388127

Change 388127 merged by jenkins-bot:
[operations/mediawiki-config@master] [labs] Unconditionally enable popups for anonymous users on beta cluster

https://gerrit.wikimedia.org/r/388127

phuedx mentioned this in T177262: [subtask] Rewrite Page Previews browser tests in Node.js.Nov 6 2017, 2:43 PM