Port Selenium tests from Ruby to Node.js
Open, Needs TriagePublic
Actions

Assigned To

None

Authored By

	• zeljkofilipin
	Jul 8 2016, 12:38 PM

Description

TODO

Repository	Task/Commit	Code	Status	Team	Daily Jenkins Job	mwselenium-quibble-docker pipelines	mwselenium-quibble-docker scenarios
mediawiki/extensions/Wikibase	T180228	tests/browser repo/tests/selenium/	🚀	WMDE Engineering		test, gate-and-submit	8
mediawiki/skins/MinervaNeue	T174018	tests/browser/ tests/selenium/	🚀	Readers-Web-Backlog	selenium-MinervaNeue	test, postmerge	24

Stats

Status	Repositories (28)	%
💣 Not started	0	0
🚀 In progress	2	7
🗑 Done: Ruby -> N/A	14	54
✅ Done: Ruby -> Node	11	39
Overall
Open (💣+🚀)	2	7
Done (🗑+✅)	26	93

Team	Repositories (28)	Summary	Task
N/A (CentralAuth and TwnMainPage)	2	🗑🗑	T173989
Discovery Discovery-ARCHIVED	1	✅	T174103
Editing team VisualEditor	2	🗑✅	T162455 T150435
Fundraising tech Fundraising-Backlog	1	🗑	T180223
Global Collaboration Global-Collaboration Collaboration-Team-Triage	8	🗑🗑🗑🗑🗑🗑🗑✅	T174594
Multimedia Multimedia	1	🗑	T180226
Reading	1	🗑
Reading Infrastructure Product-Infrastructure-Team-Backlog-Deprecated	1	🗑
Reading Web Readers-Web-Backlog	5	🚀🗑✅✅ ✅	T162256
Release Engineering Release-Engineering-Team	1	✅	T164004
WMDE Engineering	5	🚀✅✅✅✅	T180451

Status

Repository	Task/Commit	Code	Status	Team
mediawiki/core	T164004	tests/selenium	✅	Release-Engineering-Team
mediawiki/extensions/CentralAuth	T173989	tests/browser	🗑	N/A
mediawiki/extensions/CentralNotice	T180223	tests/browser	🗑	Fundraising-Backlog
mediawiki/extensions/CirrusSearch	T174103	tests/integration tests/selenium	✅	Discovery-ARCHIVED
mediawiki/extensions/ContentTranslation	T174595	N/A	🗑	Global-Collaboration
mediawiki/extensions/Echo	T171848	tests/selenium	✅	Global-Collaboration
mediawiki/extensions/ElectronPdfService	T180246	tests/selenium	✅	WMDE Engineering
mediawiki/extensions/Flow	T174591	N/A	🗑	Global-Collaboration
mediawiki/extensions/GettingStarted	T180224	tests/browser	🗑	Global-Collaboration
mediawiki/extensions/Math	T162455	tests/selenium	✅	VisualEditor
mediawiki/extensions/MobileFrontend	T177260	tests/selenium	✅	Readers-Web-Backlog
mediawiki/extensions/MultimediaViewer	T180226	tests/browser	🗑	Multimedia
mediawiki/extensions/PageTriage	T174589	N/A	🗑	Global-Collaboration
mediawiki/extensions/PdfHandler	381465	N/A	🗑	Product-Infrastructure-Team-Backlog-Deprecated
mediawiki/extensions/Popups	T177262	tests/selenium	✅	Readers-Web-Backlog
mediawiki/extensions/QuickSurveys	T177261	tests/browser	🗑	Readers-Web-Backlog
mediawiki/extensions/RelatedArticles	T164024	tests/selenium	✅	Readers-Web-Backlog
mediawiki/extensions/RevisionSlider	T180247	tests/browser tests/selenium/	✅	WMDE Engineering
mediawiki/extensions/Translate	(T174594) 381467	N/A	🗑	Global-Collaboration
mediawiki/extensions/TwnMainPage	381478	N/A	🗑	N/A
mediawiki/extensions/TwoColConflict	T180248	tests/selenium	✅	WMDE Engineering
mediawiki/extensions/UniversalLanguageSelector	(T174594) 381481	N/A	🗑	Global-Collaboration
mediawiki/extensions/VisualEditor	T150435	N/A	🗑	VisualEditor
mediawiki/extensions/Wikibase	T180228	tests/browser repo/tests/selenium/	🚀	WMDE Engineering
mediawiki/extensions/WikibaseLexeme	T179916	tests/selenium	✅	WMDE Engineering
mediawiki/extensions/WikiLove	T174593	N/A	🗑	Global-Collaboration
mediawiki/extensions/ZeroPortal	381774	N/A	🗑	Reading
mediawiki/skins/MinervaNeue	T174018	tests/browser/ tests/selenium/	🚀	Readers-Web-Backlog

Timeline

Description	Links	Status	Start	End (~Estimated)
Initial research.	256404 malu	✅	2015-12	2016-05
Browser testing user satisfaction survey.	Browser testing user satisfaction survey	✅	2016-07	2016-09
Run WebdriverIO jobs in experimental pipeline for mediawiki/core and extensions.	324416 326949 334136 337590	✅	2016-11	2017-02
Announce WebdriverIO to small group of early adopters.	N/A	✅	2017-01	2017-02
Investigating three popular Selenium packages: WebDriverJs, WebdriverIO, Nightwatch.js.	323401 328191 328349	✅	2016-11	2017-03
Update documentation.	T161103	✅	2017-03	2017-03
Announce WebdriverIO on appropriate mailing lists (QA, engineering, wikitech-l).	qa engineering wikitech-l	✅	2017-03	2017-04
WebdriverIO in person workshop(s). (European hackathon...)	T159945	✅	2017-03	2017-05
Run WebdriverIO jobs in test and gate-and-submit pipelines for mediawiki/core and extensions, voting.	324719 T164721	✅	2016-12	2017-07
Create Jenkins jobs that runs WebdriverIO tests daily targeting beta cluster.	T171847	✅	2017-07	2017-09
Announce Ruby framework deprecation on appropriate mailing lists (QA, engineering, wikitech-l).	T173488	✅	2017-08	2017-10
WebdriverIO online workshop(s) (CREDIT, Tech talks...).	T164070 T171852	✅	2017-04	2017-10
Delete Ruby jobs as tests are moved to Node.js.	See status table.	🚀	2017-03	N/A
Pairing on WebdriverIO with teams that need help.	See status table.	🚀	2017-05	N/A

Details

Project	Branch	Lines +/-	Subject
mediawiki/vagrant	master	+6 -240	Remove support for Ruby browser tests
mediawiki/core	master	+4 -0	Document how to run just one Selenium test
mediawiki/core	master	+0 -3	ESLint ecmaVersion setting is not needed if env is es6
integration/config	master	+7 -0	Run qunit-selenium job for all repositories that have Selenium tests
integration/config	master	+0 -8	Deleted RelatedArticles Selenium Ruby Jenkins job
mediawiki/core	master	+9 -0	Make running Selenium tests using Sauce Labs easy
integration/config	master	+38 -71	Run webdriverio tests for MediaWiki core
integration/config	master	+29 -71	Run webdriverio tests for MediaWiki core
mediawiki/core	master	+574 -2	Selenium tests in Node.js using WebdriverIO
mediawiki/core	master	+283 -1	WIP Selenium tests in Node.js using WebDriverJs
integration/config	master	+1 -1	Let node-config know it should use Jenkins configuration file for running Selenium tests.
integration/config	master	+44 -6	Properly inject SKIN_DEPENDENCIES
integration/config	master	+9 -7	Reuse macro in mediawiki-core-selenium-jessie
integration/config	master	+48 -1	Run Node.js Selenium job for mediawiki/core in experimental pipeline
integration/config	master	+5 -0	WIP mediawiki-core-qunit-jessie Jenkins job needs Vector skin

Related Objects
Search...

Status	Subtype	Assigned	Task
Resolved		Jdlrobson	T162936 Improve developer happiness in reading web maintained extensions
Open		None	T139740 Port Selenium tests from Ruby to Node.js
Resolved		• zeljkofilipin	T151442 Research webdriver.io
Resolved		• zeljkofilipin	T151443 Research nightwatchjs
Resolved		• zeljkofilipin	T161103 Write documentation on Selenium tests in Node.js
Declined		Ryasmeen	T150435 Selenium tests for VisualEditor in Node.js
Declined		None	T162256 [EPIC] Port Selenium tests from Ruby to Node.js on Reading Web extensions
Resolved		• zeljkofilipin	T158052 Set up Selenium tests in Node.js for RelatedArticles extension
Resolved		• zeljkofilipin	T164024 Rewrite Related pages browser tests in Node.js
Duplicate		Jdlrobson	T160238 Rewrite MobileFrontend and Page previews automated browser tests in Node.js
Resolved		Jdlrobson	T177262 [subtask] Rewrite Page Previews browser tests in Node.js
Resolved		• zeljkofilipin	T179546 Popups Selenium tests daily targeting beta cluster
Resolved		• zeljkofilipin	T179406 Documentation for selenium-RelatedArticles-jessie
Resolved		• zeljkofilipin	T171847 Create Jenkins job that runs RelatedArticles Selenium tests daily
Declined		None	T174018 Port Minerva's 7 Ruby-based browser tests to Selenium Node.js
Resolved		Jdlrobson	T190710 Minerva Ruby and Node.js browser tests running side by side
Resolved		None	T179190 Run Selenium Cucumber tests in CI
Resolved		awight	T199116 Quibble should run `npm install` and `npm run selenium-test` for each extension/skin that has Selenium tests
Duplicate		Legoktm	T225330 Commit package-lock.json files everywhere
Stalled		None	T229033 wdio-cucumber-framework fails on NodeJS due to fibers@2.x under nodejs10
Open		None	T217113 MediaWiki-Vagrant should use the same Node.js version as Wikimedia production
Resolved		• zeljkofilipin	T232495 selenium-daily-beta-CirrusSearch is broken
Resolved		hashar	T229065 Quibble extension selenium test fails with: gyp ERR! stack Error: Can't find Python executable "python", you can set the PYTHON env variable.
Open		None	T199939 Audit tests/selenium/LocalSettings.php file aiming at possibly deprecating the feature
Resolved	PRODUCTION ERROR	Jdlrobson	T219920 CI tests disabled: Steps that require login are disabled and should be restored.
Resolved		Jdlrobson	T220658 Minerva browser tests must be configured to run on the mobile domain
Resolved		Jdrewniak	T220659 Enable a MobileFrontend daily Selenium build
Open		None	T221579 Port "Page actions menu when anonymous.Receive notification message - Watchlist Icon" browser test to Node.js from Ruby
Open		None	T245250 Review MinervaNeue Selenium tests
Resolved		None	T246881 +2 for Edtadros for mediawiki/skins/MinervaNeue
Resolved		• zeljkofilipin	T251543 MinervaNeue Selenium tests fail when targeting MediaWiki-Docker
Resolved		Edtadros	T177261 Remove QuickSurveys browser tests written in Ruby
Open		ovasileva	T177260 Rewrite disabled MobileFrontend browser tests to phpunit tests and Node.js browser tests
Resolved		Jdlrobson	T181509 [Spike 8hrs] Document missing (?) features of the Node.js automated browser testing stack
Resolved		Physikerwelt	T162455 Selenium tests for Math
Resolved		hashar	T162674 Upgrade our JJB fork to support Junit `allow-empty-results`
Resolved		• zeljkofilipin	T164002 Update documentation for mediawiki-core-qunit-selenium-jessie Jenkins job
Resolved		• zeljkofilipin	T164004 Delete Ruby+Selenium Jenkins jobs for mediawiki/core
Resolved		• zeljkofilipin	T164070 WebdriverIO CREDIT showcase
Invalid		• zeljkofilipin	T167153 `npm run selenium` fails for node 8 and/or npm 5
Resolved		• zeljkofilipin	T173488 Announce Selenium Ruby framework deprecation on appropriate mailing lists (QA, engineering, wikitech-l)
Resolved		• zeljkofilipin	T173989 Port CentralAuth Selenium tests from Ruby to Node
Resolved		debt	T174103 [Epic] Port Selenium tests from Ruby to Node.js for the Search Platform
Resolved		debt	T162966 Figure out why browser tests can't create suggestion box
Resolved		None	T174594 Global Collaboration: Migrate browser tests from Ruby to node.js
Resolved		Nikerabbit	T174595 ContentTranslation: Migrate browser tests from Ruby to node.js
Resolved		• zeljkofilipin	T174593 WikiLove: Remove Ruby browser tests
Duplicate		None	T174592 Echo: Migrate browser tests from Ruby to node.js
Resolved		• zeljkofilipin	T174591 Flow: Migrate browser tests from Ruby to node.js
Resolved		• zeljkofilipin	T174589 PageTriage: Remove Ruby browser tests
Resolved		Etonkovidova	T171848 Port Echo Selenium tests from Ruby to Node.js
Resolved		• zeljkofilipin	T180224 Port GettingStarted Selenium tests from Ruby to Node.js
Resolved		• zeljkofilipin	T171852 Tech talk: Selenium tests in Node.js
Resolved		• zeljkofilipin	T180223 Port CentralNotice Selenium tests from Ruby to Node.js
Declined		None	T198480 `MediaWiki internal error` after provisioning centralnotice role
Declined		None	T180226 Port MultimediaViewer Selenium tests from Ruby to Node.js
Open		None	T180451 Port Selenium tests from Ruby to Node.js for WMDE Engineering repositories
Resolved		WMDE-Fisch	T180246 Port ElectronPdfService Selenium tests from Ruby to Node.js
Resolved		None	T180247 Port RevisionSlider Selenium tests from Ruby to Node.js
Resolved		WMDE-Fisch	T267198 Port autoexpand.feature and expand.feature from Ruby to Node.js
Resolved		Andrew-WMDE	T267199 Port difflinks.feature from Ruby to Node.js
Resolved		lilients_WMDE	T267200 Port help.feature from Ruby to Node.js
Resolved		WMDE-Fisch	T267201 Port history.feature from Ruby to Node.js
Resolved		lilients_WMDE	T267204 Port tooltips.feature from Ruby to Node.js
Resolved		awight	T267205 Port timeline.feature from Ruby to Node.js
Resolved		awight	T267206 Port pointers.feature from Ruby to Node.js
Resolved		WMDE-Fisch	T180248 Port TwoColConflict Selenium tests from Ruby to Node.js
Open		None	T180228 Port Wikibase Selenium tests from Ruby to Node.js
Resolved		Michael	T221638 Investigate how to port Wikibase Selenium tests from Ruby to Node.js
Open		None	T222745 port Wikibase Selenium tests about termbox editing from Ruby to Node.js
Open		None	T222746 port Wikibase Selenium smoke tests from Ruby to Node.js
Open		None	T222748 port Wikibase Selenium tests about sitelinks from Ruby to Node.js
Open		None	T222749 port Wikibase Selenium tests about statements from Ruby to Node.js
Open		None	T222751 port Wikibase Selenium misc tests from Ruby to Node.js
Resolved		Lydia_Pintscher	T179916 Port WikibaseLexeme Selenium tests from Ruby to Node.js
Resolved		Rosalie_WMDE	T221644 Port WikibaseLexeme forms.feature Selenium tests from Ruby to Node.js
Resolved		Michael	T221645 Port WikibaseLexeme lexeme_header.feature Selenium tests from Ruby to Node.js
Resolved		Lucas_Werkmeister_WMDE	T221646 Port WikibaseLexeme non_existing_lexeme.feature Selenium tests from Ruby to Node.js
Resolved		noarave	T221647 Port WikibaseLexeme senses.feature Selenium tests from Ruby to Node.js
Resolved		Ladsgroup	T224301 Clean up ruby test infrastructure
Resolved		aaron	T180035 MediaWiki core Selenium tests fail when targeting Vagrant
Resolved		Krinkle	T220712 Provide generic wrapper inside wdio-mediawiki for API requests
Stalled		None	T220035 Drop Ruby Selenium CI jobs; we don't support them any more
Resolved		None	T222714 Remove the code for the first interface
Resolved		thiemowmde	T222441 TwoColConflict browser tests are flapping
Resolved		thiemowmde	T208994 Flaky TwoColConflict test "The help dialog is visible" (mwselenium)
Resolved		hashar	T240575 Phase out legacy saucelabs/mediawiki_selenium instances
Duplicate		None	T274904 Delete CI configuration for Ruby Selenium jobs
Open		None	T242293 Archive mediawiki/selenium?
Open		None	T228160 Mark mediawiki_api and mediawiki_selenium Ruby gems as deprecated

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes

In T139740#5317419, @Jdlrobson wrote:

Is this ticket about getting rid of Ruby or porting all tests to Node.js

This ticket is about getting rid of Ruby Selenium tests. Either by porting them to Node or by deleting them.

• zeljkofilipin mentioned this in T227584: mediawiki_api Ruby gem improvements.Jul 10 2019, 10:32 AM

• zeljkofilipin removed • zeljkofilipin as the assignee of this task.Jul 10 2019, 11:52 AM

• zeljkofilipin moved this task from In Progress 🎸 to Watching 📺 on the User-zeljkofilipin board.

• zeljkofilipin claimed this task.Jul 10 2019, 12:36 PM

• zeljkofilipin moved this task from Watching 📺 to In Progress 🎸 on the User-zeljkofilipin board.

• zeljkofilipin edited projects, added Release-Engineering-Team-TODO (201907); removed Release-Engineering-Team-TODO.

• zeljkofilipin moved this task from INBOX to Doing on the Release-Engineering-Team-TODO (201907) board.

• zeljkofilipin updated the task description. (Show Details)Jul 10 2019, 12:47 PM

• zeljkofilipin updated the task description. (Show Details)

• zeljkofilipin updated the task description. (Show Details)Jul 10 2019, 12:50 PM

• zeljkofilipin updated the task description. (Show Details)

• zeljkofilipin updated the task description. (Show Details)Jul 10 2019, 12:53 PM

• zeljkofilipin updated the task description. (Show Details)Jul 10 2019, 1:20 PM

• zeljkofilipin updated the task description. (Show Details)Jul 10 2019, 1:23 PM

• zeljkofilipin removed • zeljkofilipin as the assignee of this task.Jul 10 2019, 1:32 PM

• zeljkofilipin moved this task from Doing to Done (within RelEng) on the Release-Engineering-Team-TODO (201907) board.

• zeljkofilipin moved this task from In Progress 🎸 to Watching 📺 on the User-zeljkofilipin board.

• zeljkofilipin changed the status of subtask T173989: Port CentralAuth Selenium tests from Ruby to Node from Stalled to Open.Jul 10 2019, 2:00 PM

• zeljkofilipin claimed this task.Jul 10 2019, 4:30 PM

• zeljkofilipin moved this task from Done (within RelEng) to Doing on the Release-Engineering-Team-TODO (201907) board.

• zeljkofilipin moved this task from Watching 📺 to In Progress 🎸 on the User-zeljkofilipin board.

• zeljkofilipin updated the task description. (Show Details)Jul 11 2019, 1:28 PM

• zeljkofilipin rescinded a token.Jul 11 2019, 1:48 PM

• zeljkofilipin awarded a token.

• zeljkofilipin updated the task description. (Show Details)Jul 11 2019, 1:57 PM

• zeljkofilipin updated the task description. (Show Details)

• zeljkofilipin updated the task description. (Show Details)Jul 11 2019, 1:59 PM

• zeljkofilipin updated the task description. (Show Details)

• zeljkofilipin updated the task description. (Show Details)Jul 11 2019, 2:01 PM

• zeljkofilipin removed • zeljkofilipin as the assignee of this task.Jul 11 2019, 2:04 PM

• zeljkofilipin moved this task from Doing to Blocked externally on the Release-Engineering-Team-TODO (201907) board.

• zeljkofilipin moved this task from In Progress 🎸 to Watching 📺 on the User-zeljkofilipin board.

• zeljkofilipin updated the task description. (Show Details)Jul 12 2019, 1:31 PM

• zeljkofilipin updated the task description. (Show Details)Jul 12 2019, 2:34 PM

• zeljkofilipin updated the task description. (Show Details)Jul 12 2019, 2:46 PM

• zeljkofilipin updated the task description. (Show Details)Jul 12 2019, 2:49 PM

• zeljkofilipin closed subtask T173989: Port CentralAuth Selenium tests from Ruby to Node as Resolved.Jul 12 2019, 3:20 PM

• zeljkofilipin closed subtask T180223: Port CentralNotice Selenium tests from Ruby to Node.js as Resolved.

• zeljkofilipin updated the task description. (Show Details)

• zeljkofilipin updated the task description. (Show Details)Jul 12 2019, 3:22 PM

• zeljkofilipin updated the task description. (Show Details)

• zeljkofilipin updated the task description. (Show Details)Jul 12 2019, 3:25 PM

• zeljkofilipin updated the task description. (Show Details)Jul 12 2019, 3:29 PM

Jdforrester-WMF edited projects, added Release-Engineering-Team-TODO (201908); removed Release-Engineering-Team-TODO (201907).Jul 29 2019, 4:32 PM

Jdforrester-WMF moved this task from INBOX to Blocked externally on the Release-Engineering-Team-TODO (201908) board.

Jdlrobson closed subtask T162256: [EPIC] Port Selenium tests from Ruby to Node.js on Reading Web extensions as Declined.Aug 1 2019, 8:22 PM

thcipriani moved this task from 201908 to Blocked externally on the Release-Engineering-Team-TODO board.Sep 3 2019, 4:16 PM

thcipriani edited projects, added Release-Engineering-Team-TODO; removed Release-Engineering-Team-TODO (201908).

• zeljkofilipin mentioned this in T230729: Evaluate Cypress as a WebdriverIO replacement for our browser automation framework.Sep 4 2019, 2:52 PM

@zeljkofilipin can you update the description of this task?

There are also a lot of sub tasks still open, yet Jenkins only has jobs for two repositories. The last two CI jobs carrying the label BrowserTests ( https://integration.wikimedia.org/ci/label/BrowserTests/ ) are: