Page MenuHomePhabricator
Create Task
Maniphest T188742

Run tests daily targeting beta cluster for all repositories with Selenium tests
Open, Needs TriagePublic
Actions

Description

selenium-EXTENSION-jessie Jenkins job is currently running for only 3 extensions, CirrusSearch, Popups and RelatedArticles.

For list of repositories with Selenium tests see Write tests section of Selenium/Node.js page.

TODO

🏝 Rename and update Selenium/Node.js/selenium-EXTENSION-jessie_Jenkins_job
🏝 Ask extension developers if they think the job would be useful for their repository
👽 bug:T188742 is:open

Done

🤖 bug:T188742 -is:open

Repositories with Nodepool jobs

RepositoryTask/CommitDocker
mediawiki/extensions/CirrusSearchT193244 444609 456128selenium-daily-beta-CirrusSearch ☀️
mediawiki/extensions/Echo444235 456134selenium-daily-beta-Echo ☀️
mediawiki/extensions/Math445643 457486selenium-daily-beta-Math ☀️
mediawiki/extensions/Popups449485selenium-daily-beta-Popups ☀️
mediawiki/extensions/RelatedArticles445646 457488selenium-daily-beta-RelatedArticles ☀️

Repositories with new jobs

RepositoryTask/CommitDockerError
mediawiki/coreT185011 446371 456131selenium-daily-beta-MediaWiki ☀️
mediawiki/extensions/AdvancedSearch460395 460516selenium-daily-beta-AdvancedSearch
mediawiki/extensions/ElectronPdfService460552 460563selenium-daily-beta-ElectronPdfService ☀️Requires a maintainer to receive email notifications!
mediawiki/extensions/Newsletter460555 460565selenium-daily-beta-Newsletter
mediawiki/extensions/OREST198201 460388 460517selenium-daily-beta-ORES
mediawiki/extensions/TwoColConflict460560 460570selenium-daily-beta-TwoColConflict 💣ERROR: Cannot find module '../../../../../tests/selenium/pageobjects/edit.page'
mediawiki/extensions/WikibaseT167432 445649 460526selenium-daily-beta-Wikibase ☀️T204205
mediawiki/extensions/WikibaseLexeme445652 441827 460527selenium-daily-beta-WikibaseLexeme 💣T200011 Promise was rejected with the following reason: timeout

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
jjb: Cleanup of selenium-daily-beta-* jobsintegration/configmaster+2 -2
WIP Selenium: set up daily job for GrowthExperimentsintegration/configmaster+4 -0
Create selenium-daily-beta-AdvancedSearch Jenkins jobintegration/configmaster+4 -0
Create selenium-daily-beta-TwoColConflict Jenkins jobintegration/configmaster+4 -0
Create selenium-daily-beta-ORES Jenkins jobintegration/configmaster+4 -0
Selenium: add selenium-daily NPM scriptmediawiki/extensions/AdvancedSearchmaster+1 K -218
Create selenium-daily-beta-ElectronPdfService Jenkins jobintegration/configmaster+5 -0
Create selenium-daily-beta-WikibaseLexeme Jenkins jobintegration/configmaster+5 -0
Selenium daily tests for beta using Docker/wdiointegration/configmaster+68 -62
Create selenium-daily-beta-Newsletter Jenkins jobintegration/configmaster+4 -0
Create selenium-daily-beta-Wikibase Jenkins jobintegration/configmaster+5 -0
Selenium: add selenium-daily NPM scriptmediawiki/extensions/TwoColConflictmaster+1 -0
Selenium: add selenium-daily NPM scriptmediawiki/extensions/ElectronPdfServicemaster+138 -5
Selenium: add selenium-daily NPM scriptmediawiki/extensions/Newslettermaster+132 -2
WIP selenium-daily-beta jobsintegration/configmaster+10 -0
Selenium: add selenium-daily NPM scriptmediawiki/extensions/ORESmaster+1 -0
jjb: npm-install-selenium macro is no more usedintegration/configmaster+0 -11
Selenium: Simplify selenium-daily NPM scriptmediawiki/extensions/RelatedArticlesmaster+1 -1
Selenium: add selenium-daily NPM scriptmediawiki/extensions/Popupsmaster+134 -5
Selenium: Simplify selenium-daily NPM scriptmediawiki/extensions/Mathmaster+1 -1
Selenium: Simplify selenium-daily NPM scriptmediawiki/extensions/Echomaster+1 -1
Selenium: selenium-daily NPM scriptmediawiki/coremaster+1 -0
Selenium: update configuration filemediawiki/extensions/CirrusSearchmaster+48 -10
Selenium: add selenium-daily NPM scriptmediawiki/coremaster+1 -0
Selenium: Simplify selenium-daily NPM scriptmediawiki/extensions/CirrusSearchmaster+1 -1
jjb: simplify selenium definitionsintegration/configmaster+66 -118
Selenium: add selenium-daily NPM scriptmediawiki/extensions/RelatedArticlesmaster+96 -1
Selenium: add selenium-daily NPM scriptmediawiki/extensions/Mathmaster+1 -0
Selenium: add selenium-daily NPM scriptmediawiki/extensions/Wikibasemaster+7 -1
Selenium: add selenium-daily NPM scriptmediawiki/extensions/WikibaseLexememaster+1 K -11
Selenium: use wdio-mediawiki NPM packagemediawiki/extensions/CirrusSearchmaster+4 -2
Order packages in package.jsonmediawiki/extensions/CirrusSearchmaster+6 -6
Remove `^` from package.jsonmediawiki/extensions/CirrusSearchmaster+9 -9
Selenium: Create selenium-daily NPM scriptmediawiki/extensions/CirrusSearchmaster+91 -1
Selenium: Create selenium-daily npm scriptmediawiki/extensions/Echomaster+2 -1
Job running Echo Selenium tests daily targeting beta clusterintegration/configmaster+9 -0
Show related patches Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 OpenNoneT188742 Run tests daily targeting beta cluster for all repositories with Selenium tests
 ResolvedWMDE-leszekT194252 Configure the CI job that runs WikibaseLexeme's browser tests against beta wikidata
 ResolvedAddshoreT191459 Deploy WikibaseLexeme to the Beta Cluster
 ResolvedJakob_WMDET188899 [Task] Remove hard-coded demo data from Lexeme code base
 Resolved• dpatrickT168264 Security review of vue.js library
 ResolvedAddshoreT191507 Add symfony/validator to mediawiki-vendor
 ResolvedNoneT191638 Security review of symfony/validator library
 ResolvedAddshoreT191618 Add wmde/php-vuejs-templating to mediawiki vendor
 ResolvedBawolffT186726 Security review WikibaseLexeme extension
 ResolvedAddshoreT184745 Prepare config for WikibaseLexeme on beta wikidata
ResolvedzeljkofilipinT197868 `Class 'Wikibase\DataModel\Entity\ItemId' not found` error when trying to install WikibaseLexeme
 ResolvedNoneT197875 LoadError when running selenium-WikibaseLexeme-chrome Jenkins job
 ResolvedzeljkofilipinT197882 jenkins_jobs.errors.JenkinsJobsException: Duplicate entry found in '/src/integration/config/jjb/selenium.yaml: 'WikibaseLexeme' already defined
 ResolvedAddshoreT200011 `ERROR: Cannot find module '../../../../Wikibase/repo/tests/selenium` when running WikibaseLexeme-npm-browser-run-selenium-daily-node-6-docker Jenkins job
 ResolvedzeljkofilipinT185011 Create selenium-daily-beta-MediaWiki daily Jenkins job
 ResolvedzeljkofilipinT203591 Popups daily jobs currently unusable
 ResolvedAddshoreT167432 Run Wikibase daily browser tests on Jenkins
 OpenNoneT188507 Consider Elastic/CirrusSearch index update in Wikibase daily browser tests
 Duplicate• alaa_wmdeT208851 Rewrite Ruby browser tests as Javascsript browser tests
 ResolvedMichaelT211696 Investigate causes of failures of daily ruby browser tests targetting beta
 DeclinedNoneT213430 Fix `The save has failed. (failed-save) (MediawikiApi::ApiError)` daily ruby browser test error
 DeclinedNoneT213433 Fix `Watir::Wait::TimeoutError` daily ruby browser test error
 DeclinedNoneT213454 Fix `RSpec::Expectations::ExpectationNotMetError` daily ruby browser test errors
 ResolvedLucas_Werkmeister_WMDET209069 Make Wikibase daily node browser tests job targeting beta green....
 ResolvedLucas_Werkmeister_WMDET204205 selenium-daily-beta-Wikibase Jenkins job fails with: AssertionError: 'Q1xy' === 'Item:Q1xy'
 ResolvedLucas_Werkmeister_WMDET209072 Wikibase keyboard-based editing browser test fails on Beta
 ResolvedzeljkofilipinT267360 Re-enable selenium-daily-beta-AdvancedSearch
 ResolvedzeljkofilipinT354713 Add CampaignEvents to selenium daily
ResolvedzeljkofilipinT357510 selenium-daily-beta-Wikistories broken

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
Michael mentioned this in T222449: Make existing daily selenium nodejs tests for WikibaseLexeme green again.May 3 2019, 12:55 PM
gerritbot added a comment.May 8 2019, 3:14 PM

Change 460552 had a related patch set uploaded (by Zfilipin; owner: Zfilipin):
[integration/config@master] Create selenium-daily-beta-ElectronPdfService Jenkins job

https://gerrit.wikimedia.org/r/460552

gerritbot added a comment.May 8 2019, 3:14 PM

Change 460517 had a related patch set uploaded (by Zfilipin; owner: Zfilipin):
[integration/config@master] Create selenium-daily-beta-ORES Jenkins job

https://gerrit.wikimedia.org/r/460517

gerritbot added a comment.May 8 2019, 3:14 PM

Change 460560 had a related patch set uploaded (by Zfilipin; owner: Zfilipin):
[integration/config@master] Create selenium-daily-beta-TwoColConflict Jenkins job

https://gerrit.wikimedia.org/r/460560

gerritbot added a comment.May 8 2019, 3:14 PM

Change 460527 had a related patch set uploaded (by Zfilipin; owner: Zfilipin):
[integration/config@master] Create selenium-daily-beta-WikibaseLexeme Jenkins job

https://gerrit.wikimedia.org/r/460527

gerritbot added a comment.May 9 2019, 2:25 PM

Change 460527 merged by jenkins-bot:
[integration/config@master] Create selenium-daily-beta-WikibaseLexeme Jenkins job

https://gerrit.wikimedia.org/r/460527

zeljkofilipin updated the task description. (Show Details)May 9 2019, 2:29 PM
zeljkofilipin updated the task description. (Show Details)May 9 2019, 2:34 PM
zeljkofilipin updated the task description. (Show Details)
zeljkofilipin updated the task description. (Show Details)May 9 2019, 2:36 PM
zeljkofilipin updated the task description. (Show Details)May 9 2019, 2:40 PM
zeljkofilipin updated the task description. (Show Details)
zeljkofilipin updated the task description. (Show Details)May 9 2019, 2:42 PM
zeljkofilipin updated the task description. (Show Details)
gerritbot added a comment.May 16 2019, 10:56 AM

Change 460516 abandoned by Hashar:
Create selenium-daily-beta-AdvancedSearch Jenkins job

Reason:
I have removed the job:

npm ERR! missing script: selenium-daily

https://gerrit.wikimedia.org/r/460516

hashar updated the task description. (Show Details)May 16 2019, 11:00 AM
gerritbot added a comment.May 16 2019, 11:03 AM

Change 460552 merged by jenkins-bot:
[integration/config@master] Create selenium-daily-beta-ElectronPdfService Jenkins job

https://gerrit.wikimedia.org/r/460552

gerritbot added a comment.May 18 2019, 9:26 AM

Change 460395 merged by jenkins-bot:
[mediawiki/extensions/AdvancedSearch@master] Selenium: add selenium-daily NPM script

https://gerrit.wikimedia.org/r/460395

Tobi_WMDE_SW subscribed.May 18 2019, 10:34 AM
In T188742#5186473, @gerritbot wrote:

Change 460516 abandoned by Hashar:
Create selenium-daily-beta-AdvancedSearch Jenkins job

Reason:
I have removed the job:

npm ERR! missing script: selenium-daily

https://gerrit.wikimedia.org/r/460516

@hashar @zeljkofilipin should we restore the patch, now that https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/AdvancedSearch/+/460395/ has been merged?

gerritbot added a comment.May 20 2019, 6:50 PM

Change 460516 restored by Hashar:
Create selenium-daily-beta-AdvancedSearch Jenkins job

https://gerrit.wikimedia.org/r/460516

hashar added a comment.May 20 2019, 6:52 PM

@Tobi_WMDE_SW I have reopened it :] Can you suggest on the change an email to send notifications to?

zeljkofilipin moved this task from Quarter 👔 to Deep work 🌊 on the User-zeljkofilipin board.May 23 2019, 10:44 AM
gerritbot added a comment.Jun 13 2019, 8:33 PM

Change 460517 merged by jenkins-bot:
[integration/config@master] Create selenium-daily-beta-ORES Jenkins job

https://gerrit.wikimedia.org/r/460517

gerritbot added a comment.Jun 19 2019, 8:02 AM

Change 460516 abandoned by Hashar:
Create selenium-daily-beta-AdvancedSearch Jenkins job

Reason:
Job has not been deployed, I guess there is not much interest.

https://gerrit.wikimedia.org/r/460516

gerritbot added a comment.Jun 19 2019, 9:05 AM

Change 460516 restored by Hashar:
Create selenium-daily-beta-AdvancedSearch Jenkins job

Reason:
;D let me deploy it so! I thought the idea got abandoned.

https://gerrit.wikimedia.org/r/460516

hashar added a comment.Jun 19 2019, 9:08 AM

https://integration.wikimedia.org/ci/job/selenium-daily-beta-AdvancedSearch/1/console deployed

gerritbot added a comment.Jun 19 2019, 9:09 AM

Change 460516 merged by jenkins-bot:
[integration/config@master] Create selenium-daily-beta-AdvancedSearch Jenkins job

https://gerrit.wikimedia.org/r/460516

hashar updated the task description. (Show Details)Jun 19 2019, 9:14 AM
gerritbot added a comment.Jun 19 2019, 9:17 AM

Change 460560 merged by jenkins-bot:
[integration/config@master] Create selenium-daily-beta-TwoColConflict Jenkins job

https://gerrit.wikimedia.org/r/460560

hashar updated the task description. (Show Details)Jun 19 2019, 9:18 AM

I merged all integration/config patches that were still pending.

TwoColConflicts still has:
ERROR: Cannot find module '../../../../../tests/selenium/pageobjects/edit.page'

ORES has a single test which is skipped. So the job usefulness is doubtful.

AdvancedSearch https://integration.wikimedia.org/ci/job/selenium-daily-beta-AdvancedSearch/ has some failures.

zeljkofilipin claimed this task.Jun 19 2019, 10:28 AM
greg edited projects, added Release-Engineering-Team-TODO (201907); removed Release-Engineering-Team (Kanban).Jul 1 2019, 9:25 PM
greg moved this task from INBOX to Ready on the Release-Engineering-Team-TODO (201907) board.Jul 1 2019, 9:27 PM
greg edited projects, added Release-Engineering-Team-TODO; removed Release-Engineering-Team-TODO (201907).Jul 6 2019, 4:34 AM
greg moved this task from Should be empty (use Release-Engineering-Team) to Next on the Release-Engineering-Team-TODO board.Jul 6 2019, 5:32 AM
greg added a project: Release-Engineering-Team (Unit & Int & System Tooling).Jul 6 2019, 5:50 AM
zeljkofilipin edited projects, added Release-Engineering-Team-TODO (201907); removed Release-Engineering-Team-TODO.Jul 9 2019, 12:01 PM
zeljkofilipin moved this task from Ready to Doing on the Release-Engineering-Team-TODO (201907) board.
Addshore closed subtask T167432: Run Wikibase daily browser tests on Jenkins as Resolved.Jul 10 2019, 5:36 PM
zeljkofilipin removed zeljkofilipin as the assignee of this task.Jul 11 2019, 1:51 PM
zeljkofilipin moved this task from Doing to Ready on the Release-Engineering-Team-TODO (201907) board.
zeljkofilipin moved this task from Deep work 🌊 to Quarter 👔 on the User-zeljkofilipin board.
zeljkofilipin claimed this task.Jul 17 2019, 10:21 AM
zeljkofilipin moved this task from Ready to Doing on the Release-Engineering-Team-TODO (201907) board.
zeljkofilipin moved this task from Quarter 👔 to Deep work 🌊 on the User-zeljkofilipin board.
zeljkofilipin removed zeljkofilipin as the assignee of this task.Jul 19 2019, 1:20 PM
zeljkofilipin moved this task from Doing to Ready on the Release-Engineering-Team-TODO (201907) board.
zeljkofilipin moved this task from Deep work 🌊 to Backlog 🪒 on the User-zeljkofilipin board.
Jdforrester-WMF edited projects, added Release-Engineering-Team-TODO (201908); removed Release-Engineering-Team-TODO (201907).Jul 29 2019, 4:34 PM
Jdforrester-WMF moved this task from INBOX to Ready on the Release-Engineering-Team-TODO (201908) board.
zeljkofilipin moved this task from Backlog 🪒 to Quarter 👔 on the User-zeljkofilipin board.Aug 22 2019, 5:46 PM
zeljkofilipin edited projects, added Release-Engineering-Team-TODO (201909); removed Release-Engineering-Team-TODO (201908).Sep 4 2019, 2:56 PM
zeljkofilipin moved this task from INBOX to Ready on the Release-Engineering-Team-TODO (201909) board.
zeljkofilipin edited projects, added Release-Engineering-Team-TODO (201910); removed Release-Engineering-Team-TODO (201909).Oct 2 2019, 1:56 PM
Jdforrester-WMF edited projects, added Release-Engineering-Team-TODO (201911); removed Release-Engineering-Team-TODO (201910).Nov 6 2019, 4:24 PM
hashar unsubscribed.Nov 7 2019, 1:19 PM
Jdforrester-WMF edited projects, added Release-Engineering-Team-TODO (201912); removed Release-Engineering-Team-TODO (201911).Dec 2 2019, 7:31 PM
zeljkofilipin removed a project: Release-Engineering-Team-TODO (201912).Dec 3 2019, 9:18 AM
gerritbot added a comment.Dec 23 2019, 4:57 PM

Change 560412 had a related patch set uploaded (by Zfilipin; owner: Zfilipin):
[integration/config@master] WIP Selenium: set up daily job for GrowthExperiments

https://gerrit.wikimedia.org/r/560412

gerritbot added a comment.Dec 23 2019, 5:07 PM

Change 560412 abandoned by Zfilipin:
WIP Selenium: set up daily job for GrowthExperiments

https://gerrit.wikimedia.org/r/560412

zeljkofilipin moved this task from Quarter 👔 to Backlog 🪒 on the User-zeljkofilipin board.Feb 14 2020, 12:54 PM
• LarsWirzenius unsubscribed.Feb 20 2020, 3:25 PM
zeljkofilipin edited projects, added Quality-and-Test-Engineering-Team; removed Release-Engineering-Team (Unit & Int & System Tooling), MediaWiki-Core-Tests.Mar 16 2020, 2:10 PM
• Jrbranaa moved this task from Inbox to Test engineering on the Quality-and-Test-Engineering-Team board.Mar 23 2020, 7:24 PM
WMDE-leszek closed subtask T194252: Configure the CI job that runs WikibaseLexeme's browser tests against beta wikidata as Resolved.Oct 28 2020, 5:48 AM
WMDE-Fisch mentioned this in T267360: Re-enable selenium-daily-beta-AdvancedSearch.Nov 5 2020, 5:36 PM
zeljkofilipin added a subtask: T267360: Re-enable selenium-daily-beta-AdvancedSearch.May 3 2021, 4:48 PM
zeljkofilipin closed subtask T267360: Re-enable selenium-daily-beta-AdvancedSearch as Resolved.May 6 2021, 2:32 PM
zeljkofilipin raised the priority of this task from Medium to Needs Triage.May 18 2021, 10:09 AM
zeljkofilipin edited parent tasks, added: T210726: Selenium framework maintenance; removed: T198389: Q1 Selenium framework improvements.Oct 7 2021, 3:36 PM
zeljkofilipin edited projects, added Browser-Tests; removed Quality-and-Test-Engineering-Team.Oct 7 2021, 5:39 PM
Lucas_Werkmeister_WMDE mentioned this in T344140: [LEX] [TECH] Decide on how to move forward with daily Lexeme browser tests.Sep 12 2023, 1:33 PM
zeljkofilipin added a subtask: T354713: Add CampaignEvents to selenium daily .Jan 10 2024, 10:33 AM
zeljkofilipin changed the status of subtask T354713: Add CampaignEvents to selenium daily from In Progress to Open.Jan 29 2024, 2:41 PM
zeljkofilipin changed the task status from Open to In Progress.Feb 14 2024, 11:14 AM
zeljkofilipin claimed this task.
zeljkofilipin triaged this task as Low priority.
zeljkofilipin moved this task from Backlog 🪒 to Deep work 🌊 on the User-zeljkofilipin board.
zeljkofilipin added a subtask: T357509: selenium-daily-beta-CirrusSearch broken.Feb 14 2024, 11:21 AM
zeljkofilipin added a subtask: T357510: selenium-daily-beta-Wikistories broken.Feb 14 2024, 11:31 AM
gerritbot added a comment.Feb 14 2024, 11:38 AM

Change 1003396 had a related patch set uploaded (by Zfilipin; author: Zfilipin):

[integration/config@master] jjb: Cleanup of selenium-daily-beta-* jobs

https://gerrit.wikimedia.org/r/1003396

zeljkofilipin changed the task status from In Progress to Open.Feb 14 2024, 11:41 AM
zeljkofilipin removed zeljkofilipin as the assignee of this task.
zeljkofilipin raised the priority of this task from Low to Needs Triage.
zeljkofilipin moved this task from Deep work 🌊 to Backlog 🪒 on the User-zeljkofilipin board.
gerritbot added a comment.Feb 14 2024, 1:06 PM

Change 1003396 merged by jenkins-bot:

[integration/config@master] jjb: Cleanup of selenium-daily-beta-* jobs

https://gerrit.wikimedia.org/r/1003396

zeljkofilipin closed subtask T357509: selenium-daily-beta-CirrusSearch broken as Resolved.Feb 14 2024, 1:28 PM
zeljkofilipin closed subtask T357510: selenium-daily-beta-Wikistories broken as Resolved.
zeljkofilipin changed the status of subtask T354713: Add CampaignEvents to selenium daily from Open to In Progress.Apr 9 2024, 1:16 PM
zeljkofilipin closed subtask T354713: Add CampaignEvents to selenium daily as Resolved.Apr 22 2024, 1:11 PM
zeljkofilipin removed a subtask: T357509: selenium-daily-beta-CirrusSearch broken.Aug 20 2024, 9:35 AM
zeljkofilipin removed a project: User-zeljkofilipin.Jan 13 2025, 10:59 AM
Physikerwelt unsubscribed.Jan 13 2025, 11:23 AM
zeljkofilipin added a project: Testing Support.Mar 20 2025, 1:00 PM
zeljkofilipin removed a project: Browser-Tests.Mar 20 2025, 6:03 PM
zeljkofilipin removed a parent task: T210726: Selenium framework maintenance.Sep 10 2025, 11:58 AM
SDunlap added a project: Browser Test Platform.Mon, Nov 17, 9:37 PM
zeljkofilipin removed a project: Testing Support.Thu, Nov 20, 4:40 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits