Page MenuHomePhabricator
Create Task
Maniphest T398310

selenium-daily-beta jobs marked as UNSTABLE
Closed, ResolvedPublicBUG REPORT
Actions

Description

Problem

Looks like every job for a repository that's on WebdriverIO v9 and had skipped tests is failing.

Data

JobWebdriverIOSkippedStatusPhabricatorGerrit
selenium-daily-beta-AdvancedSearch70SUCCESS
selenium-daily-beta-CampaignEvents93UNSTABLET398310 T3934281167600 ✅
selenium-daily-beta-CentralNotice70SUCCESS
selenium-daily-beta-Echo90SUCCESS
selenium-daily-beta-Math90SUCCESS
selenium-daily-beta-MediaWiki98UNSTABLET3983101167568 ✅
selenium-daily-beta-Minerva90SUCCESS
selenium-daily-beta-Newsletter90SUCCESS
selenium-daily-beta-Popups80SUCCESS
selenium-daily-beta-RelatedArticles70SUCCESS
selenium-daily-beta-TwoColConflict70FAILURET398289
selenium-daily-beta-VisualEditor91UNSTABLET3983101167606 ✅
selenium-daily-betacommons-MediaWiki98UNSTABLET3983101167568 ✅

XML files

v8

In v8, skipped test suites had failures="0", in v9 they have failures="1".

<?xml version="1.0" encoding="UTF-8"?>
<testsuites tests="0" failures="0" errors="0" skipped="0"/>

v9

<?xml version="1.0" encoding="UTF-8"?>
<testsuites tests="1" failures="1" errors="0" skipped="0">
  <testsuite tests="1" failures="1" errors="0" skipped="0">
    <testcase classname="" name="">
      <failure message="No tests found"/>
    </testcase>
  </testsuite>
</testsuites>

Timeline

Notes

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
jjb: update beta domain for MediaWiki Selenium dailyintegration/configmaster+1 -1
jjb: Update beta domain for selenium-daily testsintegration/configmaster+2 -2
selenium: Create test suite for the Jenkins job that runs dailymediawiki/extensions/VisualEditormaster+7 -2
selenium: Create test suite for the Jenkins job that runs dailymediawiki/extensions/CampaignEventsmaster+7 -2
selenium: Create test suite for the Jenkins job that runs dailymediawiki/coremaster+8 -2
Customize query in gerrit

Related Objects
Search...

Event Timeline

zeljkofilipin created this task.Jul 1 2025, 12:41 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 1 2025, 12:41 PM
zeljkofilipin changed the subtype of this task from "Task" to "Bug Report".Jul 1 2025, 12:41 PM
zeljkofilipin moved this task from Backlog to Ready to Refine on the Test Platform board.
zeljkofilipin added a parent task: T270771: Keep selenium-daily-beta(commons)-MediaWiki Jenkins jobs green.
zeljkofilipin updated the task description. (Show Details)Jul 1 2025, 12:43 PM
zeljkofilipin updated the task description. (Show Details)
zeljkofilipin updated the task description. (Show Details)Jul 1 2025, 12:46 PM
zeljkofilipin updated the task description. (Show Details)Jul 1 2025, 12:49 PM
zeljkofilipin added a parent task: T372633: Upgrade WebdriverIO to v9 in core.
zeljkofilipin updated the task description. (Show Details)Jul 1 2025, 12:55 PM
zeljkofilipin updated the task description. (Show Details)
zeljkofilipin added a subscriber: bd808.
zeljkofilipin renamed this task from selenium-daily-beta-MediaWiki UNSTABLE to selenium-daily-beta-MediaWiki and selenium-daily-betacommons-MediaWiki UNSTABLE.Jul 1 2025, 1:39 PM
AMarkossyan-WMF moved this task from Ready to Refine to Refined (Discussed and Estimated) Backlog on the Test Platform board.Jul 1 2025, 4:46 PM
AMarkossyan-WMF moved this task from Refined (Discussed and Estimated) Backlog to ok 8 on the Test Platform board.
AMarkossyan-WMF edited projects, added Test Platform (ok 8); removed Test Platform.
zeljkofilipin added a project: User-zeljkofilipin.Jul 1 2025, 5:13 PM
zeljkofilipin moved this task from Backlog 🪒 to Sprint 🏃‍➡️ on the User-zeljkofilipin board.
zeljkofilipin mentioned this in T270771: Keep selenium-daily-beta(commons)-MediaWiki Jenkins jobs green.Jul 1 2025, 5:30 PM
vaughnwalters subscribed.Jul 8 2025, 10:09 PM

I'm seeing the same failure on campaign events daily runs.

zeljkofilipin renamed this task from selenium-daily-beta-MediaWiki and selenium-daily-betacommons-MediaWiki UNSTABLE to selenium-daily-beta jobs marked as UNSTABLE.Jul 9 2025, 8:35 AM
zeljkofilipin updated the task description. (Show Details)
zeljkofilipin mentioned this in T393428: Daily selenium job failing for Campaign Events.Jul 9 2025, 8:55 AM
zeljkofilipin updated the task description. (Show Details)
zeljkofilipin updated the task description. (Show Details)Jul 9 2025, 8:58 AM

@vaughnwalters Looks like every job for a repository that's on WebdriverIO v9 and had skipped tests is failing.

zeljkofilipin updated the task description. (Show Details)Jul 9 2025, 8:59 AM
zeljkofilipin updated the task description. (Show Details)Jul 9 2025, 9:02 AM
zeljkofilipin updated the task description. (Show Details)Jul 9 2025, 10:25 AM
zeljkofilipin updated the task description. (Show Details)
zeljkofilipin updated the task description. (Show Details)Jul 9 2025, 10:39 AM
gerritbot added a comment.Jul 9 2025, 10:44 AM

Change #1167568 had a related patch set uploaded (by Zfilipin; author: Zfilipin):

[mediawiki/core@master] selenium: Create test suite for the Jenkins job that runs daily

https://gerrit.wikimedia.org/r/1167568

gerritbot added a project: Patch-For-Review.Jul 9 2025, 10:44 AM
gerritbot added a comment.Jul 9 2025, 11:09 AM

Change #1167568 merged by jenkins-bot:

[mediawiki/core@master] selenium: Create test suite for the Jenkins job that runs daily

https://gerrit.wikimedia.org/r/1167568

Maintenance_bot removed a project: Patch-For-Review.Jul 9 2025, 11:30 AM
zeljkofilipin changed the task status from Open to In Progress.Jul 9 2025, 11:49 AM
zeljkofilipin triaged this task as High priority.
zeljkofilipin moved this task from Backlog to In Progress on the Test Platform (ok 8) board.
zeljkofilipin moved this task from Sprint 🏃‍➡️ to Deep work 🌊 on the User-zeljkofilipin board.
ReleaseTaggerBot added a project: MW-1.45-notes (1.45.0-wmf.10; 2025-07-15).Jul 9 2025, 12:00 PM
zeljkofilipin updated the task description. (Show Details)Jul 9 2025, 12:24 PM
gerritbot added a comment.Jul 9 2025, 12:36 PM

Change #1167600 had a related patch set uploaded (by Zfilipin; author: Zfilipin):

[mediawiki/extensions/CampaignEvents@master] selenium: Create test suite for the Jenkins job that runs daily

https://gerrit.wikimedia.org/r/1167600

gerritbot added a project: Patch-For-Review.Jul 9 2025, 12:36 PM
zeljkofilipin updated the task description. (Show Details)Jul 9 2025, 12:40 PM
gerritbot added a comment.Jul 9 2025, 12:49 PM

Change #1167606 had a related patch set uploaded (by Zfilipin; author: Zfilipin):

[mediawiki/extensions/VisualEditor@master] selenium: Create test suite for the Jenkins job that runs daily

https://gerrit.wikimedia.org/r/1167606

zeljkofilipin updated the task description. (Show Details)Jul 9 2025, 12:50 PM
zeljkofilipin moved this task from In Progress to In Review on the Test Platform (ok 8) board.
gerritbot added a comment.Jul 10 2025, 8:14 PM

Change #1167600 merged by jenkins-bot:

[mediawiki/extensions/CampaignEvents@master] selenium: Create test suite for the Jenkins job that runs daily

https://gerrit.wikimedia.org/r/1167600

gerritbot added a comment.Jul 10 2025, 8:16 PM

Change #1167606 merged by jenkins-bot:

[mediawiki/extensions/VisualEditor@master] selenium: Create test suite for the Jenkins job that runs daily

https://gerrit.wikimedia.org/r/1167606

Maintenance_bot removed a project: Patch-For-Review.Jul 10 2025, 8:31 PM
zeljkofilipin updated the task description. (Show Details)Jul 11 2025, 3:46 PM
zeljkofilipin moved this task from In Review to Done on the Test Platform (ok 8) board.
zeljkofilipin moved this task from Deep work 🌊 to Waiting 🏹 on the User-zeljkofilipin board.Jul 14 2025, 5:27 PM
zeljkofilipin closed this task as Resolved.Jul 15 2025, 3:42 PM
dancy reopened this task as Open.Jul 30 2025, 2:51 PM
dancy subscribed.

Hi @zeljkofilipin. When I look at https://integration.wikimedia.org/ci/job/selenium-daily-beta-MediaWiki/ it shows that the job almost never completes successfully. I get an email about it daily. I'm reopening this ticket in hopes of fixes.

dancy added a comment.Jul 30 2025, 2:53 PM

Likewise for selenium-daily-betacommons-MediaWiki.

zeljkofilipin removed zeljkofilipin as the assignee of this task.Aug 11 2025, 3:16 PM
zeljkofilipin edited projects, added Test Platform; removed Test Platform (ok 8).
zeljkofilipin moved this task from Backlog to Ready to Refine on the Test Platform board.
zeljkofilipin removed a project: User-zeljkofilipin.
Peter subscribed.Aug 12 2025, 5:19 AM

I think T401653 can give better error messages so we understand what's going on. See also https://phabricator.wikimedia.org/T372068#11075998

gerritbot added a comment.Aug 12 2025, 11:56 AM

Change #1177975 had a related patch set uploaded (by Daimona Eaytoy; author: Daimona Eaytoy):

[integration/config@master] jjb: Update beta domain for selenium-daily tests

https://gerrit.wikimedia.org/r/1177975

gerritbot added a project: Patch-For-Review.Aug 12 2025, 11:56 AM
gerritbot added a comment.Aug 12 2025, 12:04 PM

Change #1177975 merged by jenkins-bot:

[integration/config@master] jjb: Update beta domain for selenium-daily tests

https://gerrit.wikimedia.org/r/1177975

gerritbot added a comment.Aug 12 2025, 12:07 PM

Change #1177979 had a related patch set uploaded (by Hashar; author: Hashar):

[integration/config@master] jjb: update beta domain for MediaWiki Selenium daily

https://gerrit.wikimedia.org/r/1177979

gerritbot added a comment.Aug 12 2025, 12:12 PM

Change #1177979 merged by jenkins-bot:

[integration/config@master] jjb: update beta domain for MediaWiki Selenium daily

https://gerrit.wikimedia.org/r/1177979

Maintenance_bot removed a project: Patch-For-Review.Aug 12 2025, 12:31 PM
AMarkossyan-WMF moved this task from Ready to Refine to Refined (Discussed and Estimated) Backlog on the Test Platform board.Aug 12 2025, 4:24 PM
AMarkossyan-WMF closed this task as Resolved.Aug 12 2025, 4:29 PM
AMarkossyan-WMF claimed this task.
AMarkossyan-WMF subscribed.

According to @zeljkofilipin, it's very unlikely that this exact problem has happened again. Instead, we will create a new ticket to investigate, document and resolve the actual issue. The link to this ticket will also be added here.

zeljkofilipin mentioned this in T401717: Investigate selenium-daily-beta-MediaWiki and selenium-daily-betacommons-MediaWiki jenkins job failing.Aug 12 2025, 4:35 PM

Tracked as T401717: Investigate selenium-daily-beta-MediaWiki and selenium-daily-betacommons-MediaWiki jenkins job failing.

bd808 reassigned this task from AMarkossyan-WMF to zeljkofilipin.Aug 12 2025, 4:59 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits