Page MenuHomePhabricator
Create Task
Maniphest T94162

Fix VisualEditor scenarios that fail at en.wikipedia.beta.wmflabs.org or do not run them daily
Closed, ResolvedPublic0 Estimated Story Points
Actions

Description

All jobs:

https://integration.wikimedia.org/ci/view/BrowserTests/view/VisualEditor/

Failed jobs:

https://integration.wikimedia.org/ci/view/BrowserTests/view/VisualEditor/job/browsertests-VisualEditor-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=af,label=contintLabsSlave%20&&%20UbuntuTrusty/lastBuild/console

Example:

https://integration.wikimedia.org/ci/view/BrowserTests/view/VisualEditor/job/browsertests-VisualEditor-language-screenshot-os_x_10.10-firefox/LANGUAGE_SCREENSHOT_CODE=af,label=contintLabsSlave%20&&%20UbuntuTrusty/lastBuild/console

Details

SubjectRepoBranchLines +/-
Recreate VisualEditor Selenium Jenkins jobintegration/configmaster+3 -0
[BrowserTest] Jenkins runs only passing Cucumber scenariosmediawiki/extensions/VisualEditormaster+3 -18
Revert "Delete failing VisualEditor browsertests Jenkins jobs"integration/configmaster+24 -0
Delete failing VisualEditor browsertests Jenkins jobsintegration/configmaster+0 -24
Customize query in gerrit

Related Objects
Search...

Event Timeline

zeljkofilipin created this task.Mar 27 2015, 12:48 PM
zeljkofilipin raised the priority of this task from to Medium.
zeljkofilipin updated the task description. (Show Details)
zeljkofilipin added projects: Tracking-Neverending, Continuous-Integration-Infrastructure, Browser-Tests-Infrastructure, VisualEditor.
zeljkofilipin added subscribers: hashar, Aklapper, zeljkofilipin and 2 others.
zeljkofilipin moved this task from Inbox to Ruby on the Browser-Tests-Infrastructure board.Mar 30 2015, 8:46 AM
zeljkofilipin moved this task from Ruby to Waiting on the Browser-Tests-Infrastructure board.Mar 30 2015, 1:56 PM
zeljkofilipin removed a project: Tracking-Neverending.Mar 30 2015, 2:08 PM
zeljkofilipin set Security to None.
hashar added a comment.Mar 30 2015, 3:58 PM

Isn't @Ryasmeen monitoring the failure together with the VE developers team?

Krinkle removed a project: Continuous-Integration-Infrastructure.Apr 7 2015, 2:26 PM
Jdforrester-WMF assigned this task to Ryasmeen.Apr 16 2015, 9:38 PM
Jdforrester-WMF moved this task from To Triage to Planned Maintenance on the VisualEditor board.
• dduvall subscribed.Jun 2 2015, 3:27 PM

@Ryasmeen, let's schedule a pairing session to work on this.

• dduvall raised the priority of this task from Medium to Needs Triage.Jun 2 2015, 3:27 PM
• dduvall moved this task from Waiting to Next on the Browser-Tests-Infrastructure board.
zeljkofilipin triaged this task as Medium priority.Jun 2 2015, 3:28 PM
Jdforrester-WMF moved this task from Planned Maintenance to Freezer on the VisualEditor board.Jun 18 2015, 12:16 AM
Vikassy subscribed.Jul 13 2015, 7:39 PM
• dduvall added a subtask: T99661: Update VisualEditor repository to mediawiki_selenium Ruby gem 1.x.Aug 20 2015, 5:29 PM
• dduvall closed subtask T99661: Update VisualEditor repository to mediawiki_selenium Ruby gem 1.x as Resolved.Aug 20 2015, 5:33 PM
• dduvall moved this task from Next to Waiting on the Browser-Tests-Infrastructure board.Aug 28 2015, 9:06 PM
zeljkofilipin added a comment.Sep 15 2015, 3:41 PM

@Ryasmeen: Are you working on this?

zeljkofilipin mentioned this in T94150: Fix scenarios that fail at en.wikipedia.beta.wmflabs.org or do not run them daily.Sep 24 2015, 3:15 PM
zeljkofilipin added a subtask: T111525: No such file or directory - i18n/af.json (Errno::ENOENT).Sep 25 2015, 9:59 PM
zeljkofilipin moved this task from Waiting to Next on the Browser-Tests-Infrastructure board.Sep 30 2015, 1:25 PM
zeljkofilipin claimed this task.Oct 12 2015, 3:02 PM
zeljkofilipin moved this task from Next to In Progress on the Browser-Tests-Infrastructure board.Oct 12 2015, 3:11 PM
zeljkofilipin closed subtask T111525: No such file or directory - i18n/af.json (Errno::ENOENT) as Resolved.Oct 12 2015, 3:14 PM
zeljkofilipin reopened subtask T111525: No such file or directory - i18n/af.json (Errno::ENOENT) as Open.Oct 12 2015, 4:00 PM
zeljkofilipin renamed this task from Delete or fix failed VisualEditor browsertests Jenkins job to Delete or fix failed VisualEditor browsertests Jenkins jobs.Oct 12 2015, 4:08 PM
gerritbot subscribed.Oct 12 2015, 4:08 PM

Change 245499 had a related patch set uploaded (by Zfilipin):
Delete failing VisualEditor browsertests Jenkins jobs

https://gerrit.wikimedia.org/r/245499

gerritbot added a project: Patch-For-Review.Oct 12 2015, 4:08 PM
zeljkofilipin moved this task from In Progress to Next on the Browser-Tests-Infrastructure board.Oct 14 2015, 1:30 PM
gerritbot added a comment.Oct 19 2015, 3:51 PM

Change 245499 merged by jenkins-bot:
Delete failing VisualEditor browsertests Jenkins jobs

https://gerrit.wikimedia.org/r/245499

JanZerebecki subscribed.Oct 19 2015, 3:52 PM

Jobs still need to be manually deleted:
16:12:47 Only in output-parent: browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce
16:12:47 Only in output-parent: browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce
16:12:47 Only in output-parent: browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-os_x_10.9-safari-sauce
16:12:47 Only in output-parent: browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-windows_8.1-internet_explorer-11-sauce
16:12:47 Only in output-parent: browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-10-sauce
16:12:47 Only in output-parent: browsertests-VisualEditor-production-linux-firefox-sauce

zeljkofilipin added a comment.Oct 19 2015, 4:03 PM
In T94162#1735110, @JanZerebecki wrote:

Jobs still need to be manually deleted:
16:12:47 Only in output-parent: browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce
16:12:47 Only in output-parent: browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce
16:12:47 Only in output-parent: browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-os_x_10.9-safari-sauce
16:12:47 Only in output-parent: browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-windows_8.1-internet_explorer-11-sauce
16:12:47 Only in output-parent: browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-10-sauce
16:12:47 Only in output-parent: browsertests-VisualEditor-production-linux-firefox-sauce

Done.

zeljkofilipin reassigned this task from zeljkofilipin to Amire80.Oct 19 2015, 4:23 PM
zeljkofilipin updated the task description. (Show Details)
zeljkofilipin removed a project: Patch-For-Review.
zeljkofilipin mentioned this in T111525: No such file or directory - i18n/af.json (Errno::ENOENT).Oct 19 2015, 4:28 PM
gerritbot added a comment.Oct 20 2015, 8:57 PM

Change 247612 had a related patch set uploaded (by Hashar):
Revert "Delete failing VisualEditor browsertests Jenkins jobs"

https://gerrit.wikimedia.org/r/247612

gerritbot added a project: Patch-For-Review.Oct 20 2015, 8:57 PM
zeljkofilipin claimed this task.Oct 21 2015, 8:58 AM
zeljkofilipin moved this task from Next to In Progress on the Browser-Tests-Infrastructure board.
zeljkofilipin added a subscriber: Amire80.
zeljkofilipin closed subtask T111525: No such file or directory - i18n/af.json (Errno::ENOENT) as Resolved.Nov 2 2015, 1:06 PM
zeljkofilipin removed zeljkofilipin as the assignee of this task.Nov 2 2015, 1:14 PM

@Vikassy has fixed the problem that caused all VisualEditor browser tests to fail (T111525).

I have restored Chrome and Firefox jobs:

https://integration.wikimedia.org/ci/view/BrowserTests/view/VisualEditor/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce-T94162/
https://integration.wikimedia.org/ci/view/BrowserTests/view/VisualEditor/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce-T94162/

The jobs are running only on demand (not daily like the rest of browser test jobs) since they are still failing.

https://integration.wikimedia.org/ci/view/BrowserTests/view/VisualEditor/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce-T94162/3/console
https://integration.wikimedia.org/ci/view/BrowserTests/view/VisualEditor/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce-T94162/1/console

It is now up to VisualEditor team to fix the failures. If you need help, let me know.

gerritbot added a comment.Nov 2 2015, 1:55 PM

Change 247612 abandoned by Hashar:
Revert "Delete failing VisualEditor browsertests Jenkins jobs"

Reason:
Per Zeljko above, lets follow up on T94162 for the test breakages and T114362 for lack of IE/Safari support.

https://gerrit.wikimedia.org/r/247612

zeljkofilipin removed a project: Patch-For-Review.Nov 5 2015, 11:47 AM
zeljkofilipin moved this task from In Progress to Ruby on the Browser-Tests-Infrastructure board.
zeljkofilipin edited projects, added Browser-Tests; removed Browser-Tests-Infrastructure.Nov 9 2015, 2:43 PM
gerritbot added a comment.Nov 11 2015, 9:42 AM

Change 252409 had a related patch set uploaded (by Zfilipin):
WIP [BrowserTest] Fix broken browser test

https://gerrit.wikimedia.org/r/252409

gerritbot added a project: Patch-For-Review.Nov 11 2015, 9:42 AM
zeljkofilipin added a subtask: T119482: Fix language screenshots browser test on VisualEditor.Nov 24 2015, 11:41 AM
zeljkofilipin claimed this task.Dec 16 2015, 11:03 AM
zeljkofilipin removed zeljkofilipin as the assignee of this task.Dec 17 2015, 4:39 PM
zeljkofilipin claimed this task.Feb 8 2016, 3:16 PM
gerritbot added a comment.Feb 10 2016, 5:31 PM

Change 269732 had a related patch set uploaded (by Zfilipin):
WIP recreate VisualEditor Selenium Jenkins job

https://gerrit.wikimedia.org/r/269732

zeljkofilipin added a comment.Feb 10 2016, 6:04 PM

5 tests are passing: P2586.

gerritbot added a comment.Feb 11 2016, 12:13 PM

Change 269952 had a related patch set uploaded (by Zfilipin):
[BrowserTest] Jenkins runs only passing Cucumber scenarios

https://gerrit.wikimedia.org/r/269952

gerritbot added a comment.Feb 15 2016, 1:37 PM

Change 269952 merged by jenkins-bot:
[BrowserTest] Jenkins runs only passing Cucumber scenarios

https://gerrit.wikimedia.org/r/269952

gerritbot added a comment.Feb 15 2016, 3:13 PM

Change 269732 merged by jenkins-bot:
Recreate VisualEditor Selenium Jenkins job

https://gerrit.wikimedia.org/r/269732

ReleaseTaggerBot added a project: MW-1.27-release (WMF-deploy-2016-03-01_(1.27.0-wmf.15)).Feb 16 2016, 8:02 PM
Jdforrester-WMF moved this task from Freezer to TR0: Interrupt on the VisualEditor board.Feb 16 2016, 11:14 PM
zeljkofilipin renamed this task from Delete or fix failed VisualEditor browsertests Jenkins jobs to Disable VisualEditor scenarios that fail at en.wikipedia.beta.wmflabs.org from running daily.Feb 24 2016, 4:00 PM
zeljkofilipin closed subtask T126966: Fix `ve.init is undefined` and `ve.init.target is undefined` error messages in VisualEditor browser tests as Resolved.Feb 24 2016, 6:08 PM
zeljkofilipin reopened subtask T126966: Fix `ve.init is undefined` and `ve.init.target is undefined` error messages in VisualEditor browser tests as Open.Feb 25 2016, 11:03 AM
zeljkofilipin renamed this task from Disable VisualEditor scenarios that fail at en.wikipedia.beta.wmflabs.org from running daily to Fix VisualEditor scenarios that fail at en.wikipedia.beta.wmflabs.org or do not run them daily.Feb 25 2016, 3:18 PM
zeljkofilipin closed this task as Resolved.Feb 26 2016, 10:51 AM

Resolving this task. I have created separate tasks about remaining problems: T119482, T126966.

zeljkofilipin closed subtask T126966: Fix `ve.init is undefined` and `ve.init.target is undefined` error messages in VisualEditor browser tests as Resolved.Mar 3 2016, 11:32 AM
Jdforrester-WMF set the point value for this task to 0.May 10 2016, 1:15 AM
Jdforrester-WMF closed subtask T119482: Fix language screenshots browser test on VisualEditor as Resolved.Jun 28 2016, 3:37 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL