Page MenuHomePhabricator

[subtask] selenium-MinervaNeue and mwselenium-quibble-docker CI jobs failing for watchlist and watchstar
Closed, ResolvedPublic

Description

https://integration.wikimedia.org/ci/view/Reading-Web/job/selenium-MinervaNeue/638/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/testReport/junit/(root)/Manage%20Watchlist/Remove_an_article_from_the_watchlist/

Manage Watchlist.Remove an article from the watchlist

Error Message
failed Remove an article from the watchlist
Stacktrace
    Scenario: Remove an article from the watchlist

Given I am logged into the mobile website
Given I am viewing a watched page
When I click the unwatch star
Then I should see a toast with message "Removed Selenium mobile watch test from your watchlist"
And the watch star should not be selected

Message:

    Sauce Labs job URL: http://saucelabs.com/jobs/f1110df6bc46450db5e52c06dd32d714

expected "" to match "Removed Selenium mobile watch test from your watchlist" (RSpec::Expectations::ExpectationNotMetError)
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/rspec-expectations-2.99.2/lib/rspec/expectations/fail_with.rb:32:in `fail_with'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/rspec-expectations-2.99.2/lib/rspec/expectations/handler.rb:37:in `handle_matcher'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/rspec-expectations-2.99.2/lib/rspec/expectations/expectation_target.rb:59:in `to'
/srv/jenkins-workspace/workspace/selenium-MinervaNeue/BROWSER/chrome/MEDIAWIKI_ENVIRONMENT/beta/PLATFORM/Linux/label/BrowserTests/tests/browser/features/step_definitions/common_article_steps.rb:42:in `block (2 levels) in <top (required)>'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/mediawiki_selenium-1.7.3/lib/mediawiki_selenium/page_factory.rb:43:in `block in on_page'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/page-object-1.1.0/lib/page-object/page_factory.rb:75:in `call'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/page-object-1.1.0/lib/page-object/page_factory.rb:75:in `on_page'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/mediawiki_selenium-1.7.3/lib/mediawiki_selenium/page_factory.rb:28:in `on_page'
/srv/jenkins-workspace/workspace/selenium-MinervaNeue/BROWSER/chrome/MEDIAWIKI_ENVIRONMENT/beta/PLATFORM/Linux/label/BrowserTests/tests/browser/features/step_definitions/common_article_steps.rb:40:in `block in <top (required)>'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/core_ext/instance_exec.rb:48:in `instance_exec'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/core_ext/instance_exec.rb:48:in `block in cucumber_instance_exec'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/core_ext/instance_exec.rb:69:in `cucumber_run_with_backtrace_filtering'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/core_ext/instance_exec.rb:36:in `cucumber_instance_exec'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/rb_support/rb_step_definition.rb:97:in `invoke'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/step_match.rb:25:in `invoke'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/step_invocation.rb:60:in `invoke'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/step_invocation.rb:38:in `accept'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/tree_walker.rb:106:in `block in visit_step'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/tree_walker.rb:170:in `broadcast'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/tree_walker.rb:105:in `visit_step'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/step_collection.rb:19:in `block in accept'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/step_collection.rb:18:in `each'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/step_collection.rb:18:in `accept'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/tree_walker.rb:100:in `block in visit_steps'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/tree_walker.rb:170:in `broadcast'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/tree_walker.rb:99:in `visit_steps'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/tree_walker.rb:15:in `block in execute'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/runtime.rb:83:in `block (2 levels) in with_hooks'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/runtime.rb:99:in `before_and_after'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/runtime.rb:82:in `block in with_hooks'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/runtime/support_code.rb:120:in `call'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/runtime/support_code.rb:120:in `block (3 levels) in around'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/language_support/language_methods.rb:9:in `block in around'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/language_support/language_methods.rb:97:in `call'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/language_support/language_methods.rb:97:in `execute_around'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/language_support/language_methods.rb:8:in `around'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/runtime/support_code.rb:119:in `block (2 levels) in around'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/runtime/support_code.rb:123:in `call'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/runtime/support_code.rb:123:in `around'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/runtime.rb:94:in `around'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/runtime.rb:81:in `with_hooks'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/tree_walker.rb:13:in `execute'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/scenario.rb:32:in `block in accept'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/scenario.rb:79:in `with_visitor'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/scenario.rb:31:in `accept'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/tree_walker.rb:58:in `block in visit_feature_element'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/tree_walker.rb:170:in `broadcast'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/tree_walker.rb:57:in `visit_feature_element'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/feature.rb:38:in `block in accept'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/feature.rb:37:in `each'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/feature.rb:37:in `accept'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/tree_walker.rb:27:in `block in visit_feature'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/tree_walker.rb:170:in `broadcast'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/tree_walker.rb:26:in `visit_feature'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/features.rb:28:in `block in accept'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/features.rb:17:in `each'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/features.rb:17:in `each'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/features.rb:27:in `accept'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/tree_walker.rb:21:in `block in visit_features'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/tree_walker.rb:170:in `broadcast'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/ast/tree_walker.rb:20:in `visit_features'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/runtime.rb:49:in `run!'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/lib/cucumber/cli/main.rb:47:in `execute!'
/mnt/home/jenkins-deploy/.gem/2.1.0/gems/cucumber-1.3.20/bin/cucumber:13:in `<top (required)>'
/mnt/home/jenkins-deploy/.gem/2.1.0/bin/cucumber:23:in `load'
/mnt/home/jenkins-deploy/.gem/2.1.0/bin/cucumber:23:in `<main>'
tests/browser/features/watchstar.feature:16:in `Then I should see a toast with message "Removed Selenium mobile watch test from your watchlist"'
https://integration.wikimedia.org/ci/job/mwselenium-quibble-docker/2305/console
https://integration.wikimedia.org/ci/job/mwselenium-quibble-docker/2306/console

08:58:07     Given I am viewing a watched page                                                               # features/step_definitions/watchstar_steps.rb:1
08:58:07     When I click the unwatch star                                                                   # features/step_definitions/common_article_steps.rb:21
08:58:07       timed out after 5 seconds, waiting for {:text=>"Stop watching", :tag_name=>"button"} to become present (Watir::Wait::TimeoutError)
08:58:07       features/watchstar.feature:15:in `When I click the unwatch star'
08:58:07     Then I should see a toast with message "Removed Selenium mobile watch test from your watchlist" # features/step_definitions/common_article_steps.rb:39
08:58:07     And the watch star should not be selected                                                       # features/step_definitions/common_article_steps.rb:63
08:58:07 
08:58:07 Failing Scenarios:
08:58:07 cucumber features/watchstar.feature:7 # Scenario: Add an article to the watchlist
08:58:07 cucumber features/watchstar.feature:13 # Scenario: Remove an article from the watchlist
08:58:07 
08:58:07 37 scenarios (2 failed, 35 passed)
08:58:07 242 steps (2 failed, 4 skipped, 236 passed)
08:58:07 4m33.309s
08:58:07 INFO:backend.DevWebServer:Terminating DevWebServer
08:58:07 Traceback (most recent call last):
08:58:07   File "/usr/local/bin/quibble", line 11, in <module>
08:58:07     load_entry_point('quibble==0.0.0', 'console_scripts', 'quibble')()
08:58:07   File "/usr/local/lib/python3.5/dist-packages/quibble/cmd.py", line 552, in main
08:58:07     cmd.execute()
08:58:07   File "/usr/local/lib/python3.5/dist-packages/quibble/cmd.py", line 533, in execute
08:58:07     cwd=self.mw_install_path)
08:58:07   File "/usr/local/lib/python3.5/dist-packages/quibble/test.py", line 167, in commands
08:58:07     subprocess.check_call(cmd, shell=True, cwd=cwd)
08:58:07   File "/usr/lib/python3.5/subprocess.py", line 271, in check_call
08:58:07     raise CalledProcessError(retcode, cmd)
08:58:07 subprocess.CalledProcessError: Command 'mwselenium' returned non-zero exit status 1

Event Timeline

Restricted Application changed the subtype of this task from "Deadline" to "Task". · View Herald TranscriptOct 19 2018, 3:29 PM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript
Jdlrobson renamed this task from [Bug] selenium-MinervaNeue and mwselenium-quibble-docker CI jobs failing for watchlist and watchstar to [subtask] selenium-MinervaNeue and mwselenium-quibble-docker CI jobs failing for watchlist and watchstar.Oct 19 2018, 4:15 PM

Running the sauce lab video shows this test is working correctly... looking some more.
I assume this is not consistently failing?

Change 468619 had a related patch set uploaded (by Jdlrobson; owner: Jdlrobson):
[mediawiki/skins/MinervaNeue@master] Fix watch star browser test

https://gerrit.wikimedia.org/r/468619

Change 468619 merged by jenkins-bot:
[mediawiki/skins/MinervaNeue@master] Fix watch star browser test

https://gerrit.wikimedia.org/r/468619

Jdlrobson claimed this task.

Last build was green