Page MenuHomePhabricator

'I am logged in as a new user with no notifications' doesn't always work on browser tests
Closed, InvalidPublic

Description

E.g. today it failed with:

1
2 Error Details
3
4failed Mark all as unread
5
6 Stack Trace
7
8 Scenario: Mark all as unread
9
10Given I am logged in with no notifications
11And I have a Flow message that triggers an alert notification
12And another user mentions me on the wiki
13And I am on the "Selenium Echo flyout test page" page
14And I have new notifications
15And I click the notification flyout button
16And I see the notification flyout
17And I click for the Messages view
18When I click the mark all as read button
19And I am on the "Selenium Echo flyout test page" page
20Then I have no new notifications
21
22Message:
23
24 Sauce Labs job URL: http://saucelabs.com/jobs/5821637666984eb980eda59456f35b84
25
26expected "mw-echo-unread-notifications mw-echo-notifications-badge" not to match "mw-echo-unread-notifications" (RSpec::Expectations::ExpectationNotMetError)
27/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/rspec-expectations-2.99.2/lib/rspec/expectations/fail_with.rb:32:in `fail_with'
28/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/rspec-expectations-2.99.2/lib/rspec/expectations/handler.rb:64:in `handle_matcher'
29/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/rspec-expectations-2.99.2/lib/rspec/expectations/expectation_target.rb:72:in `not_to'
30/mnt/jenkins-workspace/workspace/browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/tests/browser/features/step_definitions/notifications_steps.rb:86:in `block in <top (required)>'
31/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/core_ext/instance_exec.rb:48:in `instance_exec'
32/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/core_ext/instance_exec.rb:48:in `block in cucumber_instance_exec'
33/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/core_ext/instance_exec.rb:69:in `cucumber_run_with_backtrace_filtering'
34/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/core_ext/instance_exec.rb:36:in `cucumber_instance_exec'
35/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/rb_support/rb_step_definition.rb:97:in `invoke'
36/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/step_match.rb:25:in `invoke'
37/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/runtime/support_code.rb:60:in `invoke'
38/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/rb_support/rb_world.rb:52:in `step'
39/mnt/jenkins-workspace/workspace/browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/tests/browser/features/step_definitions/notifications_steps.rb:82:in `block in <top (required)>'
40/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/core_ext/instance_exec.rb:48:in `instance_exec'
41/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/core_ext/instance_exec.rb:48:in `block in cucumber_instance_exec'
42/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/core_ext/instance_exec.rb:69:in `cucumber_run_with_backtrace_filtering'
43/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/core_ext/instance_exec.rb:36:in `cucumber_instance_exec'
44/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/rb_support/rb_step_definition.rb:97:in `invoke'
45/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/step_match.rb:25:in `invoke'
46/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/step_invocation.rb:60:in `invoke'
47/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/step_invocation.rb:38:in `accept'
48/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/tree_walker.rb:106:in `block in visit_step'
49/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/tree_walker.rb:170:in `broadcast'
50/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/tree_walker.rb:105:in `visit_step'
51/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/step_collection.rb:19:in `block in accept'
52/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/step_collection.rb:18:in `each'
53/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/step_collection.rb:18:in `accept'
54/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/tree_walker.rb:100:in `block in visit_steps'
55/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/tree_walker.rb:170:in `broadcast'
56/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/tree_walker.rb:99:in `visit_steps'
57/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/tree_walker.rb:15:in `block in execute'
58/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/runtime.rb:83:in `block (2 levels) in with_hooks'
59/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/runtime.rb:99:in `before_and_after'
60/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/runtime.rb:82:in `block in with_hooks'
61/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/runtime/support_code.rb:120:in `call'
62/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/runtime/support_code.rb:120:in `block (3 levels) in around'
63/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/language_support/language_methods.rb:9:in `block in around'
64/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/language_support/language_methods.rb:97:in `call'
65/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/language_support/language_methods.rb:97:in `execute_around'
66/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/language_support/language_methods.rb:8:in `around'
67/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/runtime/support_code.rb:119:in `block (2 levels) in around'
68/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/runtime/support_code.rb:123:in `call'
69/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/runtime/support_code.rb:123:in `around'
70/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/runtime.rb:94:in `around'
71/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/runtime.rb:81:in `with_hooks'
72/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/tree_walker.rb:13:in `execute'
73/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/scenario.rb:32:in `block in accept'
74/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/scenario.rb:79:in `with_visitor'
75/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/scenario.rb:31:in `accept'
76/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/tree_walker.rb:58:in `block in visit_feature_element'
77/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/tree_walker.rb:170:in `broadcast'
78/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/tree_walker.rb:57:in `visit_feature_element'
79/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/feature.rb:38:in `block in accept'
80/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/feature.rb:37:in `each'
81/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/feature.rb:37:in `accept'
82/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/tree_walker.rb:27:in `block in visit_feature'
83/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/tree_walker.rb:170:in `broadcast'
84/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/tree_walker.rb:26:in `visit_feature'
85/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/features.rb:28:in `block in accept'
86/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/features.rb:17:in `each'
87/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/features.rb:17:in `each'
88/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/features.rb:27:in `accept'
89/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/tree_walker.rb:21:in `block in visit_features'
90/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/tree_walker.rb:170:in `broadcast'
91/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/ast/tree_walker.rb:20:in `visit_features'
92/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/runtime.rb:49:in `run!'
93/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/lib/cucumber/cli/main.rb:47:in `execute!'
94/mnt/jenkins-workspace/workspace/gems/2.0.0/gems/cucumber-1.3.18/bin/cucumber:13:in `<top (required)>'
95/mnt/jenkins-workspace/workspace/gems/2.0.0/bin/cucumber:23:in `load'
96/mnt/jenkins-workspace/workspace/gems/2.0.0/bin/cucumber:23:in `<main>'
97features/messages.feature:5:in `Given I am logged in with no notifications'
98

It is basically saying there were unread notifications immediately after the API 'echomarkread' (which is part of the given step).

All four today failed like that.

Related Objects

Event Timeline

Mattflaschen-WMF raised the priority of this task from to Needs Triage.
Mattflaschen-WMF updated the task description. (Show Details)
Mattflaschen-WMF renamed this task from 'Mark as read' doesn't always work on browser tests to 'I am logged in as a new user with no notifications' doesn't always work on browser tests.Jun 11 2015, 9:02 PM
Mattflaschen-WMF updated the task description. (Show Details)
Mattflaschen-WMF set Security to None.
Mattflaschen-WMF updated the task description. (Show Details)
Catrope triaged this task as Medium priority.Jul 22 2015, 11:29 PM
Catrope added subscribers: Etonkovidova, SBisson.

This refers to the cucumber browser tests that don't exist anymore.