Broken jobs:
All tests that log the user are failing. Mediawiki::Client#login appears to be receiving 403 Forbidden responses from the Beta Cluster's api.php endpoint.
Reproduced on my machine targeting beta cluster:
MobileFrontend
$ BROWSER=chrome MEDIAWIKI_ENVIRONMENT=beta MEDIAWIKI_PASSWORD=not-the-real-one bundle exec cucumber tests/browser/features/diff.feature:5 @chrome @en.m.wikipedia.beta.wmflabs.org @firefox @test2.m.wikipedia.org @vagrant Feature: Page diff @smoke @editing @integration Scenario: Added and removed content # tests/browser/features/diff.feature:5 Given I am logged into the mobile website # tests/browser/features/step_definitions/common_steps.rb:28 unexpected HTTP response (403) (MediawikiApi::HttpError) tests/browser/features/diff.feature:6:in `Given I am logged into the mobile website' And the page "Selenium diff test 3" has the following edits: # tests/browser/features/step_definitions/editor_steps.rb:1 | text | | ABC DEF | | ABC GHI | When I am on the "Selenium diff test 3" page # tests/browser/features/step_definitions/common_steps.rb:48 And I click on the history link in the last modified bar # tests/browser/features/step_definitions/common_article_steps.rb:20 And I open the latest diff # tests/browser/features/step_definitions/special_history_steps.rb:5 Then I should see "GHI" as added content # tests/browser/features/step_definitions/diff_steps.rb:1 And I should see "DEF" as removed content # tests/browser/features/step_definitions/diff_steps.rb:5 Failing Scenarios: cucumber tests/browser/features/diff.feature:5 # Scenario: Added and removed content 1 scenario (1 failed) 7 steps (1 failed, 6 skipped) 0m17.964s
QuickSurveys
$ BROWSER=chrome MEDIAWIKI_ENVIRONMENT=beta MEDIAWIKI_PASSWORD=not-the-real-one bundle exec cucumber tests/browser/features/external_survey.feature:7 @chrome @en.m.wikipedia.beta.wmflabs.org @firefox @test2.m.wikipedia.org @vagrant @integration Feature: External surveys Background: # tests/browser/features/external_survey.feature:3 Given the quick survey test pages are installed # tests/browser/features/support/step_definitions/common_steps.rb:1 unexpected HTTP response (403) (MediawikiApi::HttpError) tests/browser/features/external_survey.feature:4:in `Given the quick survey test pages are installed' And I have dismissed survey "internal-example-survey" # tests/browser/features/support/step_definitions/common_steps.rb:100 Scenario: External survey is visible with flag # tests/browser/features/external_survey.feature:7 And I am on the "Quick survey test page stub" page with the external quick survey flag enabled # tests/browser/features/support/step_definitions/common_steps.rb:54 And the page has fully loaded # tests/browser/features/support/step_definitions/common_steps.rb:72 And the survey code has fully loaded # tests/browser/features/support/step_definitions/common_steps.rb:83 Then I should see the survey # tests/browser/features/support/step_definitions/common_steps.rb:68 Failing Scenarios: cucumber tests/browser/features/external_survey.feature:7 # Scenario: External survey is visible with flag 1 scenario (1 failed) 6 steps (1 failed, 5 skipped) 0m0.553s
RelatedArticles
$ BROWSER=chrome MEDIAWIKI_ENVIRONMENT=beta-desktop MEDIAWIKI_PASSWORD=not-the-real-one bundle exec cucumber tests/browser/features/read_more.feature:29 @chrome @integration @staging Feature: ReadMore Background: # tests/browser/features/read_more.feature:3 unexpected HTTP response (403) (MediawikiApi::HttpError) /usr/local/lib/ruby/gems/2.3.0/gems/mediawiki_api-0.7.0/lib/mediawiki_api/client.rb:208:in `send_request' /usr/local/lib/ruby/gems/2.3.0/gems/mediawiki_api-0.7.0/lib/mediawiki_api/client.rb:232:in `raw_action' /usr/local/lib/ruby/gems/2.3.0/gems/mediawiki_api-0.7.0/lib/mediawiki_api/client.rb:36:in `action' /usr/local/lib/ruby/gems/2.3.0/gems/mediawiki_api-0.7.0/lib/mediawiki_api/client.rb:128:in `log_in' /usr/local/lib/ruby/gems/2.3.0/gems/mediawiki_selenium-1.7.2/lib/mediawiki_selenium/helpers/api_helper.rb:18:in `block in api' /usr/local/lib/ruby/gems/2.3.0/gems/mediawiki_selenium-1.7.2/lib/mediawiki_selenium/helpers/api_helper.rb:17:in `tap' /usr/local/lib/ruby/gems/2.3.0/gems/mediawiki_selenium-1.7.2/lib/mediawiki_selenium/helpers/api_helper.rb:17:in `api' /usr/local/lib/ruby/gems/2.3.0/gems/mediawiki_selenium-1.7.2/lib/mediawiki_selenium/helpers/api_helper.rb:39:in `Before' Given RelatedArticles test pages are installed # tests/browser/features/support/step_definitions/common_steps.rb:1 unexpected HTTP response (403) (MediawikiApi::HttpError) tests/browser/features/read_more.feature:4:in `Given RelatedArticles test pages are installed' @en.wikipedia.beta.wmflabs.org @extension-betafeatures Scenario: ReadMore is present when enabled as a BetaFeature # tests/browser/features/read_more.feature:29 Given I am logged in # mediawiki_selenium-1.7.2/lib/mediawiki_selenium/step_definitions/login_steps.rb:1 And ReadMore is enabled as a beta feature # tests/browser/features/support/step_definitions/common_steps.rb:65 And I am on the "Related Articles 1" page # tests/browser/features/support/step_definitions/common_steps.rb:39 And page has fully loaded with ReadMore code # tests/browser/features/support/step_definitions/common_steps.rb:43 Then I must see ReadMore # tests/browser/features/support/step_definitions/common_steps.rb:69 Failing Scenarios: cucumber tests/browser/features/read_more.feature:29 # Scenario: ReadMore is present when enabled as a BetaFeature 1 scenario (1 failed) 6 steps (1 failed, 5 skipped) 0m2.059s