Page MenuHomePhabricator

Browser test failures outside @smoke tests
Closed, InvalidPublic

Description

Generic special page features.Search from Watchlist
Notification.Opening notifications

are both failing.
They have failed in two builds so should probably be investigated asap.

One test reports unable to locate element, using {:id=>"mw-mf-main-menu-button", :tag_name=>"a"}

Failed builds:

Event Timeline

Jdlrobson raised the priority of this task from to Needs Triage.
Jdlrobson updated the task description. (Show Details)
Jdlrobson added a project: Web-Team-Backlog.
Jdlrobson moved this task to Incoming on the Web-Team-Backlog board.
Jdlrobson subscribed.

Both of these tests are passing locally:

  • features/special.feature
  • features/notification.feature

Can you replicate consistently against beta labs? They might be catching issues caused by other extensions.

How do I replicate those against beta labs? Any documentation?

@bmansurov you just point your tests at beta labs by configuring MEDIAWIKI_URL and other variables...

Turns out, the "I am using the mobile site" step doesn't switch to the mobile site in beta labs.

@zeljkofilipin any idea why features/special.feature doesn't pass in beta labs? Specifically, "Scenario: Search from Nearby", where the Background steps don't switch to the mobile view. In the same file "Scenario: Search from Watchlist" works fine only because there is another given there: "Given I am logged into the mobile website" which correctly switches to the mobile view.

All three builds have passed for at least the last two days. However, I'm concerned about @bmansurov's bug report around the "I am using the mobile site" step.

At the time of checking, the last failures of the builds were as follows:

  • SmokeTests-linux-chrome-sauce: 29th June
  • en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce: 30th June
  • en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce: 1st July

So "at least the last two days" isn't quite right…

@bmansurov which url are you using? I think @dduvall ran into a similar issue recently and has to pass the useformat query string parameter.

phuedx changed the task status from Open to Stalled.Jul 8 2015, 9:56 AM

The MobileFrontend tests are all green.

phuedx claimed this task.

Though we should raise a bug about the "I am on the mobile site" step…