Maniphest T101071

Audit existing browser tests
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Jdlrobson
	Jun 2 2015, 12:36 AM

Tags

Referenced Files

None

Subscribers

Tokens

"Love" token, awarded by Jhernandez.

Description

@dduvall and @Jdlrobson to sit down and audit the failing test builds which have been failing for some time:
https://integration.wikimedia.org/ci/view/Mobile/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/
https://integration.wikimedia.org/ci/view/Mobile/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/

Outcome:

Throw away fragile tests
Split tests into different less fragile packages.
Setup sensible notification defaults.

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved		zeljkofilipin	T91669 Make browser tests voting for all repos of WMF deployed code
		Resolved		zeljkofilipin	T55697 [EPIC] trigger browser tests from Gerrit (tracking)
		Resolved		• Jhernandez	T104315 [GOAL]: Set up testing environments that run browser tests on all patches.
		Resolved		Jdlrobson	T100293 [EPIC] Run browser tests against every MobileFrontend/Gather patch
		Resolved		Jdlrobson	T101071 Audit existing browser tests

Event Timeline

Jdlrobson created this task.Jun 2 2015, 12:36 AM

Jdlrobson raised the priority of this task from to Needs Triage.

Jdlrobson updated the task description. (Show Details)

Jdlrobson added projects: Mobile-Web-Sprint-48-Voyage-of-the-Damned, Web-Team-Backlog, Gather, MobileFrontend.

Jdlrobson added subscribers: • Jhernandez, phuedx, Aklapper and 2 others.

Jdlrobson moved this task from Needs Analysis to Doing on the Mobile-Web-Sprint-48-Voyage-of-the-Damned board.Jun 2 2015, 12:48 AM

• Jhernandez awarded a token.Jun 2 2015, 9:32 AM

Jdlrobson claimed this task.Jun 2 2015, 4:53 PM

dduvall updated the task description. (Show Details)Jun 2 2015, 4:59 PM

dduvall set Security to None.

dduvall added a project: Browser-Tests-Infrastructure.

dduvall moved this task from Inbox to In Progress on the Browser-Tests-Infrastructure board.

dduvall triaged this task as High priority.Jun 2 2015, 5:03 PM

• KLans_WMF moved this task from Incoming to Old Unorganized Resolved Tasks on the Web-Team-Backlog board.Jun 2 2015, 8:51 PM

TODO:

Skipped tests shouldn't send e-mail notifications
@dduval and @Jdlrobson to explore why this test failed: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/666/testReport/junit/(root)/Menus%20open%20correct%20page%20for%20anonymous%20users/Check_links_in_menu_2/

Looks like all builds are green right now. Let's keep them that way. Calling this closed. I will continue to monitor flakey tests.

Jdlrobson moved this task from Doing to Ready for Signoff on the Mobile-Web-Sprint-48-Voyage-of-the-Damned board.Jun 4 2015, 11:21 PM

phuedx moved this task from Ready for Signoff to Done on the Mobile-Web-Sprint-48-Voyage-of-the-Damned board.Jun 10 2015, 6:00 PM

zeljkofilipin moved this task from In Progress to Done on the Browser-Tests-Infrastructure board.Jun 11 2015, 3:14 PM

• Phabricator_maintenance moved this task from Old Unorganized Resolved Tasks to 2014-15 Q4 on the Web-Team-Backlog board.Mar 7 2018, 1:25 AM