Maniphest T197761

Make better use of WebPageTest mobile tests
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Peter
	Jun 20 2018, 8:02 AM

Description

Today we run tests on Chrome Android, Opera and UC. Opera and UC almost never work. And Chrome is really unstable:

Screen Shot 2018-06-20 at 8.53.43 AM.png (626×1 px, 128 KB)

Screen Shot 2018-06-20 at 8.53.33 AM.png (914×2 px, 313 KB)

Let us remove Opera and UC and increase number of runs for Chrome from 3 to 11 to see if we can get usable metrics.

Details

Subject	Repo	Branch	Lines +/-
Use max number of runs on public instance and longer wait for them to finish.	performance/WebPageTest	master	+1 -1
Collect devtools timeline data for mobile and only collect first run.	performance/WebPageTest	master	+1 -1
Increase number of runs for WebPageTest hosted mobile.	integration/config	master	+1 -1
Remove non working Opera and UC mini tests.	performance/WebPageTest	master	+0 -4

Customize query in gerrit

Event Timeline

Peter created this task.Jun 20 2018, 8:02 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJun 20 2018, 8:02 AM

Change 441162 had a related patch set uploaded (by Phedenskog; owner: Phedenskog):
[integration/config@master] Increase number of runs for WebPageTest hosted mobile.

https://gerrit.wikimedia.org/r/441162

gerritbot added a project: Patch-For-Review.Jun 20 2018, 8:03 AM

Change 441163 had a related patch set uploaded (by Phedenskog; owner: Phedenskog):
[performance/WebPageTest@master] Remove non working Opera and UC mini tests.

https://gerrit.wikimedia.org/r/441163

Change 441163 merged by jenkins-bot:
[performance/WebPageTest@master] Remove non working Opera and UC mini tests.

https://gerrit.wikimedia.org/r/441163

For future reference:

Screen Shot 2018-06-20 at 9.09.35 AM.png (1×2 px, 313 KB)

Screen Shot 2018-06-20 at 9.09.49 AM.png (1×2 px, 363 KB)

Opera Mini at least has worked before ...

Peter triaged this task as Medium priority.Jun 20 2018, 8:41 AM

Change 441162 merged by jenkins-bot:
[integration/config@master] Increase number of runs for WebPageTest hosted mobile.

https://gerrit.wikimedia.org/r/441162

Change 441558 had a related patch set uploaded (by Phedenskog; owner: Phedenskog):
[performance/WebPageTest@master] Collect devtools timeline data for mobile and only collect first run.

https://gerrit.wikimedia.org/r/441558

Change 441558 merged by jenkins-bot:
[performance/WebPageTest@master] Collect devtools timeline data for mobile and only collect first run.

https://gerrit.wikimedia.org/r/441558

Done let us keep a close watch on https://grafana.wikimedia.org/dashboard/db/webpagetest-drilldown?orgId=1&var-wiki=enwiki-mobile&var-users=anonymous&var-page=Facebook&var-location=Dulles&var-browser=Motorola_G_-_Chrome&var-view=firstView

Change 441588 had a related patch set uploaded (by Phedenskog; owner: Phedenskog):
[performance/WebPageTest@master] Use max number of runs on public instance and longer wait for them to finish.

https://gerrit.wikimedia.org/r/441588

Change 441588 merged by jenkins-bot:
[performance/WebPageTest@master] Use max number of runs on public instance and longer wait for them to finish.

https://gerrit.wikimedia.org/r/441588

• Vvjjkkii renamed this task from Make better use of WebPageTest mobile tests to ylaaaaaaaa.Jul 1 2018, 1:02 AM

• Vvjjkkii reopened this task as Open.

• Vvjjkkii removed Peter as the assignee of this task.

• Vvjjkkii raised the priority of this task from Medium to High.

• Vvjjkkii added projects: CheckUser, Connected-Open-Heritage-Batch-uploads (RAÄ-KMB_1_2017-02), Tamil-Sites, Gamepress, Hashtags, Jade, KartoEditor, Language-2018-Apr-June, New-Editor-Experiences, Mail, TCB-Team (now WMDE-TechWish).

• Vvjjkkii updated the task description. (Show Details)

• Vvjjkkii removed subscribers: gerritbot, Aklapper.

CommunityTechBot renamed this task from ylaaaaaaaa to Make better use of WebPageTest mobile tests.Jul 2 2018, 11:39 AM

CommunityTechBot closed this task as Resolved.

CommunityTechBot assigned this task to Peter.

CommunityTechBot lowered the priority of this task from High to Medium.

CommunityTechBot updated the task description. (Show Details)

CommunityTechBot removed projects: TCB-Team (now WMDE-TechWish), Mail, New-Editor-Experiences, Language-2018-Apr-June, KartoEditor, Jade, Hashtags, Gamepress, Tamil-Sites, Connected-Open-Heritage-Batch-uploads (RAÄ-KMB_1_2017-02), CheckUser.

CommunityTechBot added subscribers: gerritbot, Aklapper.

	F22405340: Screen Shot 2018-06-20 at 9.09.35 AM.png
	Jun 20 2018, 8:10 AM

	F22405341: Screen Shot 2018-06-20 at 9.09.49 AM.png
	Jun 20 2018, 8:10 AM

	F22404769: Screen Shot 2018-06-20 at 8.53.43 AM.png
	Jun 20 2018, 8:02 AM

	F22404771: Screen Shot 2018-06-20 at 8.53.33 AM.png
	Jun 20 2018, 8:02 AM

Make better use of WebPageTest mobile testsClosed, ResolvedPublicActions

Description

Details

Event Timeline

Make better use of WebPageTest mobile tests
Closed, ResolvedPublic
Actions