Peter (Peter Hedenskog)
Software Engineer, Wikimedia Foundation

Projects (6)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Wednesday

  • Clear sailing ahead.

User Details

User Since
Aug 17 2015, 6:48 PM (165 w, 6 d)
Availability
Available
IRC Nick
phedenskog
LDAP User
Unknown
MediaWiki User
PHedenskog (WMF) [ Global Accounts ]

Recent Activity

Fri, Oct 19

mmodell awarded Blog Post: Best friends forever a Orange Medal token.
Fri, Oct 19, 9:28 PM · Performance-Team
Peter created T207440: Chrome 69 -> Chrome 70 changes in metrics.
Fri, Oct 19, 7:52 AM · WebPageTest, WebPageReplay, Performance-Team

Thu, Oct 18

Peter closed T207252: Upgrade to Chrome 70 as Resolved.

This is done now, I'll add some graphs later on,

Thu, Oct 18, 7:27 AM · Performance-Team, WebPageReplay

Wed, Oct 17

Peter added a comment to T207252: Upgrade to Chrome 70.

Sometimes I feel I miss a more high level version of the Chrome changelog: https://chromium.googlesource.com/chromium/src/+log/69.0.3497.100..70.0.3538.67?pretty=fuller&n=10000

Wed, Oct 17, 12:53 PM · Performance-Team, WebPageReplay
Peter added a comment to T133646: Run performance test on commits.

Did you see https://tech.trivago.com/2018/10/12/building-fast-and-reliable-web-applications/ @Krinkle

Wed, Oct 17, 6:03 AM · MW-1.32-notes (WMF-deploy-2018-08-28 (1.32.0-wmf.19)), Patch-For-Review, Epic, Performance-Team
Peter created T207252: Upgrade to Chrome 70.
Wed, Oct 17, 5:49 AM · Performance-Team, WebPageReplay
Peter created T207251: Test out different trace settings for Chrome .
Wed, Oct 17, 5:41 AM · WebPageReplay, Performance-Team

Fri, Oct 12

Peter closed T206594: Move from c4.xlarge to c5.xlarge and c4.large to c5.large as Resolved.

Moved the last one to c5.large (and updated the docs) just now.

Fri, Oct 12, 5:45 AM · WebPageReplay, Performance-Team

Thu, Oct 11

Peter added a comment to T175708: Add annotations per URL tested in WebPagetest.

5.3.0 has been released.

Thu, Oct 11, 8:17 PM · WebPageReplay, Performance-Team, WebPageTest
Peter moved T197847: Collect performance metrics from a mobile over time from Next-up to Doing on the Performance-Team board.
Thu, Oct 11, 6:28 PM · Performance-Team
Peter renamed T206594: Move from c4.xlarge to c5.xlarge and c4.large to c5.large from Move from c4.xlarge to c5.xlarge to Move from c4.xlarge to c5.xlarge and c4.large to c5.large.
Thu, Oct 11, 8:45 AM · WebPageReplay, Performance-Team
Peter added a comment to T206594: Move from c4.xlarge to c5.xlarge and c4.large to c5.large.

I've updated the Firefox server to c5.xlarge and changed ewiki to also run on c5 series (c5.large). That one is also cheaper and a little bit faster.

Thu, Oct 11, 8:45 AM · WebPageReplay, Performance-Team

Wed, Oct 10

phuedx awarded Blog Post: Best friends forever a Mountain of Wealth token.
Wed, Oct 10, 4:13 PM · Performance-Team
Peter created T206594: Move from c4.xlarge to c5.xlarge and c4.large to c5.large.
Wed, Oct 10, 6:47 AM · WebPageReplay, Performance-Team

Mon, Oct 8

Peter closed T205603: Setup alerts for Firefox as Resolved.

Enabled them just now. 40 ms/40 points for Speed Index for all tests for now.

Mon, Oct 8, 9:09 AM · Performance-Team, WebPageReplay
Peter added a comment to T204300: [investigate] Increase in instability in metrics.

This is what it looks like going back 90 days:

Mon, Oct 8, 8:02 AM · WebPageReplay, WebPageTest, Performance-Team
Peter added a comment to T204300: [investigate] Increase in instability in metrics.

It is really one page that has the problem: The facebook page. I can see that the difference between runs are that sometime we spend 100ms+ more on UpdateLayoutTree.

Mon, Oct 8, 7:39 AM · WebPageReplay, WebPageTest, Performance-Team

Fri, Oct 5

Peter updated the task description for T205722: Prepare materials for internal synthetic testing presentation.
Fri, Oct 5, 8:26 AM · Performance-Team
Peter triaged T206301: Prepare presentation for our synthetic testing for Mozilla as Normal priority.
Fri, Oct 5, 7:15 AM · Performance-Team

Thu, Oct 4

Peter added a project to T175708: Add annotations per URL tested in WebPagetest: WebPageReplay.
Thu, Oct 4, 10:54 AM · WebPageReplay, Performance-Team, WebPageTest
Peter moved T175708: Add annotations per URL tested in WebPagetest from Blocked to Inbox on the Performance-Team board.

Woho! Templates in Grafana was released in 5.3.0 beta 2 (there's a beta 3 out there now). This means that when we upgrade to 5.3.0 we could potentially start using the Grafana API.

Thu, Oct 4, 10:54 AM · WebPageReplay, Performance-Team, WebPageTest
Peter added a comment to T195233: Blog post: Explain how we use Browsertime/WebPageReplay.

Let us focus on:

Thu, Oct 4, 8:33 AM · Performance-Team
Peter closed T195232: Blog post: How we use WebPageTest, a subtask of T195230: Blog post series about synthetic testing, as Declined.
Thu, Oct 4, 8:32 AM · Performance-Team
Peter closed T195232: Blog post: How we use WebPageTest as Declined.

Let us do T195233 instead

Thu, Oct 4, 8:32 AM · WebPageTest, Performance-Team

Wed, Oct 3

Samwalton9 awarded Blog Post: Best friends forever a Barnstar token.
Wed, Oct 3, 11:55 AM · Performance-Team
Peter published Blog Post: Best friends forever.
Wed, Oct 3, 9:43 AM · Performance-Team

Tue, Oct 2

Peter closed T205604: Keep errors on WebPageReplay servers as Resolved.

I've added a script that stores all error logs (no so far) in the home dir as error.log.

Tue, Oct 2, 8:11 AM · Performance-Team, WebPageReplay

Mon, Oct 1

Peter moved T205601: Clean up start script for WebPageReplay from Inbox to Next-up on the Performance-Team board.
Mon, Oct 1, 8:08 PM · WebPageReplay, Performance-Team
Peter moved T205604: Keep errors on WebPageReplay servers from Inbox to Doing on the Performance-Team board.
Mon, Oct 1, 8:07 PM · Performance-Team, WebPageReplay
Peter moved T205603: Setup alerts for Firefox from Inbox to Doing on the Performance-Team board.
Mon, Oct 1, 8:07 PM · Performance-Team, WebPageReplay
Peter closed T205602: Move enwiki tests to another server as Resolved.
Mon, Oct 1, 8:07 PM · WebPageReplay, Performance-Team
Peter added a comment to T205602: Move enwiki tests to another server.

I deployed on a new server today, updated the docs. Lets keep running for a while and see what happens to the metrics (I can already see that the new server is faster).

Mon, Oct 1, 10:20 AM · WebPageReplay, Performance-Team
Peter added a comment to T205603: Setup alerts for Firefox.

I've added them all but will keep them inactive until I can spot good thresholds https://grafana.wikimedia.org/dashboard/db/webpagereplay-desktop-alerts

Mon, Oct 1, 9:27 AM · Performance-Team, WebPageReplay
Peter added a comment to T205603: Setup alerts for Firefox.

I've enabled them First Visual Change and Speed Index for enwiki on Desktop. Gonna wait until tomorrow to make sure everything is ok and then and then for beta, group0 and group 1 too.

Mon, Oct 1, 8:58 AM · Performance-Team, WebPageReplay

Fri, Sep 28

Peter created T205723: Prepare materials for internal Navigation Timing (RUM) presentation.
Fri, Sep 28, 4:14 PM · Performance-Team
Peter created T205722: Prepare materials for internal synthetic testing presentation.
Fri, Sep 28, 4:13 PM · Performance-Team
Peter added a comment to T196242: Chrome 67 performance regression.

A.k.a when I'm happy I feel that every web site is faaast :)

Fri, Sep 28, 12:29 PM · Performance-Team (Radar), Upstream
Peter added a comment to T196242: Chrome 67 performance regression.

Yep, you are right.

Fri, Sep 28, 12:28 PM · Performance-Team (Radar), Upstream
Peter closed T185186: Firefox gives us unstable metrics in synthetic testing as Resolved.

This is better now, let us close it.


Fri, Sep 28, 12:19 PM · Performance-Team
Peter added a comment to T203543: Chrome 69 increase time for first visual change in synthetic testing.

I've looked at the RUM metrics and see the same thing there:





Fri, Sep 28, 11:19 AM · WebPageReplay, Upstream, Performance-Team
Peter added a comment to T196242: Chrome 67 performance regression.

I've looked at the RUM data and I'm pretty sure this is a Chrome regression:

Fri, Sep 28, 10:24 AM · Performance-Team (Radar), Upstream
Peter updated subscribers of T205369: Investigate > 40% Save Timing regression (2018-09-05).

8 of augusts correlates to 1.32.0-wmf.16 - log. The other big increase 5th of September I'm not sure I can spot a specific change in the server admin log? @aaron is back on Monday though.

Fri, Sep 28, 7:23 AM · Core Platform Team (MCR), Core Platform Team Kanban, Multi-Content-Revisions (Reactive), Performance-Team

Thu, Sep 27

Peter created P7597 Install Browsertime/WebPageReplay dependencies on a fresh Ubuntu.
Thu, Sep 27, 11:42 AM · WebPageReplay, Performance-Team
Peter triaged T205601: Clean up start script for WebPageReplay as Normal priority.
Thu, Sep 27, 11:35 AM · WebPageReplay, Performance-Team
Peter triaged T205602: Move enwiki tests to another server as Normal priority.
Thu, Sep 27, 11:35 AM · WebPageReplay, Performance-Team
Peter triaged T205603: Setup alerts for Firefox as Normal priority.
Thu, Sep 27, 11:35 AM · Performance-Team, WebPageReplay
Peter triaged T205604: Keep errors on WebPageReplay servers as Normal priority.
Thu, Sep 27, 11:34 AM · Performance-Team, WebPageReplay
Peter added a comment to T185186: Firefox gives us unstable metrics in synthetic testing.

I've deployed Firefox tests permanently on a c4.xlarge T205246 and it looks good so far.

Thu, Sep 27, 7:20 AM · Performance-Team
Peter created T205604: Keep errors on WebPageReplay servers.
Thu, Sep 27, 7:17 AM · Performance-Team, WebPageReplay
Peter created T205603: Setup alerts for Firefox.
Thu, Sep 27, 7:15 AM · Performance-Team, WebPageReplay
Peter created T205602: Move enwiki tests to another server.
Thu, Sep 27, 7:10 AM · WebPageReplay, Performance-Team
Peter created T205601: Clean up start script for WebPageReplay.
Thu, Sep 27, 7:06 AM · WebPageReplay, Performance-Team
Peter closed T205246: Deploy c4.xlarge for Firefox tests as Resolved.

Fixed this early this week. I've removed one c4.large and updated the docs https://wikitech.wikimedia.org/wiki/Performance/WebPageReplay

Thu, Sep 27, 7:02 AM · Performance-Team, WebPageReplay
Peter added a comment to T205369: Investigate > 40% Save Timing regression (2018-09-05).

The alerts fired but we didn't act on them and then 7 days later it got back to the new "normal":

Thu, Sep 27, 6:52 AM · Core Platform Team (MCR), Core Platform Team Kanban, Multi-Content-Revisions (Reactive), Performance-Team

Mon, Sep 24

Peter moved T205246: Deploy c4.xlarge for Firefox tests from Next-up to Doing on the Performance-Team board.
Mon, Sep 24, 9:35 PM · Performance-Team, WebPageReplay
Peter closed T203216: Change dashboards using navtiming to navtiming2 as Resolved.

I removed the ones that was unused. Please let me know if you need help with setting up new dashboards!

Mon, Sep 24, 6:04 PM · Performance-Team
Peter updated the task description for T203216: Change dashboards using navtiming to navtiming2.
Mon, Sep 24, 6:04 PM · Performance-Team
Peter updated the task description for T203216: Change dashboards using navtiming to navtiming2.
Mon, Sep 24, 5:57 PM · Performance-Team
Peter closed T195231: Blog post: Explain synthetic testing, a subtask of T195230: Blog post series about synthetic testing, as Resolved.
Mon, Sep 24, 5:47 PM · Performance-Team
Peter closed T195231: Blog post: Explain synthetic testing as Resolved.

This was part of:
https://phabricator.wikimedia.org/phame/post/view/117/performance_testing_in_a_controlled_lab_environment_-_the_metrics/

Mon, Sep 24, 5:47 PM · Performance-Team
Peter moved T190504: Last Visual Change is wrong for emulated mobile on Browsertime/WebPageReplay from Doing to Radar on the Performance-Team board.
Mon, Sep 24, 5:44 PM · Performance-Team, WebPageReplay, Upstream
Peter moved T192050: Use Docker version of WebPageTest agents from Doing to Next-up on the Performance-Team board.
Mon, Sep 24, 5:43 PM · WebPageTest, Performance-Team
Peter added a comment to T195840: Track when a CentralNotice banner was displayed to the user in NavTiming.

@Gilles I've added the User Timing the WebPageTest dashboard: https://grafana.wikimedia.org/dashboard/db/webpagetest-drilldown?panelId=47&fullscreen&orgId=1

Mon, Sep 24, 5:38 PM · MW-1.32-notes (WMF-deploy-2018-10-02 (1.32.0-wmf.24)), Patch-For-Review, Wikimedia-Fundraising, MediaWiki-extensions-NavigationTiming, Performance-Team
Peter moved T204345: Wrong images are picked up in Browsertime/WebPageReplay on Mobile from Doing to Radar on the Performance-Team board.
Mon, Sep 24, 5:29 PM · Performance-Team, Upstream, WebPageReplay
Peter added a project to T204345: Wrong images are picked up in Browsertime/WebPageReplay on Mobile: Upstream.
Mon, Sep 24, 5:28 PM · Performance-Team, Upstream, WebPageReplay
Peter added a comment to T204300: [investigate] Increase in instability in metrics.

Or rather just move the enwiki tests to one of the others, that's the easiest way to just test.

Mon, Sep 24, 5:28 PM · WebPageReplay, WebPageTest, Performance-Team
Peter added a comment to T204300: [investigate] Increase in instability in metrics.

It doesn't depend on browser version. Let me try to deploy on another server.

Mon, Sep 24, 5:27 PM · WebPageReplay, WebPageTest, Performance-Team
Peter added a comment to T204345: Wrong images are picked up in Browsertime/WebPageReplay on Mobile.

There's bug in the script I created, I'll fix that upstream in Browsertime. For now I added an extra element, the CentralNotice div. I'll test it out on the server running the English wikipedia.

Mon, Sep 24, 11:44 AM · Performance-Team, Upstream, WebPageReplay
Peter moved T204345: Wrong images are picked up in Browsertime/WebPageReplay on Mobile from Next-up to Doing on the Performance-Team board.
Mon, Sep 24, 11:43 AM · Performance-Team, Upstream, WebPageReplay
Peter created T205246: Deploy c4.xlarge for Firefox tests .
Mon, Sep 24, 7:39 AM · Performance-Team, WebPageReplay

Sep 22 2018

Peter created T205181: Add link to atom feed in each main blog page.
Sep 22 2018, 9:32 AM · Upstream, Phabricator (Upstream)

Sep 21 2018

Peter triaged T203543: Chrome 69 increase time for first visual change in synthetic testing as Normal priority.
Sep 21 2018, 10:22 AM · WebPageReplay, Upstream, Performance-Team
Peter triaged T204300: [investigate] Increase in instability in metrics as High priority.
Sep 21 2018, 10:22 AM · WebPageReplay, WebPageTest, Performance-Team
Peter triaged T204345: Wrong images are picked up in Browsertime/WebPageReplay on Mobile as Normal priority.
Sep 21 2018, 10:22 AM · Performance-Team, Upstream, WebPageReplay
Peter set the image for WebPageReplay to F26130621: profile.
Sep 21 2018, 8:04 AM
Peter edited Description on WebPageReplay.
Sep 21 2018, 8:03 AM
Peter added a project to T190504: Last Visual Change is wrong for emulated mobile on Browsertime/WebPageReplay: WebPageReplay.
Sep 21 2018, 7:59 AM · Performance-Team, WebPageReplay, Upstream
Peter added a project to T198287: Add alerts for all Browsertime/WebPageReplay wikis: WebPageReplay.
Sep 21 2018, 7:57 AM · Russian-Sites, Chinese-Sites, WebPageReplay, Performance-Team
Peter added a project to T202251: Try out "hero elements" metrics in WebPageTest: WebPageReplay.
Sep 21 2018, 7:57 AM · WebPageReplay, Patch-For-Review, Performance-Team, WebPageTest
Peter added a project to T198394: Change viewport for desktop tests (Browsertime and WebPageTest): WebPageReplay.
Sep 21 2018, 7:56 AM · WebPageReplay, WebPageTest, Performance-Team
Peter added a project to T203543: Chrome 69 increase time for first visual change in synthetic testing: WebPageReplay.
Sep 21 2018, 7:56 AM · WebPageReplay, Upstream, Performance-Team
Peter added a project to T204300: [investigate] Increase in instability in metrics: WebPageReplay.
Sep 21 2018, 7:55 AM · WebPageReplay, WebPageTest, Performance-Team
Peter added a watcher for WebPageReplay: Peter.
Sep 21 2018, 7:54 AM
Peter added a comment to T205058: Create project component WebPageReplay.

Thank you @Aklapper !

Sep 21 2018, 7:54 AM · Performance-Team, Project-Admins
Peter added a project to T204345: Wrong images are picked up in Browsertime/WebPageReplay on Mobile: WebPageReplay.
Sep 21 2018, 7:53 AM · Performance-Team, Upstream, WebPageReplay
Peter added projects to Blog Post: Performance testing in a controlled lab environment - the metrics: WebPageReplay, WebPageTest.
Sep 21 2018, 7:52 AM · WebPageTest, WebPageReplay, Performance-Team
Peter published Blog Post: Performance testing in a controlled lab environment - the metrics.
Sep 21 2018, 7:49 AM · WebPageTest, WebPageReplay, Performance-Team
Peter created T205058: Create project component WebPageReplay.
Sep 21 2018, 6:29 AM · Performance-Team, Project-Admins
Peter edited Description on WebPageTest.
Sep 21 2018, 6:20 AM
Peter updated the image for WebPageTest from F181978: project.png to F26124948: profile.
Sep 21 2018, 6:17 AM

Sep 20 2018

Peter updated subscribers of T204300: [investigate] Increase in instability in metrics.

Yep the metrics are more unstable with Chrome 69 on the Chinese wiki by time (haven't calculated by %). For all wikis the mdev is higher with 69 but most wikis (I think all except the English Wikipedia) still have stable medians.

Sep 20 2018, 10:57 AM · WebPageReplay, WebPageTest, Performance-Team
Peter closed T204333: Update WebPageTest server settings as Resolved.

I've updated the settings: Removed the ones that wasn't used, added new ones that are interesting for us.

Sep 20 2018, 5:29 AM · Performance-Team, WebPageTest
Peter moved T204333: Update WebPageTest server settings from Next-up to Doing on the Performance-Team board.
Sep 20 2018, 5:14 AM · Performance-Team, WebPageTest
Peter added a comment to T204300: [investigate] Increase in instability in metrics.

Yeah, we can try that maybe. I think like this: With the mobile site we can see that we have very low variation (see https://phabricator.wikimedia.org/T185186#4597159). I think some of our pages/wikis are harder to test (more JavaScript before first paint etc) and they are more sensitive to what happens on the server running the tests. But it also depends on the browser, I think I can see that with Chrome 69 on the Chinese wiki we get more unstable metrics (reverting to 68 helped us), I will let that run during the day today and then we can look at the metrics.

Sep 20 2018, 5:01 AM · WebPageReplay, WebPageTest, Performance-Team
Peter updated the task description for T203543: Chrome 69 increase time for first visual change in synthetic testing.
Sep 20 2018, 4:34 AM · WebPageReplay, Upstream, Performance-Team
Peter added a project to T203543: Chrome 69 increase time for first visual change in synthetic testing: Upstream.

Upstream: https://bugs.chromium.org/p/chromium/issues/detail?id=887205

Sep 20 2018, 4:32 AM · WebPageReplay, Upstream, Performance-Team

Sep 19 2018

Peter added a comment to T203543: Chrome 69 increase time for first visual change in synthetic testing.

I've made more tests now and made sure the only change is 69. It seems that 69 spends more time in creating the layout:
Layout : 1214.3 vs Layout : 1836.0

Sep 19 2018, 8:40 PM · WebPageReplay, Upstream, Performance-Team
Peter added a comment to T204300: [investigate] Increase in instability in metrics.

Couldn't see any diff in the metrics (that last green line is the change with orange -> white):


Only one run on that dashboard though.

Sep 19 2018, 1:53 PM · WebPageReplay, WebPageTest, Performance-Team
Peter added a comment to T204300: [investigate] Increase in instability in metrics.

Hmm I wonder .. checking the Chinese wiki, the increase in instability in metrics happened exactly when we pushed Chrome 69:

Sep 19 2018, 8:59 AM · WebPageReplay, WebPageTest, Performance-Team
Peter added a comment to T203543: Chrome 69 increase time for first visual change in synthetic testing.

Looking at other wikis it seems pretty clear that 69 introduced something. Only change in the Docker container at that moment was upgrading to 69 (and FF to 62). The blue annotation line in the graph is when we updated to 69:

Sep 19 2018, 8:48 AM · WebPageReplay, Upstream, Performance-Team