Page MenuHomePhabricator

Peter (Peter Hedenskog)
Software Engineer, Wikimedia Foundation

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Thursday

  • Clear sailing ahead.

User Details

User Since
Aug 17 2015, 6:48 PM (448 w, 13 h)
Availability
Available
IRC Nick
phedenskog
LDAP User
Unknown
MediaWiki User
PHedenskog (WMF) [ Global Accounts ]

Recent Activity

Sat, Mar 16

Peter closed T360005: Create a vocabulary list for the web performance lingo as Resolved.

I think this is good enough now.

Sat, Mar 16, 10:57 AM · Quality-and-Test-Engineering-Team

Fri, Mar 15

Peter added a comment to T360005: Create a vocabulary list for the web performance lingo.

I did a first version at https://wikitech.wikimedia.org/wiki/Performance/Dictionary

Fri, Mar 15, 2:38 PM · Quality-and-Test-Engineering-Team

Thu, Mar 14

Peter moved T263753: Investigate how the Chrome team runs their performance tests in Android from On-going maintenance to Inbox on the Performance-Device-Lab board.
Thu, Mar 14, 10:28 AM · Performance-Team, Performance-Device-Lab
Peter moved T285203: On-demand performance testing from Next Goals to Roadmap on the Performance-Device-Lab board.
Thu, Mar 14, 10:28 AM · Synthetic-Performance-Testing, Performance-Device-Lab
Peter moved T351929: Deploy Mann Whitney U tests for WebPageReplay tests from Backlog to Doing on the Synthetic-Performance-Testing board.
Thu, Mar 14, 10:26 AM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing
Peter added a project to T360091: Request creation of pixel VPS project: Web Team Visual Regression Framework.
Thu, Mar 14, 8:23 AM · Web Team Visual Regression Framework, Quality-and-Test-Engineering-Team, Cloud-VPS (Project-requests)
Peter created T360091: Request creation of pixel VPS project.
Thu, Mar 14, 8:19 AM · Web Team Visual Regression Framework, Quality-and-Test-Engineering-Team, Cloud-VPS (Project-requests)

Wed, Mar 13

Peter created T360005: Create a vocabulary list for the web performance lingo.
Wed, Mar 13, 6:28 AM · Quality-and-Test-Engineering-Team

Tue, Mar 12

Peter added a comment to T324766: Upgrade WebdriverIO to v8 in core.

@zeljkofilipin the first alpha of 9.0 was release earlier today https://github.com/webdriverio/webdriverio/releases/tag/v9.0.0-alpha.0 so I think we should aim for upgrading to 9 instead.

Tue, Mar 12, 7:17 AM · MW-1.42-notes (1.42.0-wmf.19; 2024-02-20), Patch-For-Review, MediaWiki-Core-Tests, Browser-Tests, User-zeljkofilipin

Fri, Mar 8

Peter renamed T285203: On-demand performance testing from Run performance tests on demand to On-demand performance testing.
Fri, Mar 8, 7:35 AM · Synthetic-Performance-Testing, Performance-Device-Lab
Peter closed T283233: Add synthetic performance tests for Edge as Declined.

I think Chrome and Firefox is enough for now. adding Edge would more machines.

Fri, Mar 8, 7:34 AM · Synthetic-Performance-Testing
Peter closed T267555: Create a better warning system for performance regressions as Resolved.

I think T351929 fixes most of this for us.

Fri, Mar 8, 7:33 AM · Synthetic-Performance-Testing, Performance-Device-Lab
Peter closed T291076: Move synthetic tests error reporting from Matrix to Slack as Resolved.

This is done.

Fri, Mar 8, 7:32 AM · Performance-Team
Peter closed T324041: Update user journeys documentation to include Android tests. as Declined.

We don't have android tests so there's nothing to doing right now.

Fri, Mar 8, 7:13 AM · Performance-Team, Documentation
Peter closed T326117: Update synthetic tests that benchmark Wikipedia against other web sites as Declined.

I actually removed the Alexa tests. Let's sync with the web team and if we all think this is useful we can add it again.

Fri, Mar 8, 7:12 AM · Performance-Team
Peter closed T327477: Collect number of long tasks that happens before first contentful paint as Declined.

I think we should focus on Long animation frame API (Loaf) instead T359286 since that can potentially gives us actionable work. Long tasks shows us that something is wrong but not what is wrong.

Fri, Mar 8, 7:11 AM · NavigationTiming
Peter closed T327477: Collect number of long tasks that happens before first contentful paint, a subtask of T264032: Record long tasks in navtiming, as Declined.
Fri, Mar 8, 7:11 AM · MW-1.41-notes (1.41.0-wmf.2; 2023-03-27), MediaWiki-Engineering-Group-onboarding, NavigationTiming, Performance-Team
Peter closed T359506: Problem automating getting correct first input delay on mobile phones as Resolved.

I guess this is because of the extra delay added on single clicks if the viewport is set to a specific size and using Chromedriver the browser "knows" that its a single click.

Fri, Mar 8, 7:05 AM · Performance-Device-Lab, Quality-and-Test-Engineering-Team

Thu, Mar 7

Peter created T359521: Potential interaction to paint problems and fixes.
Thu, Mar 7, 11:37 AM · Web-Team-Backlog (FY2023-24 Q3 Sprint 6), Web Team Essential Work 2024
Peter added a comment to T358380: [3 days] Interaction to Next Paint (INP) Core Web Vital is scored as "Needs Improvement" or "Poor" for Mobile users on Desktop.

I got some feedback from Gilberto Cocchi that the delay come from that we set the width=1000 (meaning it waits for a double tap see https://developer.chrome.com/blog/300ms-tap-delay-gone-away). I tried with touch-action: manipulation; and that fixed it for me.

Thu, Mar 7, 11:30 AM · MW-1.42-notes (1.42.0-wmf.21; 2024-03-05), SEO, Web-Team-Backlog (FY2023-24 Q3 Sprint 4)
Peter added a comment to T358380: [3 days] Interaction to Next Paint (INP) Core Web Vital is scored as "Needs Improvement" or "Poor" for Mobile users on Desktop.

I missed update the issue: So I can reproduce on my Moto G5 when connecting devtools to Chrome and manually clicking. For automation, I don't get the same Input delays on the interactions as if I do it manually (I added T359506 for that). Right now we are stuck in understanding the Input delay we get on the interactions.

Thu, Mar 7, 10:43 AM · MW-1.42-notes (1.42.0-wmf.21; 2024-03-05), SEO, Web-Team-Backlog (FY2023-24 Q3 Sprint 4)
Peter updated the task description for T359506: Problem automating getting correct first input delay on mobile phones.
Thu, Mar 7, 8:25 AM · Performance-Device-Lab, Quality-and-Test-Engineering-Team
Peter created T359506: Problem automating getting correct first input delay on mobile phones.
Thu, Mar 7, 8:14 AM · Performance-Device-Lab, Quality-and-Test-Engineering-Team

Wed, Mar 6

Peter closed T359289: Investigate missing data for mobile users on desktop for enwiki in data from Crux as Resolved.

It was me that disabled getting that data months ago. I have enabled it again.

Wed, Mar 6, 8:37 AM · Quality-and-Test-Engineering-Team
Peter created T359289: Investigate missing data for mobile users on desktop for enwiki in data from Crux .
Wed, Mar 6, 8:09 AM · Quality-and-Test-Engineering-Team
Peter created T359286: Collect data from the Long Animation Frame API .
Wed, Mar 6, 7:38 AM · Web-Team-Backlog (Needs Prioritization (Tech)), NavigationTiming

Tue, Mar 5

Peter closed T335727: Synthetic search tests from Google do not work as Declined.

I removed those tests since they where so noisy.

Tue, Mar 5, 2:52 PM · Synthetic-Performance-Testing
Peter closed T337207: First input delay data is missing as Declined.
Tue, Mar 5, 2:51 PM · NavigationTiming, Performance-Team
Peter closed T355709: Investigate change in First Visual Change 2024-01-15 for Chrome as Resolved.

I moved the tests to a bare metal server.

Tue, Mar 5, 2:50 PM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing
Peter added a comment to T358380: [3 days] Interaction to Next Paint (INP) Core Web Vital is scored as "Needs Improvement" or "Poor" for Mobile users on Desktop.

Hi again, I couldn't fully understand the numbers, so I asked about it on the Web Performance slack channel today and got answer from Barry Pollard who is a devrel at Google. If you are on the channel you can read the conversation here: https://webperformance.slack.com/archives/C04BK7K1X/p1709629694106149

Tue, Mar 5, 2:37 PM · MW-1.42-notes (1.42.0-wmf.21; 2024-03-05), SEO, Web-Team-Backlog (FY2023-24 Q3 Sprint 4)
Peter closed T357530: Move direct tests to bare metal servers as Resolved.

All the tests are moved and alerts has been updated.

Tue, Mar 5, 12:18 PM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing

Mon, Mar 4

Peter closed T358051: Many errors from Grafana with alertname=DatasourceError team=qte 2024-02-20 as Resolved.

Thanks @fgiunchedi I'll turn them off. Actually it has been good for me with that alert since we run that Graphite instance ourselves and it has happened a couple of times that there's been problem with it but I I guess I could do something smarter with some other alert, I'll look into that.

Mon, Mar 4, 6:37 PM · Quality-and-Test-Engineering-Team
Peter added a comment to T357530: Move direct tests to bare metal servers.

Hmm the problem was the screen with Xvfb, setting it to 1 made it work. I'll look into it more tomorrow. Now the test runs at least so I can verify that all test works.

Mon, Mar 4, 5:42 PM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing
Peter added a comment to T357530: Move direct tests to bare metal servers.

The server is installed but I'm having some problem getting all tests up and running because of the screen size for xvfb, let me see how I can fix that.

Mon, Mar 4, 4:08 PM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing
Peter added a comment to T358380: [3 days] Interaction to Next Paint (INP) Core Web Vital is scored as "Needs Improvement" or "Poor" for Mobile users on Desktop.

Hi! I have a question:

Mon, Mar 4, 2:38 PM · MW-1.42-notes (1.42.0-wmf.21; 2024-03-05), SEO, Web-Team-Backlog (FY2023-24 Q3 Sprint 4)
Peter added a comment to T357530: Move direct tests to bare metal servers.

Hmm, I haven't got access to the server yet. I got the email about the purchase but nothing in the GUI yet. I've turned off the tests and need to turn off the alarms too. The last I added a server, it took some time, so I ordered another one. But hopefully this will come through soonish.

Mon, Mar 4, 12:08 PM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing
Peter added a comment to T357530: Move direct tests to bare metal servers.

I've just started the move, hopefully it will be done in a couple of hours.

Mon, Mar 4, 9:56 AM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing

Thu, Feb 22

Peter updated subscribers of T358051: Many errors from Grafana with alertname=DatasourceError team=qte 2024-02-20.

This started to happen again today. I wonder @fgiunchedi can you help me point in the right direction how long timeout we have today for the alerts that goes to the synthetic graphite instance? I looked at our instance but couldn't see anything.

Thu, Feb 22, 5:37 PM · Quality-and-Test-Engineering-Team
Peter reopened T358051: Many errors from Grafana with alertname=DatasourceError team=qte 2024-02-20 as "Open".
Thu, Feb 22, 5:32 PM · Quality-and-Test-Engineering-Team
Peter added a comment to T357530: Move direct tests to bare metal servers.

The cleanup is done so lets do this the 4th of March.

Thu, Feb 22, 3:41 PM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing
Peter closed T357628: Remove synthetic direct tests as Resolved.

Cleanup done.

Thu, Feb 22, 3:40 PM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing
Peter closed T357628: Remove synthetic direct tests, a subtask of T357530: Move direct tests to bare metal servers, as Resolved.
Thu, Feb 22, 3:40 PM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing
Peter closed T358051: Many errors from Grafana with alertname=DatasourceError team=qte 2024-02-20 as Resolved.

It seems like this was a temporary glitch.

Thu, Feb 22, 3:03 PM · Quality-and-Test-Engineering-Team
Peter closed T358201: Change alert rules for Mann Whitney U tests, a subtask of T351929: Deploy Mann Whitney U tests for WebPageReplay tests, as Resolved.
Thu, Feb 22, 2:20 PM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing
Peter closed T358201: Change alert rules for Mann Whitney U tests as Resolved.

This must be some glitch in Grafana. After many tries and deleting the rules and re-create them, they work as expected.

Thu, Feb 22, 2:20 PM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing
Peter added a comment to T358201: Change alert rules for Mann Whitney U tests.

So this annoying. When add graph in Grafana to graph number of pages that have regression:

alerts.jpg (1×2 px, 281 KB)

Thu, Feb 22, 12:59 PM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing
Peter renamed T358201: Change alert rules for Mann Whitney U tests from Change alert rules to Change alert rules for Mann Whitney U tests.
Thu, Feb 22, 11:15 AM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing
Peter created T358201: Change alert rules for Mann Whitney U tests.
Thu, Feb 22, 11:15 AM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing

Wed, Feb 21

Peter created T358129: Add support for logging in the webdriver.io tests.
Wed, Feb 21, 5:54 PM · Browser-Tests, MediaWiki-Core-Tests, Quality-and-Test-Engineering-Team
Peter renamed T358092: Fix async for wdio in core from Add missing async for wdio in core to Fix async for wdio in core.
Wed, Feb 21, 11:45 AM · MW-1.42-notes (1.42.0-wmf.20; 2024-02-27), Browser-Tests, MediaWiki-Core-Tests, Quality-and-Test-Engineering-Team
Peter created T358094: Add missing await on wdio tests.
Wed, Feb 21, 11:35 AM · MW-1.42-notes (1.42.0-wmf.20; 2024-02-27), Quality-and-Test-Engineering-Team, Browser-Tests, MediaWiki-Core-Tests
Peter added projects to T358092: Fix async for wdio in core: MediaWiki-Core-Tests, Browser-Tests.
Wed, Feb 21, 11:33 AM · MW-1.42-notes (1.42.0-wmf.20; 2024-02-27), Browser-Tests, MediaWiki-Core-Tests, Quality-and-Test-Engineering-Team
Peter created T358092: Fix async for wdio in core.
Wed, Feb 21, 11:25 AM · MW-1.42-notes (1.42.0-wmf.20; 2024-02-27), Browser-Tests, MediaWiki-Core-Tests, Quality-and-Test-Engineering-Team

Tue, Feb 20

Peter created T358051: Many errors from Grafana with alertname=DatasourceError team=qte 2024-02-20.
Tue, Feb 20, 8:53 PM · Quality-and-Test-Engineering-Team

Mon, Feb 19

Peter closed T347261: Update performance team documentation as Resolved.
Mon, Feb 19, 7:08 AM · Quality-and-Test-Engineering-Team, Documentation
Peter closed T356839: Restructure test and configuration names for performance tests as Resolved.
Mon, Feb 19, 5:48 AM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing

Feb 16 2024

Peter added a comment to T356839: Restructure test and configuration names for performance tests.

This has been changed. To close I need to remove the old data in Graphite.

Feb 16 2024, 9:27 AM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing
Peter added a comment to T356839: Restructure test and configuration names for performance tests.

When we do this change I want to do two more changes:

  • remove the latency for the "old" test so we run all the tests the same way. That will makes our tests run faster.
  • change group 1 tests to use it.wikipedia.org. Pages there have more content and that will make it easier to spot regressions.
Feb 16 2024, 8:19 AM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing

Feb 15 2024

Peter created T357628: Remove synthetic direct tests.
Feb 15 2024, 1:09 PM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing

Feb 14 2024

Peter created T357530: Move direct tests to bare metal servers.
Feb 14 2024, 1:32 PM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing

Feb 13 2024

Peter added a comment to T355709: Investigate change in First Visual Change 2024-01-15 for Chrome.

What I've done now is reconfigured a personal bare metal server and then I'm gonna keep that running for a couple of days and se how stable metrics we can with direct tests.

Feb 13 2024, 8:43 AM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing
Peter added a comment to T355709: Investigate change in First Visual Change 2024-01-15 for Chrome.

I think this is showing when things started go wrong. It's the same for all Chrome URLs that we test. What is strange though is that we don't see the same on Firefox (on the same server). I verified that it's the exact same Chrome version.

firstvisual.jpg (952×2 px, 238 KB)

Feb 13 2024, 7:15 AM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing

Feb 9 2024

zeljkofilipin awarded Blog Post: Web Performance at FOSDEM 4th of February a Like token.
Feb 9 2024, 1:11 PM
Peter added a comment to T355709: Investigate change in First Visual Change 2024-01-15 for Chrome.

This happened again last night. I've been comparing processes and in the high states there is kworker (kernel worker threads) but I having a hard time digging deeper.

Feb 9 2024, 6:54 AM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing

Feb 8 2024

Peter added a comment to T355709: Investigate change in First Visual Change 2024-01-15 for Chrome.

Looking at the server stats I can see that everytime this happens (increase in first visual change, total blocking time) we have an decrease in CPU idle time and decrease ps state running.

Feb 8 2024, 1:41 PM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing
Peter added a comment to T355709: Investigate change in First Visual Change 2024-01-15 for Chrome.

I cannot see any correlation for the CPU benchmark metric and the TBT.

Feb 8 2024, 12:09 PM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing
Peter added a comment to T351929: Deploy Mann Whitney U tests for WebPageReplay tests.

All WebPageReplay tests has been updated to use Mann Whitney. I've updated the documentation too, now I need to finish the blog post to close this task.

Feb 8 2024, 11:59 AM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing
Peter added a comment to T355709: Investigate change in First Visual Change 2024-01-15 for Chrome.

The numbers have gone back. We can see that long tasks changed, and that made first visual change better.

Feb 8 2024, 11:46 AM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing

Feb 7 2024

Peter added a comment to T356875: Run a linter in CI to check if all Selenium tests have correct async/await.

I did some checks and for linting I think it will only help us if we used typescript with rules like @typescript-eslint/await-thenable, @typescript-eslint/require-await and @typescript-eslint/no-floating-promises.

Feb 7 2024, 6:00 PM · MediaWiki-Core-Tests, User-zeljkofilipin
Peter created T356839: Restructure test and configuration names for performance tests.
Feb 7 2024, 7:47 AM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing
Peter added a comment to T351929: Deploy Mann Whitney U tests for WebPageReplay tests.

I'm updating the group 0 and group 1 alerts today for desktop. What's missing to close this is then to do the blog post and do emulated mobile tests for with significant change.

Feb 7 2024, 7:29 AM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing

Feb 6 2024

Peter added a comment to T351929: Deploy Mann Whitney U tests for WebPageReplay tests.

I removed some old test (beta cluster) and increased the number or runs for group 0 and 1 and then turned on Mann Whitney tests for them too.

Feb 6 2024, 2:22 PM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing

Feb 5 2024

Peter added a comment to T351929: Deploy Mann Whitney U tests for WebPageReplay tests.

I got some feedback from Greg:

  • First let's run the exact same test against the exact same content throughout a day or two and see the variance we have. I need to do some changes in our implementation because today we alway re-record against a fresh version of the page. With the fix, we will run against the exact same version (the way we tried with the static Banksy page). Maybe we can use the Bansky page first.
  • When we have a significant change, alert of the change is larger than 2%. Today we alert on all significant changes.
Feb 5 2024, 3:47 PM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing
Peter closed T356367: Run baseline tests over a day and verify stability, a subtask of T355790: Verify functionality for device lab, as Resolved.
Feb 5 2024, 1:49 PM · Quality-and-Test-Engineering-Team, Performance-Device-Lab
Peter closed T356367: Run baseline tests over a day and verify stability as Resolved.
Feb 5 2024, 1:49 PM · Quality-and-Test-Engineering-Team, Performance-Device-Lab
Peter added a comment to T356367: Run baseline tests over a day and verify stability.
{
  "android": true,
  "replay": true,
    "browsertime": {
	"android": {
	"rooted": true
	},
	"connectivity": {
      "engine": "throttle",
      "throttle": {
        "localhost": true
      },
      "profile": "custom",
      "alias:": "120rtt",
      "rtt": 120
    },
      "chrome": {
        "args": [
          "host-resolver-rules=MAP *:80 127.0.0.1:8085,MAP *:443 127.0.0.1:8086,EXCLUDE localhost",
          "ignore-certificate-errors-spki-list=PhrPvGIaAMmd29hj8BCZOq096yj7uMpRNHpn5PDxI6I=",
          "user-data-dir=/data/local/tmp/chrome/"
        ]
      },
      "firefox": {
        "preference": [
          "network.dns.forceResolve:127.0.0.1",
          "security.OCSP.enabled:0",
          "network.socket.forcePort:80=8085;443=8086"
Feb 5 2024, 1:49 PM · Quality-and-Test-Engineering-Team, Performance-Device-Lab
Peter added a comment to T355709: Investigate change in First Visual Change 2024-01-15 for Chrome.

I just re-deployed the server direct1 to see if we get any difference in metrics. There's an annotation when I deployed so lets wait a couple hours and check.

Feb 5 2024, 12:50 PM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing

Feb 4 2024

Peter added a comment to T355709: Investigate change in First Visual Change 2024-01-15 for Chrome.

Looking at the Chrome trace log there's a layout phase before FCP that causes it that is something like 300 ms longer. It the same amount of elements though.

Feb 4 2024, 6:45 PM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing
Peter added a comment to T355709: Investigate change in First Visual Change 2024-01-15 for Chrome.

A next step tomorrow could be to just destroy that instance and then deploy a new and run the tests there to see if it's dependent on the instance.

Feb 4 2024, 6:34 PM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing
Peter added a comment to T355709: Investigate change in First Visual Change 2024-01-15 for Chrome.

I've looked at the instances at https://grafana.wikimedia.org/d/Vikt09zIk/performance-synthetic-server-metrics and the instance that run these tests seems to use more memory than the rest of the instances. I've rebooted the instance and will restart the tests. I'm just worried that these instabilities comes from the Hetzner cloud instance.

Feb 4 2024, 5:34 PM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing
Peter added a comment to T355709: Investigate change in First Visual Change 2024-01-15 for Chrome.

Adding some more data over time. This is for Largest Contentful Paint:

Screenshot 2024-02-04 at 18.21.33.png (1×2 px, 966 KB)

Feb 4 2024, 5:23 PM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing
Peter updated the task description for T356057: Verify running Firefox with and without WebPageReplay.
Feb 4 2024, 5:17 PM · Quality-and-Test-Engineering-Team, Performance-Device-Lab
Peter closed T356085: Prepare talk for FOSDEM as Resolved.
Feb 4 2024, 5:15 PM · Quality-and-Test-Engineering-Team
Peter added a comment to T351929: Deploy Mann Whitney U tests for WebPageReplay tests.

Ok, this has been running for over a month now. I'm having a meeting with Gregory Mierzwinski tomorrow for some feedback. Since I've upgraded to latest WebPageReplay we have had no instability in metrics for Chrome. For Firefox we had one page that goes back and forth. Feedback from Greg is that if we only have one URL that fails, maybe we should skip that URL.

Feb 4 2024, 5:13 PM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing

Feb 2 2024

Jdlrobson awarded Blog Post: Web Performance at FOSDEM 4th of February a Like token.
Feb 2 2024, 6:24 PM
Peter added a comment to T355238: Performance Team Alerts: DatasourceNoData unsilencing forthcoming.

I removed the alerts and will look at the root cause when I'm back from FOSDEM on Monday, I'll keep the task open so I don't forget.

Feb 2 2024, 8:39 AM · Synthetic-Performance-Testing
Peter claimed T355238: Performance Team Alerts: DatasourceNoData unsilencing forthcoming.
Feb 2 2024, 8:30 AM · Synthetic-Performance-Testing

Feb 1 2024

Peter added a comment to T356367: Run baseline tests over a day and verify stability.

I verified using Chrome on my rooted Samsung A51, the metrics are stable. I'll add my configuration here before I close the issue.

Feb 1 2024, 2:02 PM · Quality-and-Test-Engineering-Team, Performance-Device-Lab
Peter added a comment to T355709: Investigate change in First Visual Change 2024-01-15 for Chrome.

This has come back again for all articles tested using Chrome direct tests:

Feb 1 2024, 5:46 AM · Quality-and-Test-Engineering-Team, Synthetic-Performance-Testing
Peter created T356367: Run baseline tests over a day and verify stability.
Feb 1 2024, 5:40 AM · Quality-and-Test-Engineering-Team, Performance-Device-Lab

Jan 31 2024

Peter created Blog Post: Web Performance at FOSDEM 4th of February.
Jan 31 2024, 6:11 PM

Jan 29 2024

Peter closed T355793: Install and prepare a Raspberry Pi 5 for testing as Resolved.

This is done, it's much faster than the old 4.

Jan 29 2024, 5:35 PM · Quality-and-Test-Engineering-Team, Performance-Device-Lab
Peter closed T355793: Install and prepare a Raspberry Pi 5 for testing, a subtask of T355790: Verify functionality for device lab, as Resolved.
Jan 29 2024, 5:34 PM · Quality-and-Test-Engineering-Team, Performance-Device-Lab
Peter created T356085: Prepare talk for FOSDEM.
Jan 29 2024, 5:32 PM · Quality-and-Test-Engineering-Team
Peter added a comment to T356057: Verify running Firefox with and without WebPageReplay.

The full trace log looks like this:

Jan 29 2024, 2:57 PM · Quality-and-Test-Engineering-Team, Performance-Device-Lab
Peter added a comment to T356057: Verify running Firefox with and without WebPageReplay.

Running from the Raspberry Pi, running 11 runs, one or two of the runs get ERROR: WebDriverError: Failed to decode response from marionette. To get some more useful out of that I need to turn on the Geckodriver log.

Jan 29 2024, 2:52 PM · Quality-and-Test-Engineering-Team, Performance-Device-Lab
Peter created T356057: Verify running Firefox with and without WebPageReplay.
Jan 29 2024, 2:50 PM · Quality-and-Test-Engineering-Team, Performance-Device-Lab

Jan 26 2024

Peter closed T355792: Test if gnirehtet can be used to update browsers from the Play store as Resolved.

This actually works. The first time I tried it failed but after that it just works.

Jan 26 2024, 1:24 PM · Quality-and-Test-Engineering-Team, Performance-Device-Lab
Peter closed T355792: Test if gnirehtet can be used to update browsers from the Play store, a subtask of T355791: Build and verify gnirehtet, as Resolved.
Jan 26 2024, 1:24 PM · Quality-and-Test-Engineering-Team, Performance-Device-Lab
Peter created T355925: Verify that scrcpy works .
Jan 26 2024, 8:22 AM · Quality-and-Test-Engineering-Team, Performance-Device-Lab