Gilles (Gilles Dubuc)
Senior Performance Engineer, WMF

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Friday

  • Clear sailing ahead.

User Details

User Since
Oct 7 2014, 8:24 AM (166 w, 1 d)
Availability
Available
IRC Nick
gilles
LDAP User
Gilles
MediaWiki User
Unknown

Recent Activity

Today

Gilles added a comment to T176361: Run performance tests using local proxy.

I think that if we figured out the cause, we might be able to make things even more stable than our best current setup. But I agree that we've already spent a lot of resources on this issue and have a working setup with no practical issues since there's no PII, I don't want to keep investigating this beyond the current quarter.

Wed, Dec 13, 4:20 PM · Performance-Team
Gilles updated the post content for Blog Post: The journey to Thumbor, part 1: rationale.
Wed, Dec 13, 4:14 PM · Thumbor, Performance-Team
Gilles updated the post content for Blog Post: The journey to Thumbor, part 2: thumbnailing architecture.
Wed, Dec 13, 4:14 PM · Performance-Team, Thumbor
Gilles updated the post content for Blog Post: The journey to Thumbor, part 3: development and deployment strategy.
Wed, Dec 13, 4:14 PM · Thumbor, Performance-Team

Mon, Dec 11

Gilles added a comment to T176361: Run performance tests using local proxy.

Here's the catch: all the work being done is local to the machine. We record HTTP requests talking to the internet, but then we replay them entirely locally when the measurements are made. A lot of stuff runs (browser, ffmpeg, web servers), but you'd expect that a bare metal machine with bigger specs than c4.large would be more consistent than AWS, but no. I really have no idea what might be different. Linux kernel options? More recent generation of CPU? With so many processes involved it's really a black box, we don't know what makes it considerably more consistent across runs on AWS.

Mon, Dec 11, 8:24 PM · Performance-Team
Gilles added a comment to T176361: Run performance tests using local proxy.

We ran this on spare bare metal servers Ops sourced for us (one without SSDs, one with an SSDs) and it still didn't give us test stability anywhere near AWS.

Mon, Dec 11, 2:56 PM · Performance-Team
Gilles added a comment to T180696: Terminate Thumbor with SSL.

I don't expect any other work, no. This task really is only about adding SSL termination to Thumbor, so that Mediawiki can talk to it directly securely, since in the private wiki/thumb.php scenario we're not going through the Swift proxy.

Mon, Dec 11, 11:51 AM · Performance-Team (Radar), Thumbor
Gilles added a comment to T176361: Run performance tests using local proxy.

@Peter running the following on a new VM just now:

Mon, Dec 11, 10:04 AM · Performance-Team

Fri, Dec 8

Gilles added a comment to T176361: Run performance tests using local proxy.

All 3 ways of running Docker containers on Google Cloud are now set up and reporting to: https://grafana.wikimedia.org/dashboard/db/webpagereplay?refresh=15m&orgId=1&from=now-7d&to=now

Fri, Dec 8, 1:08 PM · Performance-Team
Gilles triaged T182390: 2017-12-07 Huge SaveTiming spike as High priority.
Fri, Dec 8, 8:47 AM · Performance-Team
Gilles created T182390: 2017-12-07 Huge SaveTiming spike.
Fri, Dec 8, 8:47 AM · Performance-Team
Gilles added a comment to T176361: Run performance tests using local proxy.

I've added a Google Compute VM of similar cost than c4.large, running the tests on BarackObama with 7 runs, for desktop and mobile: https://grafana.wikimedia.org/dashboard/db/webpagereplay?refresh=15m&orgId=1&from=now-7d&to=now

Fri, Dec 8, 8:36 AM · Performance-Team

Wed, Dec 6

Gilles committed rTHMBREXTda148b1f0510: Avoid bare excepts (authored by Gilles).
Avoid bare excepts
Wed, Dec 6, 10:21 AM
Gilles closed D896: Avoid bare excepts.
Wed, Dec 6, 10:21 AM
This is a test notification, sent at Wed, Dec 6, 11:14.
Wed, Dec 6, 10:14 AM
Gilles added a comment to T180696: Terminate Thumbor with SSL.

@fgiunchedi I'd like to add private wiki support for Thumbor as a Q3 goal. Will you have the bandwidth to handle this task next quarter?

Wed, Dec 6, 10:13 AM · Performance-Team (Radar), Thumbor
Gilles added a project to T181315: load.php response taking 160s (of which only 0.031s in Apache): Patch-For-Review.
Wed, Dec 6, 10:09 AM · Patch-For-Review, Traffic, Operations, Performance-Team
Gilles added a comment to T181877: CSS loading sometimes delayed in Firefox; FOUC reproducibly displayed.

Right, in case that wasn't clear, this happens easily, slowing down the connection just makes it happen consistently.

Wed, Dec 6, 10:04 AM · Upstream, Performance-Team, Regression, MediaWiki-ResourceLoader, Browser-Support-Firefox

Mon, Dec 4

Gilles added a comment to T176361: Run performance tests using local proxy.

Also, we could try Google's cloud, I believe we gave free credit there or something.

Mon, Dec 4, 10:54 AM · Performance-Team
Gilles added a comment to T176361: Run performance tests using local proxy.

@Peter did you always run the AWS test inside Docker? That's the one thing we haven't tried on Cloud VPS and bare metal. If you did and it didn't change stability before/after Docker I don't think it's worth looking into, though.

Mon, Dec 4, 10:53 AM · Performance-Team
Gilles moved T167403: Measure time-to-logo with ResourceTiming from Potential goals to Backlog on the Performance-Team board.
Mon, Dec 4, 10:50 AM · Performance-Team
Gilles added a comment to T167403: Measure time-to-logo with ResourceTiming.

Sure, I need to write a more concrete proof-of-concept before we can consider it

Mon, Dec 4, 10:50 AM · Performance-Team

Fri, Dec 1

Gilles added a comment to T181315: load.php response taking 160s (of which only 0.031s in Apache).

We can lower the threshold of the slow log at some point and you won't need to hit such extreme cases for them to show up. But yes, for now only 60-120 seconds will show up in there with some information about what happened.

Fri, Dec 1, 11:54 AM · Patch-For-Review, Traffic, Operations, Performance-Team

Thu, Nov 30

Gilles removed a project from T181315: load.php response taking 160s (of which only 0.031s in Apache): Patch-For-Review.
Thu, Nov 30, 9:05 PM · Patch-For-Review, Traffic, Operations, Performance-Team
Gilles claimed T181315: load.php response taking 160s (of which only 0.031s in Apache).
Thu, Nov 30, 9:04 PM · Patch-For-Review, Traffic, Operations, Performance-Team
Gilles added a comment to T181315: load.php response taking 160s (of which only 0.031s in Apache).

OK, we have the explanation as to why the 2+ minute request didn't show up in the Varnish slow log. By default the VSL transaction timeout in Varnish is 120 seconds, and the varnishncsa command the slow log is currently based on doesn't allow overriding that value. Meaning that if a Varnish transaction takes more than 120 seconds, it won't be recorded in the slow log. In essence, the Varnish slow log only records requests taking longer than 60 but less than 120 seconds.

Thu, Nov 30, 9:03 PM · Patch-For-Review, Traffic, Operations, Performance-Team

Wed, Nov 29

Gilles added a comment to T178849: Click on fullImageLink <a> for PDF on File: page no longer rendering in browser.

I think the bottleneck here is Swift being written to, the DB queries being read would be negligible DB load, IMHO.

Wed, Nov 29, 9:56 PM · MediaWiki-File-management, Commons, MW-1.31-release-notes (WMF-deploy-2017-11-28 (1.31.0-wmf.10)), Patch-For-Review, Regression, media-storage, Multimedia, Multimedia-Team-Working-Board
Gilles added a comment to T178849: Click on fullImageLink <a> for PDF on File: page no longer rendering in browser.

It usually takes days, yes. Would leaving a message in the SAL be enough warning?

Wed, Nov 29, 9:37 PM · MediaWiki-File-management, Commons, MW-1.31-release-notes (WMF-deploy-2017-11-28 (1.31.0-wmf.10)), Patch-For-Review, Regression, media-storage, Multimedia, Multimedia-Team-Working-Board
Gilles added a comment to T181626: Requesting access to terbium.eqiad.wmnet for cparle.

IMHO manual access is necessary in case it doesn't work as expected, etc. It's always convenient to be able to eval things as prod mediawiki and so on when working on this sort of that. And yes, the maintenance servers group is fine.

Wed, Nov 29, 9:22 PM · Patch-For-Review, Operations, Ops-Access-Requests
Gilles added a comment to T178849: Click on fullImageLink <a> for PDF on File: page no longer rendering in browser.

We only want this to run once. I've never felt the need to automate this sort of job, starting a screen and running the command is very simple.

Wed, Nov 29, 9:21 PM · MediaWiki-File-management, Commons, MW-1.31-release-notes (WMF-deploy-2017-11-28 (1.31.0-wmf.10)), Patch-For-Review, Regression, media-storage, Multimedia, Multimedia-Team-Working-Board
Gilles added a comment to T181493: Enable Page Previews EventLogging instrumentation.

I think it'd be nice to do the data collection before the deployment freeze and then that gives us time to analyze results and discuss next steps for the next quarter?

Wed, Nov 29, 9:19 PM · Patch-For-Review, Readers-Web-Kanban-Board, Page-Previews, Wikimedia-Site-requests, Readers-Web-Backlog
Gilles added a comment to T176361: Run performance tests using local proxy.

AWS just released 2 products on opposite sides of the spectrum that would be worth trying out for this:
https://aws.amazon.com/fr/blogs/aws/aws-fargate/
https://aws.amazon.com/fr/blogs/aws/new-amazon-ec2-bare-metal-instances-with-direct-access-to-hardware/

Wed, Nov 29, 9:05 PM · Performance-Team
Gilles added a comment to T181626: Requesting access to terbium.eqiad.wmnet for cparle.

With @Cparle working on the backend of Multimedia files, the necessity to run maintenance script is kind of inevitable for that sort of task. His work in that area increases the currently low human redundancy we have with people who know how to take care of these issues in production. He has shown to be capable of fully understanding the underlying code and stack and I trust him with performing data recovery in production.

Wed, Nov 29, 2:31 PM · Patch-For-Review, Operations, Ops-Access-Requests
Gilles closed T181507: Some BSicon SVG files that don't define a namespace on Commons fail to load, their PNG thumbnail have a HTTP 429 error as Declined.

Indeed, the namespace is necessary. I don't think we should be more permissive than browsers.

Wed, Nov 29, 1:56 PM · media-storage, Thumbor
Gilles closed T181507: Some BSicon SVG files that don't define a namespace on Commons fail to load, their PNG thumbnail have a HTTP 429 error, a subtask of T43371: Thumbnail/imagescaler (tracking), as Declined.
Wed, Nov 29, 1:56 PM · media-storage, Commons, Tracking
Gilles added a comment to T178559: Chrome 62 performance regression.

They might have rolled it out geographically, starting with some high latency locations.

Wed, Nov 29, 1:53 PM · Performance-Team, WebPageTest

Tue, Nov 28

Gilles added a comment to T178849: Click on fullImageLink <a> for PDF on File: page no longer rendering in browser.

@Cparle you should be able to do that yourself, on terbium.eqiad.wmnet See this guide if you don't have shell access yet.

Tue, Nov 28, 8:54 PM · MediaWiki-File-management, Commons, MW-1.31-release-notes (WMF-deploy-2017-11-28 (1.31.0-wmf.10)), Patch-For-Review, Regression, media-storage, Multimedia, Multimedia-Team-Working-Board
Gilles added a comment to T181315: load.php response taking 160s (of which only 0.031s in Apache).

Going back to the context of this task, the request that took more than a minute in the HAR should have been seen by the slow Varnish log and wasn't. This suggests that the problem was somewhere between Varnish and the user. Varnish is terminated by Nginx for SSL, request queueing by Nginx is also a possibility.

Tue, Nov 28, 12:19 PM · Patch-For-Review, Traffic, Operations, Performance-Team
Gilles added a comment to T181315: load.php response taking 160s (of which only 0.031s in Apache).

Slight correction: the fields start at 1, so Timestamp:Resp[2] is correct for total time spent in Varnish. We could log more, though.

Tue, Nov 28, 12:04 PM · Patch-For-Review, Traffic, Operations, Performance-Team
Gilles added a comment to T181315: load.php response taking 160s (of which only 0.031s in Apache).

I've found the explanation here.

Tue, Nov 28, 10:58 AM · Patch-For-Review, Traffic, Operations, Performance-Team
Gilles added a comment to T154132: SVG image files, switch systemLanguage, lang argument, and mixed-case IETF langtags.

@ABorbaWMF anyone can upload files to Beta. You can just download the original of that file from Commons and upload it to Beta: https://commons.wikimedia.beta.wmflabs.org/wiki/Special:UploadWizard remember to copy/paste the licensing information found on Commons (license and list of authors).

Tue, Nov 28, 9:49 AM · MW-1.31-release-notes (WMF-deploy-2017-11-28 (1.31.0-wmf.10)), Patch-For-Review, Multimedia-Team-Working-Board, Wikimedia-SVG-rendering, Chinese-Sites, Commons, Multimedia, MediaWiki-File-management

Mon, Nov 27

Gilles added a comment to T181315: load.php response taking 160s (of which only 0.031s in Apache).

If varnish saw this request as taking long, that would be reflected in the Backend-Timing header, right? So this must be happening inside varnish (or between varnish layers), or somewhere in the network (or on the client OS before the packets are passed to the browser, although can't really imagine how that could happen).

Mon, Nov 27, 10:54 PM · Patch-For-Review, Traffic, Operations, Performance-Team
Gilles added a comment to T181315: load.php response taking 160s (of which only 0.031s in Apache).

I've looked for that particular request from the HAR file in the varnish logstash data you've linked to @ema and couldn't find it.

Mon, Nov 27, 9:38 PM · Patch-For-Review, Traffic, Operations, Performance-Team
Gilles added a comment to T180688: Firefox 57 improvement.

I think that's a non-issue, clearing the cache every time isn't "normal behavior" either. Saying that this particular feature needs to be on for things to be realistic is just cherry-picking.

Mon, Nov 27, 1:15 PM · Upstream, Performance-Team
Gilles added a comment to T181315: load.php response taking 160s (of which only 0.031s in Apache).

It is indeed startling. Does this happen to you on all browsers? You mention that you can trigger this easily, it would be interesting if you can send us more HAR files, to see if there's any pattern to the requests that take a long time.

Mon, Nov 27, 12:13 PM · Patch-For-Review, Traffic, Operations, Performance-Team
Gilles added a comment to T180688: Firefox 57 improvement.

Is the task description up-to-date in regards to that bugfix? I.e. are regressions you initially saw on FF57 still true?

Mon, Nov 27, 10:26 AM · Upstream, Performance-Team
Gilles added a comment to T181315: load.php response taking 160s (of which only 0.031s in Apache).

See my reply above

Mon, Nov 27, 10:24 AM · Patch-For-Review, Traffic, Operations, Performance-Team
Gilles added a comment to T181315: load.php response taking 160s (of which only 0.031s in Apache).

@Samat sorry I gave you the wrong address, the correct one is: performance-team@lists.wikimedia.org

Mon, Nov 27, 10:23 AM · Patch-For-Review, Traffic, Operations, Performance-Team
Gilles added a comment to T181026: Spikes in TTFB for mobile.

Have you reported this upstream?

Mon, Nov 27, 9:39 AM · Upstream, Performance-Team, WebPageTest
Gilles added a comment to T181315: load.php response taking 160s (of which only 0.031s in Apache).

@Samat can you email the HAR file to performance-team@wikimedia.org ?

Mon, Nov 27, 9:29 AM · Patch-For-Review, Traffic, Operations, Performance-Team
Gilles removed projects from T181359: Online AI Shopping With M-Wallet System: WebPageTest, Performance-Team.
Mon, Nov 27, 9:26 AM · Trash
Gilles closed T163876: Grafana's incorrectly localizes dates (upstream bug) as Resolved.

It looks like the times are consistent now. The date is still localized to French in those contexts, but I can live with that.

Mon, Nov 27, 9:16 AM · Upstream, Performance-Team
Gilles added a comment to T180667: Collect RUMSpeedIndex from users.

Is it possible that in your tests, the rumSpeedIndex is computed before the banner has appeared?

Mon, Nov 27, 9:09 AM · Patch-For-Review, Performance-Team
Gilles added a comment to T178849: Click on fullImageLink <a> for PDF on File: page no longer rendering in browser.

All potentially multipage documents on all wikis were processed: PDFs, DJVUs, TIFFs. The migration was run one file type at a time, using the media_type, major_mime and minor_mime parameters in refreshFileHeaders for efficient underlying SQL queries.

Mon, Nov 27, 9:05 AM · MediaWiki-File-management, Commons, MW-1.31-release-notes (WMF-deploy-2017-11-28 (1.31.0-wmf.10)), Patch-For-Review, Regression, media-storage, Multimedia, Multimedia-Team-Working-Board

Tue, Nov 21

JeanFred awarded Blog Post: The journey to Thumbor, part 3: development and deployment strategy a Yellow Medal token.
Tue, Nov 21, 9:54 PM · Thumbor, Performance-Team

Mon, Nov 20

Gilles moved T175708: Add annotations per URL tested in WebPagetest from Inbox to Backlog on the Performance-Team board.
Mon, Nov 20, 9:22 PM · Performance-Team, WebPageTest
Gilles moved T180598: NavigationTimingv2 misses mediaWikiLoadComplete from Inbox to Doing on the Performance-Team board.
Mon, Nov 20, 9:19 PM · MediaWiki-extensions-NavigationTiming, Performance-Team
Gilles moved T180667: Collect RUMSpeedIndex from users from Inbox to Doing on the Performance-Team board.
Mon, Nov 20, 9:19 PM · Patch-For-Review, Performance-Team
Gilles moved T180696: Terminate Thumbor with SSL from Inbox to Radar on the Performance-Team board.
Mon, Nov 20, 9:17 PM · Performance-Team (Radar), Thumbor
Gilles moved T180766: Make MediaWiki profiler in Beta match production from Inbox to Next-up on the Performance-Team board.
Mon, Nov 20, 9:16 PM · Performance-Team, Beta-Cluster-Infrastructure
Gilles assigned T180766: Make MediaWiki profiler in Beta match production to Krinkle.
Mon, Nov 20, 9:16 PM · Performance-Team, Beta-Cluster-Infrastructure
Gilles moved T180761: Set up XHGui for Beta Cluster from Inbox to Backlog on the Performance-Team board.
Mon, Nov 20, 9:16 PM · Performance-Team, Beta-Cluster-Infrastructure
Gilles moved T180784: Tags in Grafana for performance issues from Inbox to Next-up on the Performance-Team board.
Mon, Nov 20, 9:15 PM · monitoring, Performance-Team
Gilles assigned T180784: Tags in Grafana for performance issues to Peter.
Mon, Nov 20, 9:14 PM · monitoring, Performance-Team
Gilles moved T180793: Frequent "Wikimedia\\Rdbms\\DatabaseMysqlBase::lock failed to acquire lock" errors on WMF mediawiki logs from Inbox to Next-up on the Performance-Team board.
Mon, Nov 20, 9:11 PM · MW-1.31-release-notes (WMF-deploy-2017-12-05 (1.31.0-wmf.11)), Patch-For-Review, DBA, Wikimedia-log-errors, Performance-Team
Gilles assigned T180793: Frequent "Wikimedia\\Rdbms\\DatabaseMysqlBase::lock failed to acquire lock" errors on WMF mediawiki logs to aaron.
Mon, Nov 20, 9:11 PM · MW-1.31-release-notes (WMF-deploy-2017-12-05 (1.31.0-wmf.11)), Patch-For-Review, DBA, Wikimedia-log-errors, Performance-Team
Gilles updated the post content for Blog Post: The journey to Thumbor, part 3: development and deployment strategy.
Mon, Nov 20, 12:43 PM · Thumbor, Performance-Team
Gilles created Blog Post: The journey to Thumbor, part 3: development and deployment strategy.
Mon, Nov 20, 12:42 PM · Thumbor, Performance-Team
Gilles added a comment to T180784: Tags in Grafana for performance issues.

I've tried adding one for when WPT upgraded to FF57 and I've found a bug/limitation already with the way we set up some of our dashboards: https://github.com/grafana/grafana/issues/9822

Mon, Nov 20, 8:51 AM · monitoring, Performance-Team
Gilles triaged T180667: Collect RUMSpeedIndex from users as Normal priority.
Mon, Nov 20, 7:16 AM · Patch-For-Review, Performance-Team
Gilles claimed T180667: Collect RUMSpeedIndex from users.
Mon, Nov 20, 7:16 AM · Patch-For-Review, Performance-Team
Gilles added a project to Blog Post: The journey to Thumbor, part 2: thumbnailing architecture: Performance-Team.
Mon, Nov 20, 6:59 AM · Performance-Team, Thumbor
Gilles added a project to Blog Post: The journey to Thumbor, part 2: thumbnailing architecture: Thumbor.
Mon, Nov 20, 6:59 AM · Performance-Team, Thumbor
Gilles updated subscribers of T180793: Frequent "Wikimedia\\Rdbms\\DatabaseMysqlBase::lock failed to acquire lock" errors on WMF mediawiki logs.

prepared-edit indicates that this is part of edit stashing. Which is preemptive processing of an edit a user is making before they actually hit save. If it fails, the worst that happens is that the edit processing has to be redone from scratch when the user hits "save".

Mon, Nov 20, 6:42 AM · MW-1.31-release-notes (WMF-deploy-2017-12-05 (1.31.0-wmf.11)), Patch-For-Review, DBA, Wikimedia-log-errors, Performance-Team

Fri, Nov 17

Gilles created Blog Post: The journey to Thumbor, part 2: thumbnailing architecture.
Fri, Nov 17, 3:17 PM · Performance-Team, Thumbor
Gilles added a comment to T180784: Tags in Grafana for performance issues.

How about "synthetic" instead of webpagetest? Since we're about to introduce a new kind of synthetic test

Fri, Nov 17, 1:35 PM · monitoring, Performance-Team
Gilles added a project to T169144: Serve thumb.php requests with Thumbor: Patch-For-Review.
Fri, Nov 17, 10:00 AM · Patch-For-Review, Performance-Team, Thumbor
Gilles added a revision to T169144: Serve thumb.php requests with Thumbor: D886: Support for private containers with secret key gate.
Fri, Nov 17, 9:59 AM · Patch-For-Review, Performance-Team, Thumbor
Gilles added a comment to T176361: Run performance tests using local proxy.

It's possible that to do this right we'll need multiple machines. The bottleneck is the time it takes to complete the slowed down requests. Maybe we could try an instance cheaper than c4.large and see if we get the same stability? We haven't tried that, i.e. seeing what the cheapest kind of AWS instance that can support this level of stability.

Fri, Nov 17, 8:23 AM · Performance-Team

Thu, Nov 16

Gilles created T180696: Terminate Thumbor with SSL.
Thu, Nov 16, 3:15 PM · Performance-Team (Radar), Thumbor
Gilles moved T169144: Serve thumb.php requests with Thumbor from Potential goals to Doing on the Performance-Team board.
Thu, Nov 16, 3:13 PM · Patch-For-Review, Performance-Team, Thumbor
Gilles added a comment to T169144: Serve thumb.php requests with Thumbor.

Fair enough, I didn't have the case of privilege escalation in mind.

Thu, Nov 16, 11:45 AM · Patch-For-Review, Performance-Team, Thumbor
Gilles added a comment to T166542: Is there something in our HTML structure that makes Firefox parsing slow(er) than it needs to be?.

I don't see the big gap on synthetic testing anymore. In RUM, we don't have enough FF57 data yet, but what's already there suggests that FF57 is on par with Chrome62 for the median. Can't compare percentiles with so little data.

Thu, Nov 16, 11:32 AM · Performance-Team
Gilles added a comment to T169144: Serve thumb.php requests with Thumbor.

The little amount of gatekeeping there would be in thumbor is that thumbor would only access private containers if the request comes from the thumb.php endpoint (which is different than varnish's). No key required, the different URL handler is enough.

Thu, Nov 16, 11:25 AM · Patch-For-Review, Performance-Team, Thumbor
Gilles added a comment to T169144: Serve thumb.php requests with Thumbor.

Hmmm the more I think about the implementation, the more the shared key would be make-believe security.

Thu, Nov 16, 11:24 AM · Patch-For-Review, Performance-Team, Thumbor
Gilles added a comment to T169144: Serve thumb.php requests with Thumbor.

@fgiunchedi the shared secret key sounds like the simplest thing to do. Do you think we should have a separate thumbor swift user for private wikis? Or just grant it r/w access to those containers if it doesn't have it already?

Thu, Nov 16, 11:12 AM · Patch-For-Review, Performance-Team, Thumbor
Gilles added a comment to T154895: Investigate late first visual change/start render in Firefox.

On FF57 it seems like Firefox beats Chrome for StartRender on the Sweden article (10k DOM elements), is slightly slower for the Facebook article (12k DOM elements) and noticeably slower for the Barack Obama article (16k DOM elements).

Thu, Nov 16, 11:10 AM · Performance-Team
Gilles created T180667: Collect RUMSpeedIndex from users.
Thu, Nov 16, 9:39 AM · Patch-For-Review, Performance-Team
Gilles added a comment to T162263: PNG thumbnail of a specific SVG file uploaded to Commons is clipped / cut at some sides.

Purged that file, the issue is still the same.

Thu, Nov 16, 8:40 AM · Thumbor, Commons, MediaWiki-File-management, Multimedia

Wed, Nov 15

Gilles added a comment to T178849: Click on fullImageLink <a> for PDF on File: page no longer rendering in browser.

Is it possible to avoid libcurl adding that header automatically? Presumably if that header wasn't set in the update call, it wouldn't be touched by Swift.

Wed, Nov 15, 7:52 PM · MediaWiki-File-management, Commons, MW-1.31-release-notes (WMF-deploy-2017-11-28 (1.31.0-wmf.10)), Patch-For-Review, Regression, media-storage, Multimedia, Multimedia-Team-Working-Board

Tue, Nov 14

Gilles added a comment to T176361: Run performance tests using local proxy.

Indeed, I'm seeing the same thing with a lot of images being stuck before being served, just for Firefox. Chrome is fine with mitmproxy. This would suggest the bad behavior comes from Firefox or its Selenium driver. Or maybe that's just how Firefox behaves when throttled this way?

Tue, Nov 14, 1:40 PM · Performance-Team
Gilles added a comment to T176361: Run performance tests using local proxy.

I see that I'm getting a couple, but not the same ones:

Tue, Nov 14, 1:13 PM · Performance-Team
Gilles added a comment to T175239: Write a guide on how to test performance locally before pushing changes.

Tested all the instructions and fixed a little thing, it's all good.

Tue, Nov 14, 11:59 AM · Performance-Team
Gilles added a comment to T176361: Run performance tests using local proxy.

It's not in Docker form, you can go ahead and make that, it should be very simple. Make sure that you use the latest mitmproxy, what comes with Debian and Ubuntu is very outdated (no HTTP/2 support, etc.).

Tue, Nov 14, 10:08 AM · Performance-Team
Gilles added a comment to T176361: Run performance tests using local proxy.

Running mitmproxy + chrome and firefox every 20 minutes on wmcs, added to https://grafana.wikimedia.org/dashboard/db/webpagereplay?refresh=15m&orgId=1

Tue, Nov 14, 9:13 AM · Performance-Team
Gilles added a comment to T176361: Run performance tests using local proxy.

It works! First working replayed runs with Firefox:

Tue, Nov 14, 8:48 AM · Performance-Team

Nov 13 2017

Gilles moved T179619: Consider aligning Chrome firstPaint with navStart (or fetchStart) from Inbox to Next-up on the Performance-Team board.
Nov 13 2017, 9:38 PM · MediaWiki-extensions-NavigationTiming, Performance-Team
Gilles moved T179595: Find and clear oversized x-content-dimensions headers from Inbox to Radar on the Performance-Team board.
Nov 13 2017, 9:36 PM · Performance-Team (Radar), User-fgiunchedi, Operations, Thumbor
Gilles moved T179954: Thumbor errors should contain a trackable request id from Inbox to Backlog on the Performance-Team board.
Nov 13 2017, 9:35 PM · Performance-Team, Thumbor
Gilles moved T179977: Change use of preconnect Link to header from Inbox to Next-up on the Performance-Team board.
Nov 13 2017, 9:35 PM · Performance-Team