Gilles (Gilles Dubuc)
Senior Performance Engineer, WMF

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Friday

  • Clear sailing ahead.

User Details

User Since
Oct 7 2014, 8:24 AM (171 w, 1 d)
Availability
Available
IRC Nick
gilles
LDAP User
Gilles
MediaWiki User
Unknown

Recent Activity

Today

Gilles added a comment to T145497: thumbor/derpconf should default to loading *.conf from config directory.

@fgiunchedi would it be ok for production to pin that particular package to testing/unstable, or do we need to have it ported over to stretch-backports?

Wed, Jan 17, 9:50 AM · Performance-Team, Thumbor
Gilles added a comment to T145497: thumbor/derpconf should default to loading *.conf from config directory.

It's on Buster now: https://packages.debian.org/source/derpconf

Wed, Jan 17, 8:55 AM · Performance-Team, Thumbor

Yesterday

Gilles moved T184510: Ideas for performance perception studies from Inbox to Backlog on the Performance-Team board.
Tue, Jan 16, 2:22 PM · Performance-Team
Gilles moved T179954: Thumbor errors should contain a trackable request id from Inbox to Backlog on the Performance-Team board.
Tue, Jan 16, 2:22 PM · Performance-Team, Thumbor
Gilles added a comment to T181315: load.php response taking 160s (of which only 0.031s in Apache).

It turns out to be quite common for load.php calls to take more than a minute: https://logstash.wikimedia.org/goto/788ca720a38ccbed8dab29adab7ac2ca

Tue, Jan 16, 8:54 AM · Patch-For-Review, Traffic, Operations, Performance-Team

Fri, Jan 12

Gilles updated the task description for T165272: Review research on performance perception.
Fri, Jan 12, 3:23 PM · Performance-Team
Gilles added a comment to T165272: Review research on performance perception.

"Narrowing the gap between QoS metrics and Web QoE using Above-the-fold metrics" Diego Neves da Hora, Alemnew Sheferaw Asrese, Vassilis Christophides, Renata Teixeira, Dario Rossi 2018

Fri, Jan 12, 3:22 PM · Performance-Team
Gilles updated the task description for T165272: Review research on performance perception.
Fri, Jan 12, 2:13 PM · Performance-Team
Gilles updated the task description for T184510: Ideas for performance perception studies.
Fri, Jan 12, 12:01 PM · Performance-Team
Gilles updated the task description for T165272: Review research on performance perception.
Fri, Jan 12, 11:56 AM · Performance-Team
Gilles added a comment to T165272: Review research on performance perception.

"Measuring the Quality of Experience of Web users" Bocchi, De Cicco, Rossi 2016

Fri, Jan 12, 11:56 AM · Performance-Team
Gilles updated the task description for T165272: Review research on performance perception.
Fri, Jan 12, 10:55 AM · Performance-Team
Gilles added a comment to T165272: Review research on performance perception.

"The Web, the Users, and the MOS: Influence of HTTP/2 on User Experience" Enrico Bocchi, Luca De Cicco, Marco Mellia, Dario Rossi, 2017

Fri, Jan 12, 10:52 AM · Performance-Team
Gilles removed a project from T145497: thumbor/derpconf should default to loading *.conf from config directory: Patch-For-Review.
Fri, Jan 12, 9:56 AM · Performance-Team, Thumbor
Gilles updated the task description for T165272: Review research on performance perception.
Fri, Jan 12, 9:22 AM · Performance-Team
Gilles added a comment to T165272: Review research on performance perception.

"The duration perception of loading applications in smartphone: Effects of different loading types" Wenguo Zhao, Yan Ge, Weina Qu, Kan Zhang, Xianghong Sun 2017

Fri, Jan 12, 9:21 AM · Performance-Team

Thu, Jan 11

Gilles updated the task description for T165272: Review research on performance perception.
Thu, Jan 11, 2:25 PM · Performance-Team
Gilles added a comment to T165272: Review research on performance perception.

"Defining Standards for Web Page Performance in Business Applications" Rempel 2015

Thu, Jan 11, 2:25 PM · Performance-Team
Gilles removed a project from T183907: Thumbor 500 while thumbnailing some webm files: Patch-For-Review.
Thu, Jan 11, 1:33 PM · Performance-Team, Thumbor
Gilles merged task T184711: Displaying thumbnail of svg file fails into T170628: Jessie rsvg/cairo can't render specific SVG file on Commons.
Thu, Jan 11, 1:08 PM · Thumbor, Commons, Multimedia
Gilles merged T184711: Displaying thumbnail of svg file fails into T170628: Jessie rsvg/cairo can't render specific SVG file on Commons.
Thu, Jan 11, 1:08 PM · Performance-Team (Radar), Operations, Thumbor, Commons, media-storage
Gilles added a comment to T184711: Displaying thumbnail of svg file fails.

The original doesn't seem to want to render either viewed straight in Chrome https://upload.wikimedia.org/wikipedia/commons/d/dd/Map_of_Texas_highlighting_Anderson_County.svg

Thu, Jan 11, 1:07 PM · Thumbor, Commons, Multimedia
Gilles added a comment to T172815: Improve stability and maintainability of our browser-based PDF render service.

This might be of interest: https://github.com/alvarcarto/url-to-pdf-api looks very similar, if not identical, to what you want to build. Could serve as inspiration at least.

Thu, Jan 11, 12:34 PM · Electron-PDFs, OfflineContentGenerator, Operations, Services (designing)
Gilles updated subscribers of T183310: Preview image for 3D file fails to load shortly after upload.

Files that can be expensive to thumbnail are nothing new, giant images and multipage documents also fall in that category. It's not uncommon in production for giant TIFFs to take 20 seconds to render.

Thu, Jan 11, 11:48 AM · Patch-For-Review, Multimedia-Team-Working-Board, Multimedia

Wed, Jan 10

Gilles updated the task description for T165272: Review research on performance perception.
Wed, Jan 10, 7:28 PM · Performance-Team

Tue, Jan 9

Gilles updated the task description for T181353: [EPIC] Migrate base image to Debian Stretch.
Tue, Jan 9, 7:09 PM · Patch-For-Review, Epic, MediaWiki-Vagrant
Gilles closed T183462: Fix Thumbor role for Stretch as Resolved.
Tue, Jan 9, 7:09 PM · Patch-For-Review, Thumbor, MediaWiki-Vagrant
Gilles closed T183462: Fix Thumbor role for Stretch, a subtask of T161707: Upgrade linux kernel used on Vagrant to 4+, as Resolved.
Tue, Jan 9, 7:09 PM · Patch-For-Review, Performance-Team, MediaWiki-Vagrant
Gilles closed T183462: Fix Thumbor role for Stretch, a subtask of T181353: [EPIC] Migrate base image to Debian Stretch, as Resolved.
Tue, Jan 9, 7:09 PM · Patch-For-Review, Epic, MediaWiki-Vagrant
Gilles closed T183384: Fix Poolcounter role for Stretch, a subtask of T181353: [EPIC] Migrate base image to Debian Stretch, as Resolved.
Tue, Jan 9, 6:52 PM · Patch-For-Review, Epic, MediaWiki-Vagrant
Gilles closed T183384: Fix Poolcounter role for Stretch as Resolved.
Tue, Jan 9, 6:52 PM · MediaWiki-Vagrant
Gilles closed T183384: Fix Poolcounter role for Stretch, a subtask of T183462: Fix Thumbor role for Stretch, as Resolved.
Tue, Jan 9, 6:52 PM · Patch-For-Review, Thumbor, MediaWiki-Vagrant
Gilles added a comment to T169144: Serve thumb.php requests with Thumbor.

This is now blocked on the Mediawiki core change to add the ability to proxy requests to Thumbor from thumb.php

Tue, Jan 9, 6:38 PM · Patch-For-Review, Performance-Team, Thumbor
Gilles added a comment to T183907: Thumbor 500 while thumbnailing some webm files.

Doesn't seem like it fixed the issue with the percentage character in production. Oh well, back to the drawing board...

Tue, Jan 9, 6:37 PM · Performance-Team, Thumbor
Gilles updated the task description for T165272: Review research on performance perception.
Tue, Jan 9, 2:03 PM · Performance-Team
Gilles added a comment to T165272: Review research on performance perception.

I'm going to leave the older papers aside for now and look for more relevant recent studies instead to complete the list. Dated technology, particularly for mobile, makes a lot of these older studies difficult to translate to current usage patterns.

Tue, Jan 9, 1:56 PM · Performance-Team
Gilles updated the task description for T165272: Review research on performance perception.
Tue, Jan 9, 1:45 PM · Performance-Team
Gilles added a comment to T165272: Review research on performance perception.

2005: “Interaction in 4-Second Bursts: The Fragmented Nature of Attentional Resources in Mobile HCI” Antti Oulasvirta, Sakari Tamminen, Virpi Roto, and Jaana Kuorelahti, Interruptions in Human Computer Interaction

Tue, Jan 9, 1:45 PM · Performance-Team
Gilles triaged T184510: Ideas for performance perception studies as Low priority.
Tue, Jan 9, 12:14 PM · Performance-Team
Gilles updated the task description for T165272: Review research on performance perception.
Tue, Jan 9, 12:01 PM · Performance-Team
Gilles added a comment to T165272: Review research on performance perception.

Kaaresoja T., Hoggan E., Anttila E. (2011) Playing with Tactile Feedback Latency in Touchscreen Interaction: Two Approaches. In: Campos P., Graham N., Jorge J., Nunes N., Palanque P., Winckler M. (eds) Human-Computer Interaction – INTERACT 2011. INTERACT 2011.

Tue, Jan 9, 12:00 PM · Performance-Team
Gilles updated the task description for T165272: Review research on performance perception.
Tue, Jan 9, 10:24 AM · Performance-Team
Gilles added a comment to T165272: Review research on performance perception.

"Characterizing Web Use on Smartphones”, Chad C. Tossell, Philip Kortum, Ahmad Rahmati, Clayton Shepard, Lin Zhong, Conference on Human Factors in Computing Systems 2012

Tue, Jan 9, 10:24 AM · Performance-Team
Liuxinyu970226 awarded T171093: Performance review of Editing features a Love token.
Tue, Jan 9, 4:07 AM · VisualEditor-Performance, Performance-Team, VisualEditor

Mon, Jan 8

Gilles moved T183907: Thumbor 500 while thumbnailing some webm files from Inbox to Doing on the Performance-Team board.
Mon, Jan 8, 9:14 PM · Performance-Team, Thumbor
Gilles committed rTHMBREXT82aafd757844: Version bump (authored by Gilles).
Version bump
Mon, Jan 8, 8:36 PM
Gilles added a commit to T183907: Thumbor 500 while thumbnailing some webm files: rTHMBREXT82aafd757844: Version bump.
Mon, Jan 8, 8:36 PM · Performance-Team, Thumbor
Gilles added a comment to T167400: Disable serving unpatrolled new files to Wikipedia Zero users.

As for thumbnails, it's not that it's hard to implement, but you'll create a lot of extra purge traffic and cache invalidation for a threat that is currently only theoretical. Consult the Traffic team about this, imho it's not a worthy tradeoff until the loophole is really exploited.

Mon, Jan 8, 8:30 PM · Reading-Infrastructure-Team-Backlog (Kanban), Patch-For-Review, User-Tgr, Operations, Traffic, media-storage, Commons, Multimedia, Zero
Gilles added a comment to T167400: Disable serving unpatrolled new files to Wikipedia Zero users.

Thumbor isn't involved with transcodes, only thumbnails. Taking care of transcode logic for this should all happen within Mediawiki, afaik.

Mon, Jan 8, 8:25 PM · Reading-Infrastructure-Team-Backlog (Kanban), Patch-For-Review, User-Tgr, Operations, Traffic, media-storage, Commons, Multimedia, Zero
Gilles committed rTHMBREXT8acacea9fd91: Content-Disposition filename should be URL-encoded (authored by Gilles).
Content-Disposition filename should be URL-encoded
Mon, Jan 8, 8:24 PM
Gilles added a commit to T183907: Thumbor 500 while thumbnailing some webm files: rTHMBREXT8acacea9fd91: Content-Disposition filename should be URL-encoded.
Mon, Jan 8, 8:24 PM · Performance-Team, Thumbor
Gilles closed D944: Content-Disposition filename should be URL-encoded.
Mon, Jan 8, 8:24 PM
Gilles added a comment to T145497: thumbor/derpconf should default to loading *.conf from config directory.

Change merged. Not sure this is worth bumping the upstream Debian package for.

Mon, Jan 8, 2:05 PM · Performance-Team, Thumbor
Gilles requested review of D944: Content-Disposition filename should be URL-encoded.
Mon, Jan 8, 1:59 PM
Gilles added a revision to T183907: Thumbor 500 while thumbnailing some webm files: D944: Content-Disposition filename should be URL-encoded.
Mon, Jan 8, 1:58 PM · Performance-Team, Thumbor
Gilles added a comment to T183907: Thumbor 500 while thumbnailing some webm files.

Found one that 500s a the moment:

Mon, Jan 8, 9:44 AM · Performance-Team, Thumbor
Gilles added a comment to T183907: Thumbor 500 while thumbnailing some webm files.

Actually, from your last comment, the 1st and 3rd one come out as 400s for me right now, and the 2nd one works. It's possible that the ones with % in them shouldn't be 400s, but I wonder why they showed up in the Varnish logs as 500s.

Mon, Jan 8, 9:37 AM · Performance-Team, Thumbor
Gilles changed the status of T183462: Fix Thumbor role for Stretch from Open to Stalled.
Mon, Jan 8, 9:34 AM · Patch-For-Review, Thumbor, MediaWiki-Vagrant
Gilles changed the status of T183462: Fix Thumbor role for Stretch, a subtask of T161707: Upgrade linux kernel used on Vagrant to 4+, from Open to Stalled.
Mon, Jan 8, 9:34 AM · Patch-For-Review, Performance-Team, MediaWiki-Vagrant
Gilles changed the status of T183384: Fix Poolcounter role for Stretch from Open to Stalled.
Mon, Jan 8, 9:34 AM · MediaWiki-Vagrant
Gilles changed the status of T183384: Fix Poolcounter role for Stretch, a subtask of T181353: [EPIC] Migrate base image to Debian Stretch, from Open to Stalled.
Mon, Jan 8, 9:34 AM · Patch-For-Review, Epic, MediaWiki-Vagrant
Gilles changed the status of T183384: Fix Poolcounter role for Stretch, a subtask of T183462: Fix Thumbor role for Stretch, from Open to Stalled.
Mon, Jan 8, 9:34 AM · Patch-For-Review, Thumbor, MediaWiki-Vagrant
Gilles closed T156826: Thumbor role breaks /etc/group as Resolved.

Fixed on the Stretch branch.

Mon, Jan 8, 9:28 AM · Performance-Team, MediaWiki-Vagrant
Gilles added a comment to T167400: Disable serving unpatrolled new files to Wikipedia Zero users.

Given that the vast majority of the abuse was with video files, transcode support seems like a must have. As it stands, the workaround is very easy for any original that gets blocked with this new feature: just watch a transcode listed on the file page.

Mon, Jan 8, 8:48 AM · Reading-Infrastructure-Team-Backlog (Kanban), Patch-For-Review, User-Tgr, Operations, Traffic, media-storage, Commons, Multimedia, Zero

Sat, Jan 6

Gilles committed rTHMBREXTfbecc06f279d: Version bump (authored by Gilles).
Version bump
Sat, Jan 6, 12:53 PM
Gilles added a commit to T169144: Serve thumb.php requests with Thumbor: rTHMBREXTfbecc06f279d: Version bump.
Sat, Jan 6, 12:53 PM · Patch-For-Review, Performance-Team, Thumbor
Gilles committed rTHMBREXT997c67d7fbf8: Support for private containers with secret key gate (authored by Gilles).
Support for private containers with secret key gate
Sat, Jan 6, 12:44 PM
Gilles added a commit to T169144: Serve thumb.php requests with Thumbor: rTHMBREXT997c67d7fbf8: Support for private containers with secret key gate.
Sat, Jan 6, 12:44 PM · Patch-For-Review, Performance-Team, Thumbor
Gilles closed D886: Support for private containers with secret key gate.
Sat, Jan 6, 12:44 PM

Thu, Jan 4

Gilles added a comment to T183907: Thumbor 500 while thumbnailing some webm files.

The percent character without being an encoded character code seems like the likely culprit for most of them.

Thu, Jan 4, 5:32 PM · Performance-Team, Thumbor

Wed, Jan 3

Gilles added a comment to T183907: Thumbor 500 while thumbnailing some webm files.

Most affected files have been fixed. The occurrences of that error dropped like a rock in logstash. There are a couple of hits still, but probably for other reasons (url encoding?):

Wed, Jan 3, 5:49 PM · Performance-Team, Thumbor
Gilles updated the task description for T165272: Review research on performance perception.
Wed, Jan 3, 4:17 PM · Performance-Team
Gilles updated the task description for T165272: Review research on performance perception.
Wed, Jan 3, 4:17 PM · Performance-Team
Gilles updated the task description for T165272: Review research on performance perception.
Wed, Jan 3, 2:53 PM · Performance-Team
Gilles updated the task description for T165272: Review research on performance perception.
Wed, Jan 3, 2:24 PM · Performance-Team
Gilles added a comment to T165272: Review research on performance perception.

Here's my review of "A Study on Tolerable Waiting Time: How long Are Web Users Willing to Wait?” (PDF), Fiona Fui-Hoon Nah, Behaviour and Information Technology, 2004, cited in the RAIL article.

Wed, Jan 3, 2:15 PM · Performance-Team
Gilles added a comment to T165272: Review research on performance perception.

Here's my review of "Response Times: The 3 Important Limits" by Jakob Nielsen, 1993, cited in the RAIL article.

Wed, Jan 3, 1:33 PM · Performance-Team
Gilles requested review of D886: Support for private containers with secret key gate.
Wed, Jan 3, 1:21 PM
Gilles added a project to T183907: Thumbor 500 while thumbnailing some webm files: Patch-For-Review.
Wed, Jan 3, 12:51 PM · Performance-Team, Thumbor
Gilles committed rTHMBREXTa08317bdae77: Version bump (authored by Gilles).
Version bump
Wed, Jan 3, 12:47 PM
Gilles added a commit to T183907: Thumbor 500 while thumbnailing some webm files: rTHMBREXTa08317bdae77: Version bump.
Wed, Jan 3, 12:47 PM · Performance-Team, Thumbor
Gilles committed rTHMBREXT237b786be137: Work around ffmpeg incorrect status code (authored by Gilles).
Work around ffmpeg incorrect status code
Wed, Jan 3, 12:44 PM
Gilles added a commit to T183907: Thumbor 500 while thumbnailing some webm files: rTHMBREXT237b786be137: Work around ffmpeg incorrect status code.
Wed, Jan 3, 12:43 PM · Performance-Team, Thumbor
Gilles closed D940: Work around ffmpeg incorrect status code.
Wed, Jan 3, 12:43 PM
Gilles requested review of D940: Work around ffmpeg incorrect status code.
Wed, Jan 3, 12:32 PM
Gilles added a comment to T183907: Thumbor 500 while thumbnailing some webm files.

This currently fixes some of the files showing up in logstash, but not all.

Wed, Jan 3, 12:14 PM · Performance-Team, Thumbor
Gilles added a revision to T183907: Thumbor 500 while thumbnailing some webm files: D940: Work around ffmpeg incorrect status code.
Wed, Jan 3, 12:00 PM · Performance-Team, Thumbor

Tue, Jan 2

Gilles triaged T183907: Thumbor 500 while thumbnailing some webm files as Normal priority.
Tue, Jan 2, 2:51 PM · Performance-Team, Thumbor
Gilles added a comment to T183907: Thumbor 500 while thumbnailing some webm files.

Testing this on thumbor1001, seeking for the midpoint with ffmpeg fails silently. The status code is 0, but no screenshot is generated. If the fallback of seeking to 0 kicked in, it would work.

Tue, Jan 2, 2:50 PM · Performance-Team, Thumbor
Gilles added a comment to T183907: Thumbor 500 while thumbnailing some webm files.

Cape_Town_under_the_clouds.webm is playable, but for me it skips straight to 11:12 when I open it in Chrome. Which probably suggests something unusual about the file or its keyframes. On VLC it plays for 33 seconds, instead of the announced 11 minutes duration. Which is consistent with the approximate amount of time it plays in Chrome. This file looks corrupt.

Tue, Jan 2, 2:40 PM · Performance-Team, Thumbor
Gilles added a comment to T165272: Review research on performance perception.

Here's my review of Response Time in Man-Computer Conversational Transactions" by Robert B; Miller, Fall Joint Computer Conference 1968, the first paper cited in the RAIL article.

Tue, Jan 2, 2:10 PM · Performance-Team
Gilles claimed T183907: Thumbor 500 while thumbnailing some webm files.
Tue, Jan 2, 11:04 AM · Performance-Team, Thumbor
Gilles added a comment to T183889: 2017-12-30 save timing regression.

Looking at the new breakdown dashboard: https://grafana.wikimedia.org/dashboard/db/backend-save-timing-breakdown?refresh=5m&orgId=1

Tue, Jan 2, 8:40 AM · Wikimedia-General-or-Unknown, Regression, Performance-Team
Gilles created T183889: 2017-12-30 save timing regression.
Tue, Jan 2, 8:36 AM · Wikimedia-General-or-Unknown, Regression, Performance-Team
Gilles added a comment to T180667: Collect RUMSpeedIndex from users.

I think it could be useful as-is, with the understanding that it only works well on a specific set of browsers, because it extracts a potentially useful metric from a large set of very fine-grained metrics we don't collect currently and probably never will (precisely because it's too fine-grained).

Tue, Jan 2, 8:22 AM · Patch-For-Review, Performance-Team

Sat, Dec 23

mmodell awarded Blog Post: The journey to Thumbor, part 3: development and deployment strategy a Barnstar token.
Sat, Dec 23, 2:13 AM · Thumbor, Performance-Team

Thu, Dec 21

Gilles added a comment to T181353: [EPIC] Migrate base image to Debian Stretch.

Out of curiosity, do all roles provision correctly on master? (Jessie)

Thu, Dec 21, 3:00 PM · Patch-For-Review, Epic, MediaWiki-Vagrant
Gilles added a subtask for T161707: Upgrade linux kernel used on Vagrant to 4+: T183462: Fix Thumbor role for Stretch.
Thu, Dec 21, 12:33 PM · Patch-For-Review, Performance-Team, MediaWiki-Vagrant
Gilles added a parent task for T183462: Fix Thumbor role for Stretch: T161707: Upgrade linux kernel used on Vagrant to 4+.
Thu, Dec 21, 12:33 PM · Patch-For-Review, Thumbor, MediaWiki-Vagrant
Gilles added a parent task for T183384: Fix Poolcounter role for Stretch: T183462: Fix Thumbor role for Stretch.
Thu, Dec 21, 12:32 PM · MediaWiki-Vagrant