Tue, Jul 31
They need access to Eventlogging data, preferably on Hadoop/Spark
Jun 27 2018
Jun 26 2018
The hack described by Steve Souders is actually detrimental to performance, which defeats the purpose of measuring anything with it. We'll just have to wait until there's a proper API available to measure time-to-text.
A preview of what's to come, once the Varnish change gets merged. Thumbnail from the current enwiki front page:
Fixed. Affected files can simply be purge to get correct thumbnail dimensions. I've already purged the 2 you mentioned in the task description.
Jun 25 2018
Stuck in review since March
Stuck in review since May
Stuck in review since April/May
No activity on the patch since June 2
Done, there's an ongoing project already in the works by Google that's more likely to be implemented in Chrome, as it reduces the overhead by using attributes instead.
Seems like https://linux.goeszen.com/how-to-take-screen-caps-from-do-thumbnails-of-anamorphic-video-in-correct-display-aspect-ratio.html has the answer, adding
It's extracting a frame with ffmpeg, ideally that can somehow be made correct, without having to parse WebM-specific display_aspect_ratio, crop_* etc?
I don't believe that GIF is capable of supporting that kind of metadata. The EXIF filtering capabilities only apply to JPG at the moment. Behavior described here https://wikitech.wikimedia.org/wiki/Thumbor/JPEG
Jun 22 2018
@stjn indeed that's a pretty logical thing to look at. We don't record transferSize at the moment, I'll add it to the list of things to record alongside the survey responses.
Manually filtering out seasonal articles, these are the most frequent articles in survey responses, that might be worth oversampling. They have between 2500 and 12000 daily pageviews on average:
Indeed, with this week's deployment freeze those wikis are still on wmf.8
I don't see the new EventLogging table yet, I presume this hasn't hit the wikis where the survey is running yet.
Nevermind, that's already the case for this one. Just let me check that the data is correctly recorded.
I also need to write the part that will collect it and send it via EventLogging
Jun 21 2018
Jun 19 2018
It's actually already recorded in the recvfrom field of the vent capsule, it's just exposed only in hive and not in the mysql version.
Jun 18 2018
Jun 15 2018
Jun 13 2018
Actually the latest version of their API uses attributes to enable the feature. I asked about the overhead involved, since we'd have to add the attribute for all pageviews, Tim Dresser (Google)'s response:
Jun 12 2018
The latest iteration of their hero text proposal focuses on a JS observer, which in our case would have to be in the head. This is workable and would allow us to control the sampling in JS.
Hah, of course there are things like this that have been proposed before, which I didn't find when I searched through their stuff:
...and what do humans think? :)
Should appear here https://lists.w3.org/Archives/Public/public-web-perf/2018Jun/ once my message got past their moderation queue.