Wed, Nov 14
Note that this is dependent on suitable playback support being widespread. While on desktops, Chrome and Firefox are shipping AV1 now or in next versions, and Microsoft is previewing it for Edge, we don't yet know the situation for Safari. I've started adding AV1 decode to ogv.js, but it's slower than decoding VP9 so far so may require running lower resolutions (unless WebAssembly threading arrives soon on Safari).
Ingest should be a matter of having a suitable ffmpeg & libaom package backport, and a small update to make sure we're allowing AV1 codec in WebM container. Note there will also be MP4-flavored AV1 out in the world, but we don't yet know how popular that will be as flat files (versus DASH/HLS/streaming).
Sun, Nov 11
Thu, Nov 8
Storage note: may need/want to include a reverse-domain copy of the domain for indexing purposes for bulk lookups.
(my concern being the possibility of getting people to agree to click-through things they shouldn't; attacker script wouldn't be able to auth/confirm the form, in theory)
Wed, Nov 7
Version bumped, and README includes a little info on the changes to config.
Yep, our bad -- we didn't document the breaking changes to config. :( Try this:
Mon, Nov 5
Tue, Oct 30
Thu, Oct 25
Oct 9 2018
I didn't manage to do an early push because I was out sick most of last week, but it should be live now, and the re-rendered file works for me so hoping it's fine for @jeblad. :)
Oct 1 2018
I'll try to sneak it into a 'swat deploy' window later this week.
Aha found it -- the file is 4:2:2 chroma subsampling (profile 1) which Chrome probably doesn't support.
I did some more poking at this, and I'm not quite sure what's going on but I don't think it's because of the pause/play stuff.
This merged some time ago. Closing out.
Looks like a bug with the old mwembed player assuming it can autoplay and interacting badly with current browsers...
Sep 18 2018
@Esanders worst case, currently should be possible to override the ThreeDHandler's doTransform method to return a custom ThumbnailImage subclass, which can add a class by sniping into the toHtml() method and appending to the img-class entry in options.
Not a blocker, but it'd be nice to treat various media types consistently in that respect. Ought to be able to add a custom class on the <img> in some reasonable way already, though...
Sep 14 2018
Sep 10 2018
Note that this should be made possible for both regular File: page view and the iframe-embedded view.
Sep 8 2018
Feedback question -- is the method name mapping from 'somethingWorker' to 'something' too clever? Should it just let you pass any method name to $controller->queue()?
(Still have to see if the exec mode can be got working, do a little debugging, and add a hook for closing extensions.)
Updated summary with the reworked API for ParallelMaintenance.
Sep 7 2018
using regular execute() method, with a helper fork() method (bikeshed that name!) that creates the controller, a dispatch callback, and the work/result callbacks
I'm retooling the proposal based on feedback. Key things:
Sep 5 2018
Note via Timo -- currently we run maint scripts in production through hhvm, which sets processor affinity on all child processes. :P
Hadn't thought of trying h.263; testing... I've put up some samples at https://brionv.com/misc/pumpjack/
Aug 31 2018
Seems to be a change in how plugins are loaded in 2.1.3/2.1.4. Yay semver!
Aug 27 2018
Taking a quick peek at this per an inquiry from @saper. Specifically looking at the login page...
Aug 21 2018
Aug 20 2018
I'm pretty happy with the current documentation now; last time I needed to use it I found what I needed. :) Closing.
Adding to techcom-rfc board to make sure we don't forget to discuss this, if cross-cutting issues are forseen.
Existing files should be either deleted or re-encoded.
Fix has been deployed; no more MP4 files should be coming in.
AAAAAGGGGHHHH the VM has the clock wrong and thinks the cert is not yet valid. Nevermind.
(I think that missing file is ok cause the dir is full of other files...?)
The /usr/lib/ssl/cert.pem file specified in config seems to be missing?
PHP 5 is obsolete; use PHP 7.
Aug 19 2018
Yep, that's a regression in the extension.json migration. The addition of file types to $wgFileExtensions was being done twice, both in the extension.json and then again dynamically, causing the way that 'mp4' was removed from the list to fail because it only removed one instance of it.
Aug 14 2018
Aug 13 2018
As for role ids -- perhaps we should primarily use the names, not the numbers, in the <role> bit. It's analogous to a page's <title> reference (a primary identifier) not to its <ns> or <id> (which are provided informatively if you want to repro the database exactly, but can be freely discarded when doing imports and such).
Ok, proposed transitional schema looks like it imports cleanly via importDump (which uses same code path as Special:Import). The proposed final schema, however, imports a revision with empty text (and throws a notice on Undefined index: text in /vagrant/mediawiki/includes/import/WikiImporter.php on line 886).
My concern with the two-step transition idea is that some consumers may not update on a reliable schedule, or may not be able to do so easily. For instance, if people are using Special:Export on one wiki and Special:Import'ing those pages on another that's *not* a Wikimedia-hosted site, it's more likely to be an older version of MediaWiki.
Aug 8 2018
Aug 7 2018
I remuxed the file with ffmpeg, and reuploaded the new file and it's happier. Looks like the cues didn't get written properly by the original conversion program.
EBML parser thinks the file is incomplete; got cropped shortly before 128MB
file is File:GreenlandReel_Icebergs_2160APR.webm
Aug 6 2018
Hmm, that load factor moved. I have no idea what to change now. :D
Aug 4 2018
Yep, same cropping with the new VP9 transcodes (ffmpeg 3.2 I think)
Aug 3 2018
ffmpeg's behavior seems to have updated a bit; it's not perfect but may be "good enough".
Note this appears to predate the current VP9 stuff, and appears on some VP8 transcodes too.
Seems like if it's doing this regularly to our pages, that it's a browser compatibility issue that we'd want to address in some way?
Aug 2 2018
Aug 1 2018
Another intermittent error I see is "invalid frame size: 0x0" T200939. Doesn't seem VP9-specific but I hadn't noticed it until recently.
(Restarted the batch job a while ago.)
(Re-running the errored ones...)
Per joe in irc this is probably from hhvm config restarts, in which case just re-queuing the failed ones should patch em up. Just need to expect more will come and run follow-ups. (Todo: improve retry logic!)
Errors continuing. Stopping the batch job.
Encountered a spike in errors, details at T200873. Stopping the batch job for now.
Can confirm they were all around the same time:
Unfortunately the error logs in transcode table don't include the hostname yet.
This has been resolved (caused by T200813, worked around). Batch is running. Load is moderate on servers, we might be able to tune them to run more runners.