brion (Brion Vibber)
User

Projects (21)

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Friday

  • Clear sailing ahead.
User Since
Oct 15 2014, 8:30 PM (122 w, 6 d)
Availability
Available
IRC Nick
brion
LDAP User
Brion VIBBER
MediaWiki User
Unknown

Recent Activity

Yesterday

brion created T158716: Split CPU cost of transcoding large video files more evenly (chunked video transcoding).
Tue, Feb 21, 11:36 PM · TimedMediaHandler-Transcode
brion created T158617: npm install fails for changeprop service in MW-Vagrant jessie-migration.
Tue, Feb 21, 4:33 AM · MediaWiki-Vagrant
brion closed T158615: Job runner service doesn't appear to work in jessie-migration as "Resolved".

Now working with the patch merged.

Tue, Feb 21, 3:52 AM · Patch-For-Review, MediaWiki-Vagrant
brion closed T158615: Job runner service doesn't appear to work in jessie-migration, a subtask of T136429: [EPIC] Migrate base image to Debian Jessie, as "Resolved".
Tue, Feb 21, 3:52 AM · Operations, Release-Engineering-Team, Epic, MediaWiki-Vagrant
brion added a comment to T158615: Job runner service doesn't appear to work in jessie-migration.

Note there is no logs/mediawiki-runJobs.log file, and I cannot connect to port 80 on 127.0.0.1 from within the VM (testing curl http://127.0.0.1/w/RunJobs.php).

Tue, Feb 21, 2:03 AM · Patch-For-Review, MediaWiki-Vagrant
brion created T158615: Job runner service doesn't appear to work in jessie-migration.
Tue, Feb 21, 1:58 AM · Patch-For-Review, MediaWiki-Vagrant
brion created T158611: Vagrant role for TimedMediaHandler doesn't run composer after git clone.
Tue, Feb 21, 1:12 AM · Patch-For-Review, Easy, MediaWiki-Vagrant
brion closed T158608: Vagrant 1.8.7 fails to fetch Jessie image with vague error message as "Invalid".

Running with --debug seems to indicate that Vagrant's downloader is failing to load curl or some such junk:

Tue, Feb 21, 12:51 AM · Operations, Release-Engineering-Team, Epic, MediaWiki-Vagrant
brion closed T158608: Vagrant 1.8.7 fails to fetch Jessie image with vague error message, a subtask of T136429: [EPIC] Migrate base image to Debian Jessie, as "Invalid".
Tue, Feb 21, 12:51 AM · Operations, Release-Engineering-Team, Epic, MediaWiki-Vagrant
brion created T158608: Vagrant 1.8.7 fails to fetch Jessie image with vague error message.
Tue, Feb 21, 12:09 AM · Operations, Release-Engineering-Team, Epic, MediaWiki-Vagrant

Mon, Feb 20

brion added a comment to T158300: Embedded ogv files doesn't play in Phabricator on mobile.

Workaround: should work to download the file and play it in VLC for Android. Awkward, but that's file formats for ya. :)

Mon, Feb 20, 9:14 PM · Mobile, Phabricator
brion added a comment to T158300: Embedded ogv files doesn't play in Phabricator on mobile.

Chrome for Android doesn't support Ogg Theora video natively: http://caniuse.com/#search=ogv

Mon, Feb 20, 7:22 PM · Mobile, Phabricator
brion added a subtask for T152013: RenameLink gadget on Commons causes the page tabs to jump around after it loads: T158597: Provide server-side registration for Gadgets to add tabs to skin output without flash of content.
Mon, Feb 20, 7:07 PM · Multimedia, MediaWiki-General-or-Unknown, Commons
brion added a parent task for T158597: Provide server-side registration for Gadgets to add tabs to skin output without flash of content: T152013: RenameLink gadget on Commons causes the page tabs to jump around after it loads.
Mon, Feb 20, 7:07 PM · Gadgets
brion created T158597: Provide server-side registration for Gadgets to add tabs to skin output without flash of content.
Mon, Feb 20, 6:55 PM · Gadgets

Sat, Feb 18

SamanthaNguyen awarded T158181: Aim for 1:1 feature equivalence for MediaWiki on desktop and mobile web a Love token.
Sat, Feb 18, 4:46 AM · Reading-Web-Backlog, Epic, MobileFrontend, MediaWiki-General-or-Unknown, Technical-Debt

Fri, Feb 17

brion added a comment to T157319: Implement replacement for Firefogg (on-the-fly video transcoding).

The chief problem with ffmpeg.js is that it has the h.264 and AAC decoders built in and shipped to the client -- like in firefogg's embedded copy of ffmpeg -- making it a legal minefield.

Fri, Feb 17, 11:50 PM · Wikimedia-Video, UploadWizard, Multimedia

Thu, Feb 16

brion created T158287: Add option to requeueTranscodes.php to restrict processing to high or low priority queue.
Thu, Feb 16, 9:12 AM · TimedMediaHandler-Transcode

Wed, Feb 15

brion added a comment to T153864: Disable possibility to create extensionless File namespace pages.

cf T6421, T25255

Wed, Feb 15, 7:47 PM · Patch-For-Review, Multimedia, MediaWiki-General-or-Unknown, Commons, MediaWiki-File-management
brion created T158232: Video transcode error details link/popup no longer shown on File: pages.
Wed, Feb 15, 7:41 PM · TimedMediaHandler-Transcode
brion added a comment to T108234: Run a bot to add 240p webm/ogv, re-run 360p/480p ogv video transcodes.

Queue runner count has now been pushed up, so we should get through the rest of the files faster. Might still bump it slightly farther up, I'm seeing usage around 80%, though we're trying to avoid overcommitting CPU either.

Wed, Feb 15, 7:33 PM · Patch-For-Review, Wikimedia-Video
brion added a comment to T127268: Dismantle ResourceLoader's "targets" system.

I've also opened a more general tech-debt task T158181 to collect subtasks where we have different or limited functionality between mobile and desktop web. We may not reach 1:1 parity but I'd love to try. :)

Wed, Feb 15, 4:49 PM · Developer-Wishlist (2017), Technical-Debt (RW-Tech-Debt), Front-end-Standards-Group, Reading-Web-Backlog, MediaWiki-ResourceLoader
brion edited the description of T158181: Aim for 1:1 feature equivalence for MediaWiki on desktop and mobile web.
Wed, Feb 15, 4:47 PM · Reading-Web-Backlog, Epic, MobileFrontend, MediaWiki-General-or-Unknown, Technical-Debt
brion added a comment to T127268: Dismantle ResourceLoader's "targets" system.

@Jdlrobson agreed, I apologize for my hasty snarky comment earlier. :)

Wed, Feb 15, 4:43 PM · Developer-Wishlist (2017), Technical-Debt (RW-Tech-Debt), Front-end-Standards-Group, Reading-Web-Backlog, MediaWiki-ResourceLoader
brion added a comment to T153864: Disable possibility to create extensionless File namespace pages.

There was talk in the past about decoupling raw filenames from titles in the file: namespace so that extensions aren't exposed on new uploads, titles can contain funky chars, and file types can be upgraded without breaking usage.

Wed, Feb 15, 4:19 PM · Patch-For-Review, Multimedia, MediaWiki-General-or-Unknown, Commons, MediaWiki-File-management
brion renamed T158177: Phabricator "reconcile timezone" dialog options are confusing from "Phabricator won't stop bugging me about my timezone setting not matching local time when traveling" to "Phabricator "reconcile timezone" dialog options are confusing".
Wed, Feb 15, 2:09 PM · Phabricator (Upstream), Upstream
brion added a comment to T158177: Phabricator "reconcile timezone" dialog options are confusing.

Aha, that's a rather confusing UI to me; I would expect to have a separate button or link that says "ignore conflict" rather than hiding it in a drop-down list of timezones I must search through and then having to click something that says "Change Timezone" when I want to *not* change timezone. :)

Wed, Feb 15, 1:54 PM · Phabricator (Upstream), Upstream
brion added subtasks for T158181: Aim for 1:1 feature equivalence for MediaWiki on desktop and mobile web: T61207: Thanks given via mobile are not shown on desktop history page, T98491: TimedMediaHandler user experience is poor on mobile, T65504: Consolidate code for MediaViewer across desktop and mobile (tracking), T58817: Watchlist features available on desktop that aren't on mobile yet (tracking), T127268: Dismantle ResourceLoader's "targets" system, T67078: Allow feedback for mobile beta features like Desktop, T99003: (3) Fix up Special:Upload in mobile and desktop Minerva, T67983: toaster overlay for watchlisting is inconsistent between mobile and desktop, T89219: "Last modified..." text differs between desktop and mobile, T69799: Mobile watchlist should follow the same Show/Hide preferences as the desktop watchlist, T148047: Desktop MediaWiki should be able to lazy load images, T113844: Make the mobile edit conflict screen nicer to use, T144571: Mobile Media Viewer violates user settings, T124168: Show Navboxes in mobile view, T123694: Allow mobile web edits to be marked as minor, T133085: Graphs are not mobile friendly, T120755: Mobile-friendly framework for multi-column portal and project pages, T72787: Tooltip notifications not implemented with mobile in mind, T122305: Make Special:Contributions in core mobile friendly, T148049: Make APISandbox useable on mobile, T49858: Enable jquery.tablesorter on mobile, T144299: Dashboards working on mobile , T62565: TMH totally broken on mobile, T152841: Nowrap template not working on mobile site, T95878: [Story] Make Wikidata editable on mobile web, T94998: Make Share-a-fact available on desktop, T72142: Make minerva a presentable desktop skin (tracking), T145409: Have recently viewed articles section on desktop mediawiki and ideally sync with mobile app, T149487: MobileFrontend talk overlay URL's are being shared and do not resolve on desktop site.
Wed, Feb 15, 1:45 PM · Reading-Web-Backlog, Epic, MobileFrontend, MediaWiki-General-or-Unknown, Technical-Debt
brion added a parent task for T49858: Enable jquery.tablesorter on mobile: T158181: Aim for 1:1 feature equivalence for MediaWiki on desktop and mobile web.
Wed, Feb 15, 1:45 PM · JavaScript, MediaWiki-jQuery-Tablesorter, MobileFrontend-Feature-requests
brion added projects to T158181: Aim for 1:1 feature equivalence for MediaWiki on desktop and mobile web: MediaWiki-General-or-Unknown, MobileFrontend.
Wed, Feb 15, 1:34 PM · Reading-Web-Backlog, Epic, MobileFrontend, MediaWiki-General-or-Unknown, Technical-Debt
brion created T158181: Aim for 1:1 feature equivalence for MediaWiki on desktop and mobile web.
Wed, Feb 15, 1:33 PM · Reading-Web-Backlog, Epic, MobileFrontend, MediaWiki-General-or-Unknown, Technical-Debt
brion added a comment to T127268: Dismantle ResourceLoader's "targets" system.

Anyway, main thing to consider is that the targets system was meant to be temporary, as I recall, during the period when we had massive amounts of stuff that wasn't tested on mobile. If people still aren't testing things on mobile, then we got a problem that needs fixing before we remove it entirely. :)

Wed, Feb 15, 1:04 PM · Developer-Wishlist (2017), Technical-Debt (RW-Tech-Debt), Front-end-Standards-Group, Reading-Web-Backlog, MediaWiki-ResourceLoader
brion created T158177: Phabricator "reconcile timezone" dialog options are confusing.
Wed, Feb 15, 1:02 PM · Phabricator (Upstream), Upstream
brion added a comment to T127268: Dismantle ResourceLoader's "targets" system.

(Or I suppose you can keep two skins and force everyone to ACTUALLY test everything on both.)

Wed, Feb 15, 12:55 PM · Developer-Wishlist (2017), Technical-Debt (RW-Tech-Debt), Front-end-Standards-Group, Reading-Web-Backlog, MediaWiki-ResourceLoader
brion added a comment to T127268: Dismantle ResourceLoader's "targets" system.

So the correct fix for this is to remove the "mobile site" mode and extra skin and have a single, responsive output mode and skin, with all modules working on that skin on both large and small screens. This is a fairly big task.

Wed, Feb 15, 12:50 PM · Developer-Wishlist (2017), Technical-Debt (RW-Tech-Debt), Front-end-Standards-Group, Reading-Web-Backlog, MediaWiki-ResourceLoader
brion added a comment to T64270: Support video and audio content.

I'm mostly free next week (other than the archcom meetings Wednesday), happy to start getting this issue back in gear. :)

Wed, Feb 15, 12:37 AM · Patch-For-Review, Parsoid

Tue, Feb 14

brion created T158137: Renaming audio/video files leaves orphaned transcode table entries that clog reports.
Tue, Feb 14, 11:36 PM · Wikimedia-Video, TimedMediaHandler-Transcode
brion added a comment to T108234: Run a bot to add 240p webm/ogv, re-run 360p/480p ogv video transcodes.

The 160p/240p.ogv 'missing' jobs are getting closer to done; going ahead and adding the 360p/480p.ogv 'all' jobs back in to the mix.

Tue, Feb 14, 10:09 PM · Patch-For-Review, Wikimedia-Video
brion added a comment to T149806: [A/B/C Test] Add cross-wiki search results in a right sidebar.

The three surfaced images appear to be shown backwards from the top 3 results, resulting in the 3rd result being shown largest and the top result being shown smallest:

Tue, Feb 14, 9:39 PM · WMF-deploy-2017-02-14_(1.29.0-wmf.12), MW-1.29-release-notes, WMF-deploy-2017-02-07_(1.29.0-wmf.11), WMF-deploy-2017-01-31_(1.29.0-wmf.10), Patch-For-Review, Discovery-Search (Current work), CirrusSearch, Discovery
brion added a comment to T149806: [A/B/C Test] Add cross-wiki search results in a right sidebar.

Looks nice so far! However the multimedia results seem to be frequently irrelevant, perhaps a result of searching based primarily on title... Titles of images are often not descriptive, are in other languages, or contain irrelevant details that are sorted/scored higher than relevant images that appear in articles.

Tue, Feb 14, 9:25 PM · WMF-deploy-2017-02-14_(1.29.0-wmf.12), MW-1.29-release-notes, WMF-deploy-2017-02-07_(1.29.0-wmf.11), WMF-deploy-2017-01-31_(1.29.0-wmf.10), Patch-For-Review, Discovery-Search (Current work), CirrusSearch, Discovery
brion created T158057: Replace ?embedplayer=yes with /embed/File:Foo URL prefix.
Tue, Feb 14, 2:13 PM · Wikimedia-Video, TimedMediaHandler-Player
brion added a comment to T89552: Implement International Image Interoperability Framework (IIIF) prototype service on Wikimedia labs.

If we can get the IIIF endpoint up and running again (or/and create an IIIF image-serving functionality more centrally to the main MediaWiki code), something that might be good would be the possibility for a user to download an IIIF manifest pretty much whenever the MediaViewer is used (maybe even specify the carousel of images for MediaViewer together with its metadata as an IIIF manifest).

An IIIF manifest is (as I understand it) the key document that presents a bundle of images, and how they should be presented together. It's also the key thing that IIIF editor programs eat -- given various IIIF manifests as input, the IIIF editor allows the user to create a new document combining different aspects of them, which is then passed around as a new manifest. So it makes our images more usable if we can (i) serve them as an IIIF services, but (ii) also serve information about them as an IIIF manifest, that can then be passed around and reused.

Tue, Feb 14, 11:08 AM · Possible-Tech-Projects, Wikimedia-General-or-Unknown, Multimedia

Mon, Feb 13

brion added a comment to T89552: Implement International Image Interoperability Framework (IIIF) prototype service on Wikimedia labs.

@Jdforrester-WMF do you know who we should ping re: the structured data project plans and if we can/should get someone to the IIIF conference in June that Liam mentioned above? I'm in on the IIIF's A/V API working group but may not be the best point person for other data-sharing kinds of things: there's kind of middling support for structured metadata in the protocols so far (just a few vaguely-specified fields for attribution, licensing etc) which might want to be expanded, and that'd be something I'd rather leave to folks planning to work in the thick of the metadata. :)

Mon, Feb 13, 4:01 PM · Possible-Tech-Projects, Wikimedia-General-or-Unknown, Multimedia

Sat, Feb 11

brion added a comment to T108234: Run a bot to add 240p webm/ogv, re-run 360p/480p ogv video transcodes.

Stopping the 360p/480p ogv jobs for now, need to bump up the queue runners (per above patch) to actually use the extra CPU. :)

Sat, Feb 11, 7:34 PM · Patch-For-Review, Wikimedia-Video
brion added a comment to T108234: Run a bot to add 240p webm/ogv, re-run 360p/480p ogv video transcodes.

There's some spare CPU still, so adding in the 360p.ogv and 480p.ogv re-run jobs, seeing how it goes... (still throttled; currently the high-prio queue is about 5 deep and the low-prio queue is at ~9000, down from ~9800 yesterday)

Sat, Feb 11, 7:13 PM · Patch-For-Review, Wikimedia-Video

Fri, Feb 10

brion added a comment to T108234: Run a bot to add 240p webm/ogv, re-run 360p/480p ogv video transcodes.

Currently running throttled version of requeueTranscodes.php to fill in missing 160p.ogv, 160p.webm, 240p.ogv, and 240p.webm transcodes.

Fri, Feb 10, 6:34 PM · Patch-For-Review, Wikimedia-Video
brion added a comment to T108234: Run a bot to add 240p webm/ogv, re-run 360p/480p ogv video transcodes.

Note per IRC conversation -- will also need to do a generic cleanup pass on non-Commons wikis that have local audio or video uploads. This shouldn't eat too much human time, just needs to be set up and looped.

Fri, Feb 10, 1:42 AM · Patch-For-Review, Wikimedia-Video
brion added a comment to T108234: Run a bot to add 240p webm/ogv, re-run 360p/480p ogv video transcodes.

I think I'm going to wait on the rest until I've put an automatic throttle in place... too easy to flood the high-prio queue with requeueTranscodes.php otherwise.

Fri, Feb 10, 12:59 AM · Patch-For-Review, Wikimedia-Video
brion added a comment to T108234: Run a bot to add 240p webm/ogv, re-run 360p/480p ogv video transcodes.

I added a bunch of 160p.ogv transcodes and am waiting to see how long it takes for them to run through. :)

Fri, Feb 10, 12:38 AM · Patch-For-Review, Wikimedia-Video
brion added a comment to T108234: Run a bot to add 240p webm/ogv, re-run 360p/480p ogv video transcodes.

Currently running:

  • ogg audio (missing)
Fri, Feb 10, 12:19 AM · Patch-For-Review, Wikimedia-Video

Thu, Feb 9

brion added a comment to T108234: Run a bot to add 240p webm/ogv, re-run 360p/480p ogv video transcodes.

Ok I'm near ready to run this, am testing with audio transcodes before I do anything rash. :)

Thu, Feb 9, 10:08 PM · Patch-For-Review, Wikimedia-Video
brion closed T110916: Video transcode job runner on beta cluster runs 5 jobs even though configured for 2 as "Resolved".

I'm pretty sure we resolved this on the ops/hhvm end. Closing out.

Thu, Feb 9, 8:10 PM · TimedMediaHandler-Transcode, MediaWiki-Vagrant, MediaWiki-JobRunner, Beta-Cluster-Infrastructure
brion added a comment to T157527: Flac and wav files do not show play options in Commons.

This is a side effect of the audio clip not being transcoded yet (This is currently taking several days due to a whole lot of files currently being in the transcode queue).

Thu, Feb 9, 8:09 PM · Multimedia, TimedMediaHandler-Player, Commons
brion closed T155098: Rework job queue usage for TimedMediaHandler (video scalers) as "Resolved".

MW changes are live. Existing files will continue to process on the low-prio queue. I'll watch the server load for the next couple days and see if we need to change the queue runner balance between the two.

Thu, Feb 9, 8:07 PM · WMF-deploy-2017-02-07_(1.29.0-wmf.11), WMF-deploy-2017-02-14_(1.29.0-wmf.12), Patch-For-Review, TimedMediaHandler-Transcode
brion closed T155098: Rework job queue usage for TimedMediaHandler (video scalers), a subtask of T110916: Video transcode job runner on beta cluster runs 5 jobs even though configured for 2, as "Resolved".
Thu, Feb 9, 8:06 PM · TimedMediaHandler-Transcode, MediaWiki-Vagrant, MediaWiki-JobRunner, Beta-Cluster-Infrastructure
brion closed T157621: Special:TimedMediaHandler does not exist and won't even load a webpage as "Resolved".

Seems happier now; quick fix deployed.

Thu, Feb 9, 7:38 PM · WMF-deploy-2017-02-07_(1.29.0-wmf.11), WMF-deploy-2017-02-14_(1.29.0-wmf.12), Patch-For-Review, Wikimedia-log-errors, TimedMediaHandler, Commons
brion closed T157621: Special:TimedMediaHandler does not exist and won't even load a webpage, a subtask of T155526: MW-1.29.0-wmf.11 deployment blockers, as "Resolved".
Thu, Feb 9, 7:37 PM · Release, Release-Engineering-Team (Deployment-Blockers)
brion added a comment to T155098: Rework job queue usage for TimedMediaHandler (video scalers).

Ok, the puppet changes went out at this morning's puppet swat, mediawiki side is ready to go for the 11am pacific mediawiki swat.

Thu, Feb 9, 5:41 PM · WMF-deploy-2017-02-07_(1.29.0-wmf.11), WMF-deploy-2017-02-14_(1.29.0-wmf.12), Patch-For-Review, TimedMediaHandler-Transcode

Wed, Feb 8

brion added a comment to T157621: Special:TimedMediaHandler does not exist and won't even load a webpage.

It's only loading details for 50 items -- I think the problem is that it's also loading the error output (and then not using it) and some of those are MONSTROUSLY huge, adding up to eating 500 mb of process ram just for the errors:

Wed, Feb 8, 11:17 PM · WMF-deploy-2017-02-07_(1.29.0-wmf.11), WMF-deploy-2017-02-14_(1.29.0-wmf.12), Patch-For-Review, Wikimedia-log-errors, TimedMediaHandler, Commons
brion added a comment to T157621: Special:TimedMediaHandler does not exist and won't even load a webpage.

Still fails on .10, I don't think there's any relevant change to the special page in the last version.

Wed, Feb 8, 10:50 PM · WMF-deploy-2017-02-07_(1.29.0-wmf.11), WMF-deploy-2017-02-14_(1.29.0-wmf.12), Patch-For-Review, Wikimedia-log-errors, TimedMediaHandler, Commons
brion added a comment to T157621: Special:TimedMediaHandler does not exist and won't even load a webpage.

hmm nevermind, should be limiting to 50. Not sure wtf is going on then, looking more closely

Wed, Feb 8, 10:41 PM · WMF-deploy-2017-02-07_(1.29.0-wmf.11), WMF-deploy-2017-02-14_(1.29.0-wmf.12), Patch-For-Review, Wikimedia-log-errors, TimedMediaHandler, Commons
brion added a comment to T157621: Special:TimedMediaHandler does not exist and won't even load a webpage.

Special:TimedMediaHandler's getTranscodes method asks for every matching row instead of a subset. It's probably just too many files total now. I'll see if I can add a quick hack to limit.

Wed, Feb 8, 10:40 PM · WMF-deploy-2017-02-07_(1.29.0-wmf.11), WMF-deploy-2017-02-14_(1.29.0-wmf.12), Patch-For-Review, Wikimedia-log-errors, TimedMediaHandler, Commons
brion added a comment to T157614: Investigate if it is legally okay to have h264 decoder run on production and/or labs, or provide the decoder in JS for a browser to run.

So there's two separate questions:

  1. can we run an h.264 decoder (via ffmpeg) on a service in production that converts from files we don't serve directly

-or-

  1. can we ship a JavaScript h.264 decoder (ffmpeg compiled to JS) in a web page
Wed, Feb 8, 8:31 PM · WMF-Legal, Wikimedia-Video, Multimedia
brion added a comment to T157319: Implement replacement for Firefogg (on-the-fly video transcoding).

video2commons already has the video transcode (on the backend instead of frontend) + upload, it wouldn't be impossible to port that to production and integrate with UW.

Wed, Feb 8, 7:23 PM · Wikimedia-Video, UploadWizard, Multimedia
brion added a comment to T155085: Audio/video playback fails in MS Edge in Windows 10 Insider build 15002.

Build 15031 fixes the immediate problem but still introduces some other incompatibility... however it seems to be worked around by the updated streaming code in ogv.js master. I'll prep an update release...

Wed, Feb 8, 7:21 PM · WMF-deploy-2017-02-14_(1.29.0-wmf.12), Patch-For-Review, Upstream, Browser-Support-Microsoft-Edge, TimedMediaHandler-Player

Tue, Feb 7

brion added a comment to T89552: Implement International Image Interoperability Framework (IIIF) prototype service on Wikimedia labs.

Yeah, this is a useful ability and will be needed for panoramic stuff. I'd like to create an IIIF image api & tiling endpoint built into MediaWiki instead of as a separate layer, but we haven't got to it yet..

Tue, Feb 7, 8:22 PM · Possible-Tech-Projects, Wikimedia-General-or-Unknown, Multimedia

Thu, Feb 2

Yann awarded T155098: Rework job queue usage for TimedMediaHandler (video scalers) a Like token.
Thu, Feb 2, 2:52 PM · WMF-deploy-2017-02-07_(1.29.0-wmf.11), WMF-deploy-2017-02-14_(1.29.0-wmf.12), Patch-For-Review, TimedMediaHandler-Transcode

Thu, Jan 26

brion added a comment to T156185: Big transcodes fail with Exitcode: 137.

Hmm, maybe let's bump the limit up a little further. No sense spending hours transcoding just to fail the file. (Dialing this in is not an exact science; the wall clock and CPU times don't match up on a consistent ratio so you'll see some failures earlier, and others later.)

Thu, Jan 26, 6:30 PM · Patch-For-Review, TimedMediaHandler-Transcode

Jan 19 2017

brion closed T155750: Increase transcode background time limit as "Resolved".

Ok, this is merged live in today's SWAT updates. Already-running jobs will still have the lower limit and may still time out, but those that start from now should have a doubled time limit which'll be more in line with wall-clock time and should avoid timing out on most of the 1-2 hours 720p/1080p videos.

Jan 19 2017, 7:23 PM · Patch-For-Review, TimedMediaHandler-Transcode
brion claimed T155750: Increase transcode background time limit.

(patch in the works to double the timeout based on our threading setting)

Jan 19 2017, 6:13 PM · Patch-For-Review, TimedMediaHandler-Transcode
brion added a comment to T155750: Increase transcode background time limit.

I was a bit baffled why the timeouts seem to be happening significantly before the 8-hour limit is hit, but it turns out ulimit is based on *CPU time* not *wall-clock time*. Since there is some parallelization between decode, scaling, and re-encoding, the CPU usage is around 175% on these ffmpeg processes, not a 'mere' 100%, so we'll hit an 8 hour limit in 4-6 hours.

Jan 19 2017, 6:04 PM · Patch-For-Review, TimedMediaHandler-Transcode
brion added a comment to T155098: Rework job queue usage for TimedMediaHandler (video scalers).

Memory usage looks sane enough logging in... I do see a few processes in 240+ minutes of CPU time, longest running now is 346 minutes.

Jan 19 2017, 6:02 PM · WMF-deploy-2017-02-07_(1.29.0-wmf.11), WMF-deploy-2017-02-14_(1.29.0-wmf.12), Patch-For-Review, TimedMediaHandler-Transcode
brion added a comment to T155098: Rework job queue usage for TimedMediaHandler (video scalers).

Ah that 'memory' is just the memory limit being reported. That doesn't help us know why it died. Sigh.

Jan 19 2017, 5:39 PM · WMF-deploy-2017-02-07_(1.29.0-wmf.11), WMF-deploy-2017-02-14_(1.29.0-wmf.12), Patch-For-Review, TimedMediaHandler-Transcode
brion added a comment to T155098: Rework job queue usage for TimedMediaHandler (video scalers).

(Ok I can find the error messages, it's just not linking to the popup anymore. Weird.) Yeah, I see those "Exitcode: 137" which indicates a SIGKILL... but the times don't seem to match up with a strict 8-hour limit. I see some apparently killed at 6 hours or so, others less. Actually I think they're dying on the memory limit -- "Exitcode: 137 / Memory: 4194304" etc.

Jan 19 2017, 5:36 PM · WMF-deploy-2017-02-07_(1.29.0-wmf.11), WMF-deploy-2017-02-14_(1.29.0-wmf.12), Patch-For-Review, TimedMediaHandler-Transcode
brion added a comment to T155098: Rework job queue usage for TimedMediaHandler (video scalers).

@Yann can you break out a separate task for raising the background time limit? I want to make sure we don't lose that. Currently most of the failures I'm seeing aren't reporting back what their errors were, which makes it tricky to see what's going on, I'll have to poke around and see why that's going on.

Jan 19 2017, 5:20 PM · WMF-deploy-2017-02-07_(1.29.0-wmf.11), WMF-deploy-2017-02-14_(1.29.0-wmf.12), Patch-For-Review, TimedMediaHandler-Transcode
brion added a comment to T155098: Rework job queue usage for TimedMediaHandler (video scalers).

@Joe the puppet changes are in https://gerrit.wikimedia.org/r/#/c/331668/ -- can you take a look and see if it makes sense?

Jan 19 2017, 5:09 PM · WMF-deploy-2017-02-07_(1.29.0-wmf.11), WMF-deploy-2017-02-14_(1.29.0-wmf.12), Patch-For-Review, TimedMediaHandler-Transcode

Jan 18 2017

brion moved T87619: Ogg audio file on Commons not listed with correct duration metadata from Reported Upstream to Patch proposed upstream on the Upstream board.
Jan 18 2017, 6:00 PM · WMF-deploy-2017-01-31_(1.29.0-wmf.10), Multimedia, Upstream, Commons, TimedMediaHandler, MediaWiki-File-management
brion moved T155085: Audio/video playback fails in MS Edge in Windows 10 Insider build 15002 from Reported Upstream to Patch proposed upstream on the Upstream board.
Jan 18 2017, 5:24 PM · WMF-deploy-2017-02-14_(1.29.0-wmf.12), Patch-For-Review, Upstream, Browser-Support-Microsoft-Edge, TimedMediaHandler-Player
brion moved T155247: Transcoding hangs for no apparent reason, then timeouts from Reported Upstream to Patch proposed upstream on the Upstream board.
Jan 18 2017, 5:24 PM · Upstream, TimedMediaHandler-Transcode
brion moved T87619: Ogg audio file on Commons not listed with correct duration metadata from Backlog to Reported Upstream on the Upstream board.
Jan 18 2017, 5:23 PM · WMF-deploy-2017-01-31_(1.29.0-wmf.10), Multimedia, Upstream, Commons, TimedMediaHandler, MediaWiki-File-management
brion added a project to T87619: Ogg audio file on Commons not listed with correct duration metadata: Upstream.

This appears to be an issue with File_Ogg. Tagging upstream... https://pear.php.net/bugs/bug.php?id=21164

Jan 18 2017, 5:23 PM · WMF-deploy-2017-01-31_(1.29.0-wmf.10), Multimedia, Upstream, Commons, TimedMediaHandler, MediaWiki-File-management
brion added a comment to T155320: Implement strict mime type detection and media type inferring of audio/video files.

Skeleton track, if present, can list the types of the various streams, but yes it's usually not there for audio and not always there for video depending on which software was used to convert. But parsing the skeleton track isn't trivial either -- it's embedded in the Ogg stream multiplexing too -- so we may as well just check the header packets of each stream, which is what File_Ogg does.

Jan 18 2017, 5:05 PM · Technical-Debt, TimedMediaHandler
brion added a comment to T103421: Publish File_Ogg as a composer package.

Work in progress retooling some of the old code to be namespace & PSR-4 autoloader friendly on my work fork branch: https://github.com/brion/File_Ogg/commits/modernize Also merged the fix for certain cut-off positions, and removed the PEAR_Exception dependency.

Jan 18 2017, 12:44 AM · Librarization, TimedMediaHandler

Jan 17 2017

brion closed T138772: TMH video.js-mode iframe embed isn't centered as "Resolved".
Jan 17 2017, 9:56 PM · WMF-deploy-2017-01-24_(1.29.0-wmf.9), Patch-For-Review, TimedMediaHandler-Player
brion added a comment to T155320: Implement strict mime type detection and media type inferring of audio/video files.

Adding T103421 as dep; proper way to check is to actually look at the header packets and check what they contain, which File_Ogg package can do. We need to move our copy out of TMH and use it via Composer in a shared manner.

Jan 17 2017, 9:49 PM · Technical-Debt, TimedMediaHandler
brion added a subtask for T103421: Publish File_Ogg as a composer package: T155320: Implement strict mime type detection and media type inferring of audio/video files.
Jan 17 2017, 9:48 PM · Librarization, TimedMediaHandler
brion added a parent task for T155320: Implement strict mime type detection and media type inferring of audio/video files: T103421: Publish File_Ogg as a composer package.
Jan 17 2017, 9:48 PM · Technical-Debt, TimedMediaHandler
brion claimed T103421: Publish File_Ogg as a composer package.

I'll take this on, was looking at making some fixes anyway. @tstarling can you set me up as a maintainer for Pear/File_Ogg and I'll try and get it synced with our inline version and set up with Composer?

Jan 17 2017, 9:47 PM · Librarization, TimedMediaHandler
brion added a comment to T155551: 'MWMultiVersion instance already set!' running 'mwscript tests/phpunit/phpunit.php' in MediaWiki-Vagrant.

Workaround: run via 'php5' manually:

Jan 17 2017, 9:21 PM · MediaWiki-Unit-tests, MediaWiki-Vagrant
brion created T155551: 'MWMultiVersion instance already set!' running 'mwscript tests/phpunit/phpunit.php' in MediaWiki-Vagrant.
Jan 17 2017, 9:20 PM · MediaWiki-Unit-tests, MediaWiki-Vagrant
brion added a comment to T138771: TMH iframe embed code doesn't pass width/height, doesn't create thumb/poster image unless 404 handler active.

We should be able to use a suitable default size here for non-JS path, with suitable JS injection if we really want to give a precise size.

Jan 17 2017, 7:55 PM · TimedMediaHandler-Player
brion added a comment to T155523: re-index multimedia files after deployment of ogg filetype detection updates.

You'll probably have to touch the affected files to update their data first... Not sure if we have a suitable maint script at this time.

Jan 17 2017, 7:51 PM · Discovery-Search, Commons, Discovery
brion closed T27397: Add .webp to the list of accepted file types on Wikimedia Commons uploads as "Resolved".

Ok I've confirmed the backend image servers are now producing thumbnail output. Thanks joe! Closing back out as resolved.

Jan 17 2017, 5:00 PM · User-notice, WMF-deploy-2015-11-03_(1.27.0-wmf.5), MW-1.27-release-notes, Patch-For-Review, Commons, Multimedia, MediaWiki-Uploading
brion closed T27397: Add .webp to the list of accepted file types on Wikimedia Commons uploads, a subtask of T27611: Support optimized WebP thumbnails as alternative to JPEG, PNG, as "Resolved".
Jan 17 2017, 5:00 PM · Commons, Multimedia, MediaWiki-File-management

Jan 14 2017

brion closed T153488: Commons video transcoders have over 6500 tasks in the backlog. as "Resolved".

Yeah I think we're good to close this one out; improvements to the queue handling are in a separate ticket

Jan 14 2017, 10:55 PM · User-notice, User-Elukey, User-Joe, Operations, Wikimedia-Video, TimedMediaHandler-Transcode, Commons
brion closed T153488: Commons video transcoders have over 6500 tasks in the backlog., a subtask of T152938: Server side upload for Jasonanaggie, as "Resolved".
Jan 14 2017, 10:55 PM · Commons, Wikimedia-Site-requests
brion closed T153488: Commons video transcoders have over 6500 tasks in the backlog., a subtask of T152942: Please upload large file to Wikimedia Commons, as "Resolved".
Jan 14 2017, 10:55 PM · Commons, Wikimedia-Site-requests
brion closed T153488: Commons video transcoders have over 6500 tasks in the backlog., a subtask of T152943: Please upload large file to Wikimedia Commons, as "Resolved".
Jan 14 2017, 10:55 PM · Commons, Wikimedia-Site-requests
brion closed T153488: Commons video transcoders have over 6500 tasks in the backlog., a subtask of T152969: Please upload large file to Wikimedia Commons, as "Resolved".
Jan 14 2017, 10:55 PM · Commons, Wikimedia-Site-requests
brion closed T153488: Commons video transcoders have over 6500 tasks in the backlog., a subtask of T153136: Please upload large file to Wikimedia Commons, as "Resolved".
Jan 14 2017, 10:55 PM · Commons, Wikimedia-Site-requests