Page MenuHomePhabricator

Batch-convert old video files for new VP9/opus format
Closed, ResolvedPublic

Description

With T63805 deployed, new video uploads will be producing VP9/Opus WebM transcodes instead of the old VP8/Vorbis configuration. We still have to back-fill in the old files for consistency; this can be done with requeueTranscodes.php.

On mwmain1001, run something like:

mwscript extensions/TimedMediaHandler/maintenance/requeueTranscodes.php --wiki=commonswiki --throttle --video --missing

in a tmux session. This will go through all video files on the wiki and for any missing transcodes in the currently defined set (VP9) it'll run them. The --throttle option is important to keep from flooding the queue with thousands of files.

I'll start running this shortly.

Event Timeline

Something seems wrong with the throttle option; it's not pausing when the queue size goes up. I'll investigate.

This has been resolved (caused by T200813, worked around). Batch is running. Load is moderate on servers, we might be able to tune them to run more runners.

Encountered a spike in errors, details at T200873. Stopping the batch job for now.

(Restarted the batch job a while ago.)

Another intermittent error I see is "invalid frame size: 0x0" T200939. Doesn't seem VP9-specific but I hadn't noticed it until recently.

All this ran, and later a bunch re-ran, some time ago. Closing out.