Page MenuHomePhabricator

Batch run of TMH requeueTranscodes to remove now-unused 120p and 180p low-res files
Closed, ResolvedPublic

Description

There seems to be not too much call for super low resolutions; the patch for T312152 removes the 120p and 180p transcodes, so 240p is now the smallest size video output.

These files should be deleted to free space after it is deployed; that can be done with a call to requeueTranscodes.php like this:

php extensions/TimedMediaHandler/maintenance/requeueTranscodes.php --key=120p.vp9.webm
php extensions/TimedMediaHandler/maintenance/requeueTranscodes.php --key=180p.vp9.webm

but on all wikis :D

Event Timeline

Mentioned in SAL (#wikimedia-operations) [2023-01-18T00:07:30Z] <zabe> mwscript extensions/TimedMediaHandler/maintenance/requeueTranscodes.php --wiki=testwiki --key=120p.vp9.webm # T312153

Mentioned in SAL (#wikimedia-operations) [2023-01-18T00:08:28Z] <zabe> mwscript extensions/TimedMediaHandler/maintenance/requeueTranscodes.php --wiki=testwiki --key=180p.vp9.webm # T312153

I ran this on testwiki and I am not sure it did what it was supposed to, they seem to have been regenerated and they are still there, see e.g. https://test.wikipedia.org/wiki/File:2012-07-18_Market_Street_-_San_Francisco.webm.

Random snippet from what happened.

[...]
Marquisdejolie-Sandbox796_512kb.ogg
.. removing 180p.vp9.webm
.. queueing 180p.vp9.webm
SF125.ogv
.. removing 180p.vp9.webm
.. queueing 180p.vp9.webm
Sandbox_test.ogg
.. removing 180p.vp9.webm
.. queueing 180p.vp9.webm
Test.webm
.. removing 180p.vp9.webm
.. queueing 180p.vp9.webm
Test_Bungy.ogg
.. removing 180p.vp9.webm
.. queueing 180p.vp9.webm
[...]

@Zabe it seems to me that the patch that @brion refers to in the description has been reverted, so this is probably blocked on that.

Zabe changed the task status from Open to Stalled.Jan 18 2023, 9:13 AM
brion changed the task status from Stalled to Open.Sep 28 2023, 5:21 PM
brion claimed this task.

Reviving this as we landed the much-redone patch today and it should hit live in the next train. :) Self-assigning as I'll run it myself.

I can start this once this config patch goes out:

https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/961864

and can then build new tracks on testwiki afterwards.

Mentioned in SAL (#wikimedia-operations) [2023-10-05T16:47:25Z] <bvibber> brion running requeueTranscodes.php on mwmaint2002 for VP9 transcode cleanup for T312153

Mentioned in SAL (#wikimedia-operations) [2023-10-05T16:57:18Z] <bvibber> scaling back batch jobs for T312153 and T312152, will run these in further chunks as the new config rolls out