Current encoding performance on 1440p and 2160p videos can be very long. This needs to be tuned to run faster, possibly at cost of higher bitrate, as a batch of uploads of long videos can stick in the queue for a couple of days easily.
Step 1: disable 1440p and 2160p transcodes on live production (both HLS and WebM)
Step 2: re-tune the compression settings and test offline
Step 3: re-enable, preferably consolidating on HLS only (or re-tooling the adaptive streaming to combine with the WebM)
| Subject | Repo | Branch | Lines +/- | |
|---|---|---|---|---|
| Temporarily disable '4K' 2160p and mid 1440p transcodes | operations/mediawiki-config | master | +7 -2 |
Change #1049608 had a related patch set uploaded (by Bvibber; author: Bvibber):
[operations/mediawiki-config@master] Temporarily disable '4K' 2160p and mid 1440p transcodes
We found that timeouts didn't seem to be handled correctly:
Taking the high-res ones out for now should help until we reduce the initial timestamp and make sure it's enforced correctly.
The encoding can also be reconfigured to run faster, with slightly higher bitrate output. I'll poke at this shortly.
Change #1049608 merged by jenkins-bot:
[operations/mediawiki-config@master] Temporarily disable '4K' 2160p and mid 1440p transcodes
Mentioned in SAL (#wikimedia-operations) [2024-06-25T20:05:47Z] <cjming@deploy1002> Started scap: Backport for [[gerrit:1049608|Temporarily disable '4K' 2160p and mid 1440p transcodes (T368433)]]
Mentioned in SAL (#wikimedia-operations) [2024-06-25T20:08:39Z] <cjming@deploy1002> cjming, bvibber: Backport for [[gerrit:1049608|Temporarily disable '4K' 2160p and mid 1440p transcodes (T368433)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)
Mentioned in SAL (#wikimedia-operations) [2024-06-25T20:14:24Z] <cjming@deploy1002> Finished scap: Backport for [[gerrit:1049608|Temporarily disable '4K' 2160p and mid 1440p transcodes (T368433)]] (duration: 08m 36s)
Are 1080p transcodes also disabled? https://commons.wikimedia.org/wiki/File:White_Tiger_%281923%29_by_Tod_Browning.webm
That source file is 1408x1076 pixels, smaller than 1080p, so no 1080p output is created.
I have been working on flushing out "stuck" transcodes from the running transcodes recently... ones that had been in a "started" status for weeks or months, and were probably interrupted by a server reset. Among these I've found a few (https://commons.wikimedia.org/wiki/File:Rhaeadr_Fawr,_Abergwyngregyn,_Gwynedd,_Cymru_(Wales).webm is an example) that are permanently "running" and not resettable due to this.
I'm not saying this is actually a problem. Just remember to flush when you're done. :)