Move video transcoding to use Shellbox
Open, HighPublic
Actions

Assigned To

None

Authored By

	Joe
	Jan 31 2024, 7:34 AM

Description

This needs the following to happen:

Create a new shellbox deployment called shellbox-video or similar
Create a new flavour of the shellbox image, including ffmpeg and fluidsynth at least, to use in that deployment
Convert the TimedMediaHandler extension to use BoxedCommand instead of UnboxedCommand (via wfShellExec)
Configure MediaWiki in production to use the remote shellbox installation

Details

Subject	Repo	Branch	Lines +/-
shellbox-video: increase replicas, namespace resources	operations/deployment-charts	master	+10 -5
group0, group1: enable shellbox-video	operations/mediawiki-config	master	+2 -1
testwiki: use shellbox-video for scaling video	operations/mediawiki-config	master	+1 -0
Add shellbox-video vars/config, enable on beta	operations/mediawiki-config	master	+14 -0

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Open	None	T355292 Port videoscaling to kubernetes
Open	None	T356241 Move video transcoding to use Shellbox
Resolved	Joe	T356242 Convert TimedMediaHandler to use BoxedCommand/Shellbox
Resolved	kamila	T357296 Create new flavour of shellbox for video transcoding
Resolved	hnowlan	T357309 Create a deployment for `shellbox-timedmedia`
Open	None	T368619 Log filename in shellbox-video httpd

Event Timeline

Joe created this task.Jan 31 2024, 7:34 AM

Joe triaged this task as High priority.Jan 31 2024, 7:46 AM

Joe updated the task description. (Show Details)

Joe closed subtask T356242: Convert TimedMediaHandler to use BoxedCommand/Shellbox as Resolved.Feb 12 2024, 11:20 AM

kamila changed the status of subtask T357309: Create a deployment for `shellbox-timedmedia` from Open to In Progress.Feb 21 2024, 10:42 AM

kamila closed subtask T357296: Create new flavour of shellbox for video transcoding as Resolved.Mar 25 2024, 12:23 PM

TehKittyCat subscribed.Apr 22 2024, 5:18 AM

Change #1043812 had a related patch set uploaded (by Hnowlan; author: Hnowlan):

[operations/mediawiki-config@master] Add shellbox-video vars/config, enable on testwiki

https://gerrit.wikimedia.org/r/1043812

gerritbot added a project: Patch-For-Review.Fri, Jun 21, 11:39 AM

Change #1043812 merged by jenkins-bot:

[operations/mediawiki-config@master] Add shellbox-video vars/config, enable on beta

https://gerrit.wikimedia.org/r/1043812

Mentioned in SAL (#wikimedia-operations) [2024-06-26T14:21:24Z] <logmsgbot> lucaswerkmeister-wmde@deploy1002 Started scap: Backport for [[gerrit:1043812|Add shellbox-video vars/config, enable on beta (T356241)]]

Mentioned in SAL (#wikimedia-operations) [2024-06-26T14:24:07Z] <logmsgbot> lucaswerkmeister-wmde@deploy1002 hnowlan, lucaswerkmeister-wmde: Backport for [[gerrit:1043812|Add shellbox-video vars/config, enable on beta (T356241)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)

Mentioned in SAL (#wikimedia-operations) [2024-06-26T14:29:42Z] <logmsgbot> lucaswerkmeister-wmde@deploy1002 Finished scap: Backport for [[gerrit:1043812|Add shellbox-video vars/config, enable on beta (T356241)]] (duration: 08m 22s)

Maintenance_bot removed a project: Patch-For-Review.Wed, Jun 26, 2:30 PM

hnowlan closed subtask T357309: Create a deployment for `shellbox-timedmedia` as Resolved.Thu, Jun 27, 9:51 AM

hnowlan mentioned this in T357309: Create a deployment for `shellbox-timedmedia`.

Change #1049970 had a related patch set uploaded (by Hnowlan; author: Hnowlan):

[operations/mediawiki-config@master] testwiki: use shellbox-video for scaling video

https://gerrit.wikimedia.org/r/1049970

gerritbot added a project: Patch-For-Review.Thu, Jun 27, 9:52 AM

kamila subscribed.Thu, Jun 27, 9:59 AM

Change #1049970 merged by jenkins-bot:

[operations/mediawiki-config@master] testwiki: use shellbox-video for scaling video

https://gerrit.wikimedia.org/r/1049970

Mentioned in SAL (#wikimedia-operations) [2024-06-27T13:08:07Z] <urbanecm@deploy1002> Started scap: Backport for [[gerrit:1038742|[CheckUser] Stop writing old for event tables migration on all wikis (T360685)]], [[gerrit:1049970|testwiki: use shellbox-video for scaling video (T356241)]], [[gerrit:1049886|Add VK namespace alias to Azerbaijani Wikibooks (T368237)]]

Stashbot mentioned this in T368237: Add "VK" namespace alias to Azerbaijani Wikibooks..Thu, Jun 27, 1:08 PM

Stashbot mentioned this in T360685: Stop writing old for event table migration on WMF wikis.

Mentioned in SAL (#wikimedia-operations) [2024-06-27T13:10:46Z] <urbanecm@deploy1002> urbanecm, dreamrimmer, hnowlan, dreamyjazz: Backport for [[gerrit:1038742|[CheckUser] Stop writing old for event tables migration on all wikis (T360685)]], [[gerrit:1049970|testwiki: use shellbox-video for scaling video (T356241)]], [[gerrit:1049886|Add VK namespace alias to Azerbaijani Wikibooks (T368237)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)

Mentioned in SAL (#wikimedia-operations) [2024-06-27T13:24:55Z] <urbanecm@deploy1002> Finished scap: Backport for [[gerrit:1038742|[CheckUser] Stop writing old for event tables migration on all wikis (T360685)]], [[gerrit:1049970|testwiki: use shellbox-video for scaling video (T356241)]], [[gerrit:1049886|Add VK namespace alias to Azerbaijani Wikibooks (T368237)]] (duration: 16m 48s)