Page MenuHomePhabricator

[Epic] Determine a strategy to store files between 5 and 100 Gb
Open, Needs TriagePublic

Description

More and more, we're going to encounter requests to store very large videos in lossless format. Those videos will be huge, we already received requests for 16 Gb and 18 Gb files from @Goryeo.

Current Wikimedia infrastructure uses swift as a storage backend, but without support for large object.

MediaWiki isn't equipped either to send large objects to swift, as there is a need to divide the file in several parts < 5 Gb each.

We need to determine a strategy at infrastructure and MediaWiki levels to store those large files.

References:

Event Timeline

Dereckson created this task.Apr 9 2018, 2:44 PM
Dereckson renamed this task from Determine if/how we can store file size greater than 32 bits to {Epic] Determine a strategy to store files between 5 and 100 Gb.Apr 9 2018, 2:59 PM
Dereckson removed Dereckson as the assignee of this task.
Dereckson updated the task description. (Show Details)
Dereckson added subscribers: aaron, fgiunchedi.
revi renamed this task from {Epic] Determine a strategy to store files between 5 and 100 Gb to [Epic] Determine a strategy to store files between 5 and 100 Gb.Apr 12 2018, 7:52 AM
revi added a subscriber: revi.

I think it'd be good to do this. Commons is aimed to provide high quality educational multimedia. The more quality of our resources, the more useful they'll be. Thanks.

aaron added a comment.Apr 12 2018, 5:35 PM

This is related to T149847 in that we would *have* to stop moving file content around in Special:MovePage just to rename files.

Yann added a subscriber: Yann.Jun 7 2018, 4:28 PM
Meisam added a subscriber: Meisam.Aug 17 2018, 9:26 PM
GPSLeo added a subscriber: GPSLeo.Jul 16 2019, 12:18 PM