Page MenuHomePhabricator

Convert and upload large interview videos for Mardetanha
Open, Needs TriagePublic

Description

Tracking task for helping Mohsen Salek (Mardetanha) with converting and uploading some large video files of interviews.

  • convert to WebM
  • collect descriptions for the files
  • upload them manually via importFiles.php
  • return USB drive

I'll try running the conversions next week when I'm back home. Some files are MPEG-2 some are MP4/H.264, all should be easy to turn into WebM once I tune the parameters -- they're just so large it's hard to do online. :)

@Mardetanha before I can upload them I'll need descriptions for each file, at least the source, then you can detail them more after upload.

Event Timeline

brion created this task.Aug 15 2017, 5:01 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptAug 15 2017, 5:01 PM

hello, I was traveling and I know back home, if you could upload videos with same file name as they are in folder I can manage everything on commons.
and for the source please add part of kheshte kham seriies, I am creating a source template on commons.

brion added a comment.Sep 13 2017, 5:17 PM

Ok, my batch conversions have completed -- files are all converted to .webm and small enough to upload. (They're long and high resolution, but they compress well because they're interviews with relatively little motion.)

I'll start the uploads later this week and ping you for the detail updates. :)

Ok, my batch conversions have completed -- files are all converted to .webm and small enough to upload. (They're long and high resolution, but they compress well because they're interviews with relatively little motion.)
I'll start the uploads later this week and ping you for the detail updates. :)

Thanks indeed, do we have any use manual how to convert such files ?

brion added a comment.Sep 18 2017, 6:52 PM

Ok, currently running the imports. Did some slight renaming of the files, gave them all prefix 'Kheshte Kham - ' to avoid any name conflicts.

@Mardetanha here's the command I used to do the conversion:

ffmpeg \
  -i "$vid" \
  -c:v libvpx-vp9 \
  -b:v 0 \
  -crf 30 \
  -threads 4 \
  -speed 2 \
  -tile-columns 6 \
  -auto-alt-ref 1 \
  -lag-in-frames 25 \
  -c:a libopus \
  -b:a 64k \
  -f webm \
  "vp9/$vid.webm"

On my batch processing computer this took about 4 hours per video (where I could run two at once using two 4-core processors).

The '-crf 30' parameter sets "constant quality" mode to a reasonable default, which allows using a lower data rate during scenes of low motion (great for interview shows like this). Using VP9/Opus gave me about 40% smaller file size of VP8/Vorbis in my first testing round, which helped ensure the files fit within the 4 GB limit we have. All the VP9 WebM files are under 2 GB, which is *much* smaller than the high data rate MPEG-2 and MP4 files originally provided with only slight quality loss.

Note that the files will require processing on the server side, so playback may initially show the HD version instead of a more moderate resolution while it's going.

Don't forget to add the license metadata etc! :)

brion added a comment.Sep 18 2017, 7:26 PM

Ok import complete:

Import Images

Importing Kheshte Kham - Asgharzade.webm...done.
Importing Kheshte Kham - لطف الله میثمی.webm...done.
Importing Kheshte Kham - سید کاظم موسوی بجنوردی.webm...done.
Importing Kheshte Kham - Hamid Rasaie. kamel.webm...done.
Importing Kheshte Kham - نادر طالب زاده.webm...done.
Importing Kheshte Kham - Tajzade.webm...done.
Importing Kheshte Kham - سید محمدعلی ابطحی.webm...done.
Importing Kheshte Kham - Davari.webm...done.
Importing Kheshte Kham - هادی غفاری.webm...done.
Importing Kheshte Kham - Yazdi.webm...done.
Importing Kheshte Kham - Dr Ardeshir Khorshidian.webm...done.
Importing Kheshte Kham - Rahmanian.webm...done.
Importing Kheshte Kham - Khamenei.webm...done.
Importing Kheshte Kham - Faezeh Hashemie.webm...done.
Importing Kheshte Kham - Zarghami.webm...done.
Importing Kheshte Kham - Final.webm...done.
Importing Kheshte Kham - Mohammad Reze Zaerie.webm...done.
Importing Kheshte Kham - رحمانیان.webm...done.
Importing Kheshte Kham - Mohammad Beheshtie.webm...done.
Importing Kheshte Kham - Ebrahim Yazdie.webm...done.
Importing Kheshte Kham - Sadeq Zibakalam.webm...done.
Importing Kheshte Kham - Noorizad.webm...done.
Importing Kheshte Kham - Final Beheshti.webm...done.

Found: 23
Added: 23

They should appear under your contribs, or copy-paste the filenames from above list.

Thanks indeed, I am working with files. sadly one clueless admin deleted files without prior notification, so I am trying to get them back,

Meisam added a subscriber: Meisam.Oct 21 2018, 9:48 PM