Page MenuHomePhabricator

Play Audio Files in Media Viewer
Open, LowPublic

Description

Migrated from: https://wikimedia.mingle.thoughtworks.com/projects/multimedia/cards/163

Narrative

As a user, I want to play audio filesin Media Viewer, so I can get more info, better controls and related visuals.

Acceptance Criteria

We would like to play audio files in the Media Viewer, with a few basic features like:

  • Play
  • Pause
  • Volume control (mute option)
  • Browsable time-line (with draggable progress indicator)
  • Time indicator (current time/total time)**
  • Waveform display(showing the file's sound wave)**
  • Cover image (related still picture, like album cover - optional)
  • Full screen (as for other media types)
  • Settings (speed, quality, format)
  • Subtitles / closed caption
  • Script / Transcript (link to sub-page, if one exists)

    See this design exploration PDF on how Media Viewer design concepts can support different media types.

For specific design recommendations, review slide 11 (see mockup below, and notes below that).

Mockup

Notes

  • This would be done using the Kaltura player 2.0, which can be skinned as needed.
  • Right now, we aim to support these open formats:OGG, WAV, MIDI and X-FLAC.
  • See separate cards for Video support (see #162 ), Kaltura player 2.0 integration (see #164 ) and TimedMedia Handler upgrade (see #165 ).
  • We are setting up phone calls and in-person meetings with Kaltura in mid-February and early March to help us.
  • We want to inherit as much of the basic video UI as appropriate, to save extra work.
  • How do we deal with the fact there is no image for audio files? Show a waveform animation of the sound? Show an image, if specified? Show meta-data panel,captions or transcripts?
  • In the first implementation, we will go for whichever solution seems more practical from a development and community maintenance perspective(e.g. meta-data panel or sound waveform), then incrementally improve the quality and optionsover time, in consultation with our community.

About Media Viewer

Read more on MediaWiki product page .

Related Bugs

Related Stories

  • #8 Media Viewer Front-End
  • T77147 Play Video Files in Media Viewer
  • T77149 Integrate Kaltura Player v2 in Media Viewer
  • T77150 UpgradeTimedMedia Handler

Related Patchsets

Event Timeline

MingleTerminator raised the priority of this task from to Low.Dec 8 2014, 4:25 PM
In mingle on 2014-02-03 at 14:41:04, @Gilles wrote:

I think that this should actually happen after video, not before. By then we should have a plugin architecture, subtitles support, draggable timeline, etc. The remainder is three subcards, imho: basic audio playback, cover image support and waveform display.

In mingle on 2014-02-19 at 19:56:19, @Fabrice_Florin wrote:

Gilles, I agree with your recommendation to do this after video. There are also possible complications with this feature, because we do not have an easy solution for the visualization aspects, which would be needed to justify opening up audio files in the full-screen media viewer. As a fall-back plan, we should be open to possibly only show a small modal pop-up window to play audio over the article, rather than a Media Viewer integration.

brion added a subscriber: brion.Jul 21 2015, 12:56 AM
Restricted Application added a subscriber: Matanya. · View Herald TranscriptJul 21 2015, 12:56 AM
Jdforrester-WMF moved this task from Untriaged to Backlog on the Multimedia board.Sep 4 2015, 5:56 PM

Mass-removing the Multimedia tag from MediaViewer tasks, as this is now being worked on by the Reading department, not Editing's Multimedia team.