Video.js default skin is really only suited for video playback. We will need to create/borrow a skin and/or player mode that really works for <audio>.
Related Gerrit Patches:
|mediawiki/extensions/TimedMediaHandler : master||Fix sizing of audio player and fully hide native controls|
|mediawiki/extensions/TimedMediaHandler : master||Make controlbar layout depend on the player width|