Page MenuHomePhabricator

Transcode job failures
Closed, ResolvedPublic

Description

aaron@terbium:~$ mwscript showJobs.php commonswiki --group
...
webVideoTranscode: 18013 queued; 281 claimed (153 active, 128 abandoned); 0 delayed

aaron@fluorine:~/mw-log$ grep -r 'transcode' runJobs.log | grep 'error=' | wc -l
62

Seem to be lots of "Source not found" errors.


Version: unspecified
Severity: normal

Details

Reference
bz61713

Event Timeline

bzimport raised the priority of this task from to Needs Triage.Nov 22 2014, 2:58 AM
bzimport set Reference to bz61713.

Perhaps the job gets run before the file fully gets settled into swift. Ive noticed lots of cases where the transcode is "queued" when first uploaded but doesnt run until somebody "resets" it.

Actually more likely answer is that Brion added about 80000 transcode jobs (by adding 2 new transcodes for each file) so maybe the job queue is simply getting much more use, and thus much more errors.

Gilles triaged this task as Medium priority.Nov 24 2014, 2:52 PM
Gilles subscribed.
brion claimed this task.
brion subscribed.

I think this was due to old system where lots of duplicate jobs got filed and most of them "failed" because they were already done, which has been since reworked. Closing out for now; reopen if still issues such as this.