ApiUploadTest is flaky
Open, LowPublic


Author: neilk

multiple runs of ApiUploadTest have different results. Sometimes they succeed, sometimes fail.

Oddly, printing debug information seems to make the errors more elusive.

Arguably ApiUploadTest is done wrong; it should open up a real HTTP connection rather than elaborately simulating an API request.

Version: unspecified
Severity: normal



Related Objects

bzimport raised the priority of this task from to Low.
bzimport set Reference to bz26169.
bzimport added a subscriber: Unknown Object (MLST).
bzimport created this task.Nov 30 2010, 5:29 AM
demon added a comment.Nov 30 2010, 6:07 PM

Is this actually in wikimedia-deployment, or on trunk?

I wouldn't trust any of the unit tests to run on deployment, lots of unmerged changes there.

the purpose of ApiUploadTest is not to test the actual upload so much as the code path handling the API upload. Requiring the test to use an actual web server would mean the tests couldn't be used by as many people.

Is this still an issue?

Antoine is going to remove this test from the default group of tests. I'm unassigning this from him for now. Whoever takes this on probably needs to set up mock objects and other mechanisms to avoid this unreliability in testing.

hashar added a comment.Feb 6 2012, 9:40 PM

Disabled with r110790

Krinkle added subscribers: hashar, Krinkle.EditedJan 12 2017, 9:59 PM

Disabled with rSVN110790

ApiUploadTest is still in @group Broken in current master.

Restricted Application added a project: Multimedia. · View Herald TranscriptJan 12 2017, 9:59 PM
Krinkle renamed this task from ApiUploadTest is flaky -- inconsistent results to ApiUploadTest is flaky.Jan 12 2017, 10:00 PM
demon removed a subscriber: demon.Mar 9 2017, 9:38 PM

Change 379817 had a related patch set uploaded (by Aleksey Bekh-Ivanov (WMDE); owner: Aleksey Bekh-Ivanov (WMDE)):
[mediawiki/core@master] Make ApiUploadTest up to date so it passes


Krinkle removed a subscriber: Krinkle.Sep 22 2017, 6:53 PM

Change 379817 merged by jenkins-bot:
[mediawiki/core@master] Make ApiUploadTest up to date so it passes


Anomie added a subscriber: Anomie.

(nothing useful for that tag in the merged patch)

Ramsey-WMF moved this task from Untriaged to Triaged on the Multimedia board.Nov 28 2017, 8:37 PM