Page MenuHomePhabricator

Browser tests report as failures despite passing
Closed, DuplicatePublic


The RelatedArticles build has failed for the last 2 attempts according to a visual scan of however if you dive into the test failures they actually passed.

Also note that the IRC bot thinks they've passed as well

<wmf-insecte> Yippee, build fixed!
9:26 AM Project selenium-RelatedArticles » chrome,beta-desktop,Linux,BrowserTests build #394: FIXED in 18 sec: > >,MEDIAWIKI_ENVIRONMENT=beta-desktop,PLATFORM=Linux,label=BrowserTests/394/
9:26 AM Yippee, build fixed!
9:26 AM Project selenium-RelatedArticles » chrome,beta-mobile,Linux,BrowserTests build #394: FIXED in 38 sec:,MEDIAWIKI_ENVIRONMENT=beta-mobile,PLATFORM=Linux,label=BrowserTests/394/
9:28 AM J

Looks like may have the same problem.

Event Timeline

Jdlrobson created this task.May 2 2017, 4:32 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 2 2017, 4:32 PM
phuedx added a subscriber: phuedx.May 3 2017, 4:30 AM

No tests have failed. The build artifacts look correct. The "Publishing Performance test result report" step seems to be failing as it can't find the build artifacts, e.g. from,MEDIAWIKI_ENVIRONMENT=beta-desktop,PLATFORM=Linux,label=BrowserTests/394/console:

16:26:08 ERROR: Step ‘Publish Performance test result report’ aborted due to exception: 
16:26:08 /srv/jenkins-workspace/workspace/selenium-RelatedArticles/BROWSER/chrome/MEDIAWIKI_ENVIRONMENT/beta-desktop/PLATFORM/Linux/label/BrowserTests/log/junit/*.xml (No such file or directory)
16:26:08 	at Method)
16:26:08 	at<init>(
16:26:08 	at<init>(
16:26:08 	at hudson.plugins.performance.parsers.ParserDetector.detect(
16:26:08 	at hudson.plugins.performance.parsers.ParserFactory.getParser(
16:26:08 	at hudson.plugins.performance.PerformancePublisher.getParsers(
16:26:08 	at hudson.plugins.performance.PerformancePublisher.perform(
16:26:08 	at hudson.tasks.BuildStepCompatibilityLayer.perform(
16:26:08 	at hudson.tasks.BuildStepMonitor$1.perform(
16:26:08 	at hudson.model.AbstractBuild$AbstractBuildExecution.perform(
16:26:08 	at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(
16:26:08 	at hudson.model.Build$BuildExecution.post2(
16:26:08 	at hudson.model.AbstractBuild$
16:26:08 	at hudson.model.Run.execute(
16:26:08 	at
16:26:08 	at hudson.model.ResourceController.execute(
16:26:08 	at

It looks like some variables – BROWSER, MEDIAWIKI_ENVIRONMENT, PLATFORM – aren't being replaced in that path.

phuedx added a subscriber: hashar.May 3 2017, 4:30 AM

@hashar: Could this be due to the recent Jenkins upgrade?

hashar added a comment.May 3 2017, 2:39 PM

Yes that is the same as T164296 indeed. Sorry again for the breakage. The root cause is a regression in the Jenkins Performance plugin.