Page MenuHomePhabricator

Jenkins CI job castor-save-workspace-cache stall breaking the whole CI
Closed, ResolvedPublic

Description

Following a plugin upgrade (T336666), a build of castor-save-workspace-cache is stall and not processing. Given the job is triggered by most other jobs, that causes everything to stall!

Trace of the executor thread on the controller:

Executor #0 for integration-castor05 : executing castor-save-workspace-cache #3682143
java.base@11.0.18/java.util.WeakHashMap.getEntry(WeakHashMap.java:432)
java.base@11.0.18/java.util.WeakHashMap.containsKey(WeakHashMap.java:418)
org.jenkinsci.plugins.credentialsbinding.impl.SecretBuildWrapper.getPatternForBuild(SecretBuildWrapper.java:68)
org.jenkinsci.plugins.credentialsbinding.impl.SecretBuildWrapper$Filter.lambda$decorateLogger$0(SecretBuildWrapper.java:150)
org.jenkinsci.plugins.credentialsbinding.impl.SecretBuildWrapper$Filter$$Lambda$835/0x000000084035b040.get(Unknown Source)
org.jenkinsci.plugins.credentialsbinding.masking.SecretPatterns$MaskingOutputStream.eol(SecretPatterns.java:88)
hudson.console.LineTransformationOutputStream.eol(LineTransformationOutputStream.java:61)
hudson.console.LineTransformationOutputStream.write(LineTransformationOutputStream.java:57)
hudson.console.LineTransformationOutputStream.write(LineTransformationOutputStream.java:75)
java.base@11.0.18/java.io.PrintStream.write(PrintStream.java:559)
java.base@11.0.18/sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:233)
java.base@11.0.18/sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:312)
java.base@11.0.18/sun.nio.cs.StreamEncoder.flushBuffer(StreamEncoder.java:104)
java.base@11.0.18/java.io.OutputStreamWriter.flushBuffer(OutputStreamWriter.java:181)
java.base@11.0.18/java.io.PrintStream.newLine(PrintStream.java:625)
java.base@11.0.18/java.io.PrintStream.println(PrintStream.java:883)
hudson.model.Cause$UpstreamCause.print(Cause.java:313)
hudson.model.Cause$UpstreamCause.print(Cause.java:302)
hudson.model.BuildListener.started(BuildListener.java:50)
hudson.model.Run.execute(Run.java:1882)
hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44)
hudson.model.ResourceController.execute(ResourceController.java:107)
hudson.model.Executor.run(Executor.java:449)

Related Objects

Event Timeline

I went to update the Credentials Binding and the Plain Text Credential plugins. Else I guess we gotta rollback.

hashar added a parent task: Restricted Task.Tue, May 16, 3:30 PM
hashar claimed this task.

Looks like it is working now.

Mentioned in SAL (#wikimedia-operations) [2023-05-16T15:36:00Z] <hashar> Some CI jobs started failing after an upgrade of some Jenkins plugins. I have upgraded a couple more and it seems to work now T336775