Page MenuHomePhabricator

Docker CI errors on integration-agent-docker-1020
Closed, DuplicatePublic

Description

Blocking many things :(. Happening on many patches

https://integration.wikimedia.org/ci/job/wmf-quibble-selenium-php72-docker/56310/console

01:33:52 Started by user unknown or anonymous
01:33:52 Running as SYSTEM
01:33:52 Building remotely on integration-agent-docker-1020 (pipelinelib Docker blubber) in workspace /srv/jenkins/workspace/workspace/wmf-quibble-selenium-php72-docker
01:33:53 [wmf-quibble-selenium-php72-docker] $ /bin/bash -xe /tmp/jenkins8692653502146724051.sh
01:33:53 + mkdir -m 2777 -p cache
01:33:53 [wmf-quibble-selenium-php72-docker] $ /bin/bash /tmp/jenkins4392663490209928552.sh
01:33:53 + set -o pipefail
01:33:53 ++ pwd
01:33:53 + exec docker run --volume /srv/jenkins/workspace/workspace/wmf-quibble-selenium-php72-docker/cache:/cache --security-opt seccomp=unconfined --init --rm --label jenkins.job=wmf-quibble-selenium-php72-docker --label jenkins.build=56310 --env-file /dev/fd/63 docker-registry.wikimedia.org/releng/castor:0.2.4 load
01:33:53 ++ /usr/bin/env
01:33:53 ++ egrep -v '^(HOME|SHELL|PATH|LOGNAME|MAIL)='
01:33:53 docker: Got permission denied while trying to connect to the Docker daemon socket at unix:///var/run/docker.sock: Post http://%2Fvar%2Frun%2Fdocker.sock/v1.40/containers/create: dial unix /var/run/docker.sock: connect: permission denied.
01:33:53 See 'docker run --help'.
01:33:53 Build step 'Execute shell' marked build as failure
01:33:53 Recording test results
01:33:53 [PostBuildScript] - [INFO] Executing post build scripts.
01:33:53 [wmf-quibble-selenium-php72-docker] $ /bin/bash -xe /tmp/jenkins6761239936333422219.sh
01:33:53 + find log/ -name 'junit*.xml' -exec gzip '{}' +
01:33:53 find: ‘log/’: No such file or directory
01:33:54 Build step 'Execute Scripts' marked build as failure
01:33:54 [PostBuildScript] - [INFO] Executing post build scripts.
01:33:54 [wmf-quibble-selenium-php72-docker] $ /bin/bash -xe /tmp/jenkins564198118366161153.sh
01:33:54 + find log/ -name 'mw-debug-*.log' -exec gzip '{}' +
01:33:54 find: ‘log/’: No such file or directory
01:33:54 Build step 'Execute Scripts' marked build as failure
01:33:54 Archiving artifacts
01:33:54 [PostBuildScript] - [INFO] Executing post build scripts.
01:33:54 [PostBuildScript] - [INFO] Build does not have any of the results [SUCCESS]. Did not execute build step #0.
01:33:54 [PostBuildScript] - [INFO] Executing post build scripts.
01:33:54 [wmf-quibble-selenium-php72-docker] $ /bin/bash -xe /tmp/jenkins5363195281824434372.sh
01:33:54 + echo 'Clearing /srv/jenkins/workspace/workspace/wmf-quibble-selenium-php72-docker/cache'
01:33:54 Clearing /srv/jenkins/workspace/workspace/wmf-quibble-selenium-php72-docker/cache
01:33:54 [wmf-quibble-selenium-php72-docker] $ /bin/bash /tmp/jenkins1621399303684179276.sh
01:33:54 + set -o pipefail
01:33:54 ++ pwd
01:33:54 + exec docker run --volume /srv/jenkins/workspace/workspace/wmf-quibble-selenium-php72-docker/cache:/cache --security-opt seccomp=unconfined --init --rm --label jenkins.job=wmf-quibble-selenium-php72-docker --label jenkins.build=56310 --env-file /dev/fd/63 docker-registry.wikimedia.org/releng/castor:0.2.1 clear
01:33:54 ++ /usr/bin/env
01:33:54 ++ egrep -v '^(HOME|SHELL|PATH|LOGNAME|MAIL)='
01:33:54 docker: Got permission denied while trying to connect to the Docker daemon socket at unix:///var/run/docker.sock: Post http://%2Fvar%2Frun%2Fdocker.sock/v1.40/containers/create: dial unix /var/run/docker.sock: connect: permission denied.
01:33:54 See 'docker run --help'.
01:33:54 Build step 'Execute Scripts' marked build as failure
01:33:54 [PostBuildScript] - [INFO] Executing post build scripts.
01:33:55 [wmf-quibble-selenium-php72-docker] $ /bin/bash -xe /tmp/jenkins4451850553701261172.sh
01:33:55 + set -euxo pipefail
01:33:55 + docker ps -q --filter label=jenkins.job=wmf-quibble-selenium-php72-docker --filter label=jenkins.build=56310
01:33:55 + xargs --no-run-if-empty docker stop
01:33:55 Got permission denied while trying to connect to the Docker daemon socket at unix:///var/run/docker.sock: Get http://%2Fvar%2Frun%2Fdocker.sock/v1.40/containers/json?filters=%7B%22label%22%3A%7B%22jenkins.build%3D56310%22%3Atrue%2C%22jenkins.job%3Dwmf-quibble-selenium-php72-docker%22%3Atrue%7D%7D: dial unix /var/run/docker.sock: connect: permission denied
01:33:55 Build step 'Execute Scripts' marked build as failure
01:33:55 [PostBuildScript] - [INFO] Executing post build scripts.
01:33:55 [wmf-quibble-selenium-php72-docker] $ /bin/bash /tmp/jenkins497421383676739866.sh
01:33:55 + set -o pipefail
01:33:55 + exec docker run --user=root --volume /srv/jenkins/workspace/workspace/wmf-quibble-selenium-php72-docker:/workspace --entrypoint=/usr/bin/find --security-opt seccomp=unconfined --init --rm --label jenkins.job=wmf-quibble-selenium-php72-docker --label jenkins.build=56310 --env-file /dev/fd/63 docker-registry.wikimedia.org/wikimedia-stretch:latest /workspace -mindepth 1 -delete
01:33:55 ++ egrep -v '^(HOME|SHELL|PATH|LOGNAME|MAIL)='
01:33:55 ++ /usr/bin/env
01:33:55 docker: Got permission denied while trying to connect to the Docker daemon socket at unix:///var/run/docker.sock: Post http://%2Fvar%2Frun%2Fdocker.sock/v1.40/containers/create: dial unix /var/run/docker.sock: connect: permission denied.
01:33:55 See 'docker run --help'.
01:33:55 [wmf-quibble-selenium-php72-docker] $ /bin/bash -xe /tmp/jenkins2390733732134959189.sh
01:33:55 + set -u
01:33:55 + rmdir /srv/jenkins/workspace/workspace/wmf-quibble-selenium-php72-docker
01:33:55 rmdir: failed to remove '/srv/jenkins/workspace/workspace/wmf-quibble-selenium-php72-docker': Directory not empty
01:33:55 Build step 'Execute Scripts' marked build as failure
01:33:55 Finished: FAILURE

Event Timeline

Reedy triaged this task as Unbreak Now! priority.Aug 21 2020, 1:20 AM
Reedy renamed this task from Docker CI errors to Docker CI errors on integration-agent-docker-1020.Aug 21 2020, 1:26 AM
thcipriani lowered the priority of this task from Unbreak Now! to High.Aug 21 2020, 2:08 AM
thcipriani added subscribers: hashar, thcipriani.

Took this agent offline for the time being. It's late here, so leaving for @hashar to investigate. It looks related to something he already ran into: https://sal.toolforge.org/log/E8CfDHQBv7KcG9M-zNvz

Disconnected by thcipriani : https://phabricator.wikimedia.org/T260961

I fixed the provisioning but forgot to reconnect the agent to take in account jenkins-deploy is in the docker group...