Page MenuHomePhabricator

publishing to fails: rsync command not found
Closed, ResolvedPublic


Spotted on various builds such as

08:15:53 Fetching from:
08:15:53 - Instance...:
08:15:53 - Workspace..: /srv/jenkins/workspace/workspace/mwext-phpunit-coverage-docker-publish
08:15:53 - Subdir.....: cover
08:15:53 + rsync --archive --stats --compress '--rsh=/usr/bin/ssh -a -T -o ConnectTimeout=6 -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no' jenkins-deploy@ .
08:15:53 Warning: Permanently added '' (ECDSA) to the list of known hosts.
08:15:54 bash: line 1: rsync: command not found
08:15:54 rsync: connection unexpectedly closed (0 bytes received so far) [Receiver]
08:15:54 rsync error: error in rsync protocol data stream (code 12) at io.c(235) [Receiver=3.1.3]
08:15:54 Build step 'Execute shell' marked build as failure

MediaWiki core documentation was last published on Jan 26 2022 19:12:04. That is an aftermath of migrating to Bullseye T252071

Event Timeline

hashar triaged this task as Unbreak Now! priority.Jan 27 2022, 8:40 AM
integration-cumin:~$ sudo cumin --force 'name:docker' 'which rsync'
18 hosts will be targeted:
FORCE mode enabled, continuing without confirmation
===== NODE GROUP =====                                                                        
----- OUTPUT of 'which rsync' -----                                                           
PASS |██                                   |   6% (1/18) [00:00<00:13,  1.26hosts/s]          
FAIL |██████████████████████████████████  |  94% (17/18) [00:00<00:00, 21.10hosts/s]
94.4% (17/18) of nodes failed to execute command 'which rsync': integration-agent-docker-[1023-1039]
5.6% (1/18) success ratio (< 100.0% threshold) for command: 'which rsync'. Aborting.:
5.6% (1/18) success ratio (< 100.0% threshold) of nodes successfully executed all commands. Aborting.:

So rsync is gone somehow :-\\

From the host that works:

# aptitude why rsync
i   git-fat Depends rsync

However git-fat is no more available on Bullseye / T275873 and thus as a side effect we no more have rsync. Regardless it should be marked as an explicit dependency.

Change 757613 had a related patch set uploaded (by Hashar; author: Hashar):

[operations/puppet@production] ci: ensure rsync is on all WMCS CI agents

Change 757613 merged by Muehlenhoff:

[operations/puppet@production] ci: ensure rsync is on all WMCS CI agents

Mentioned in SAL (#wikimedia-releng) [2022-01-27T09:16:54Z] <hashar> integration: cumin --force 'name:docker' 'apt install rsync' # T300236


rsync_has_vanished.png (442×951 px, 165 KB)

The build failed on the 1023+ hosts which are the new instances.

Missing docs will be regenerated as branches are updated.