We normally use "scap pull" on appservers after hardware maintenance (like T205240) or other downtime to make sure they are in sync with other appservers.
This appears to have stopped working. On mw2181 it fails like this, with mwscript missing:
[mw2181:~] $ scap pull
18:14:34 Copying from deployment.codfw.wmnet to mw2181.codfw.wmnet
18:14:34 Started rsync common
cannot delete non-empty directory: php-1.33.0-wmf.23/cache/l10n
cannot delete non-empty directory: php-1.33.0-wmf.23/cache/l10n
cannot delete non-empty directory: php-1.33.0-wmf.23/cache
cannot delete non-empty directory: php-1.33.0-wmf.23/cache
cannot delete non-empty directory: php-1.33.0-wmf.23
cannot delete non-empty directory: php-1.32.0-wmf.3/cache/l10n
cannot delete non-empty directory: php-1.32.0-wmf.3/cache/l10n
cannot delete non-empty directory: php-1.32.0-wmf.3/cache
cannot delete non-empty directory: php-1.32.0-wmf.3/cache
cannot delete non-empty directory: php-1.32.0-wmf.3
18:14:52 Finished rsync common (duration: 00m 17s)
18:14:52 Started scap-cdb-rebuild
18:14:53 Finished scap-cdb-rebuild (duration: 00m 00s)
18:14:53 Running refreshMessageBlobs.php for each wiki
18:14:53 Last output:
sudo: /usr/local/bin/mwscript: command not found
18:14:53 Unhandled error:
Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/scap/cli.py", line 342, in run
exit_status = app.main(app.extra_arguments)
File "/usr/lib/python2.7/dist-packages/scap/main.py", line 713, in main
tasks.clear_message_blobs()
File "/usr/lib/python2.7/dist-packages/scap/utils.py", line 402, in context_wrapper
return func(*args, **kwargs)
File "/usr/lib/python2.7/dist-packages/scap/tasks.py", line 809, in clear_message_blobs
'/usr/local/bin/mwscript '
File "/usr/lib/python2.7/dist-packages/scap/utils.py", line 402, in context_wrapper
return func(*args, **kwargs)
File "/usr/lib/python2.7/dist-packages/scap/utils.py", line 497, in sudo_check_call
raise subprocess.CalledProcessError(proc.returncode, cmd)
CalledProcessError: Command '/usr/local/bin/mwscript extensions/WikimediaMaintenance/refreshMessageBlobs.php' returned non-zero exit status 1
18:14:53 pull failed: <CalledProcessError> Command '/usr/local/bin/mwscript extensions/WikimediaMaintenance/refreshMessageBlobs.php' returned non-zero exit status 1