Page MenuHomePhabricator
Paste P5956

scan sync failure
ActivePublic

Authored by Mattflaschen-WMF on Sep 5 2017, 3:42 PM.
Tags
None
Referenced Files
F9341993: scan sync failure
Sep 5 2017, 3:42 PM
Subscribers
None
mattflaschen@tin:/srv/mediawiki-staging/php-1.30.0-wmf.16$ scap sync 'Prepare to enable RCFilters (WLFilters) on Watchlist'
___ ____
⎛ ⎛ ,----
\ //==--'
_//|,.·//==--' ____________________________
_OO≣=- ︶ ᴹw ⎞_§ ______ ___\ ___\ ,\__ \/ __ \
(∞)_, ) ( | ______/__ \/ /__ / /_/ / /_/ /
¨--¨|| |- ( / ______\____/ \___/ \__^_/ .__/
««_/ «_/ jgs/bd808 /_/
15:27:31 Started scap: Prepare to enable RCFilters (WLFilters) on Watchlist
15:27:54 Copying to tin.eqiad.wmnet from tin.eqiad.wmnet
15:27:54 Started rsync common
15:27:59 Finished rsync common (duration: 00m 05s)
15:27:59 Started cache_git_info
15:28:02 Finished cache_git_info (duration: 00m 03s)
15:28:03 Started l10n-update
15:28:03 Updating ExtensionMessages-1.30.0-wmf.16.php
15:28:04 Updating LocalisationCache for 1.30.0-wmf.16 using 10 thread(s)
15:33:01 Generating JSON versions and md5 files
15:33:20 Finished l10n-update (duration: 05m 17s)
15:33:20 Started sync-masters
15:34:43 ['/usr/bin/scap', 'pull-master', 'tin.eqiad.wmnet'] on naos.codfw.wmnet returned [70]: Could not chdir to home directory /var/lib/mwdeploy: No such file or directory
15:33:21 Copying to naos.codfw.wmnet from tin.eqiad.wmnet
15:33:21 Started rsync master
cannot delete non-empty directory: php-1.30.0-wmf.9/cache/l10n
cannot delete non-empty directory: php-1.30.0-wmf.9/cache/l10n
cannot delete non-empty directory: php-1.30.0-wmf.9/cache
cannot delete non-empty directory: php-1.30.0-wmf.9/cache
cannot delete non-empty directory: php-1.30.0-wmf.9
cannot delete non-empty directory: php-1.30.0-wmf.7/cache/l10n
cannot delete non-empty directory: php-1.30.0-wmf.7/cache/l10n
cannot delete non-empty directory: php-1.30.0-wmf.7/cache
cannot delete non-empty directory: php-1.30.0-wmf.7/cache
cannot delete non-empty directory: php-1.30.0-wmf.7
cannot delete non-empty directory: php-1.30.0-wmf.11/cache/l10n
cannot delete non-empty directory: php-1.30.0-wmf.11/cache/l10n
cannot delete non-empty directory: php-1.30.0-wmf.11/cache
cannot delete non-empty directory: php-1.30.0-wmf.11/cache
cannot delete non-empty directory: php-1.30.0-wmf.11
cannot delete non-empty directory: php-1.30.0-wmf.10/cache/l10n
cannot delete non-empty directory: php-1.30.0-wmf.10/cache/l10n
cannot delete non-empty directory: php-1.30.0-wmf.10/cache
cannot delete non-empty directory: php-1.30.0-wmf.10/cache
cannot delete non-empty directory: php-1.30.0-wmf.10
cannot delete non-empty directory: php-1.30.0-wmf.12/cache/l10n
cannot delete non-empty directory: php-1.30.0-wmf.13/cache/l10n
cannot delete non-empty directory: php-1.30.0-wmf.14/cache/l10n
15:34:13 Finished rsync master (duration: 00m 51s)
15:34:13 Started rebuild CDB staging files
15:34:43 Failure processing (u'/srv/mediawiki-staging/php-1.30.0-wmf.16/cache/l10n', u'l10n_cache-hif-latn.cdb', True)
Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/scap/tasks.py", line 477, in update_l10n_cdb_wrapper
return update_l10n_cdb(*args)
File "/usr/lib/python2.7/dist-packages/scap/utils.py", line 401, in context_wrapper
return func(*args, **kwargs)
File "/usr/lib/python2.7/dist-packages/scap/tasks.py", line 458, in update_l10n_cdb
raise IOError(errno.ENOENT, 'Failed to create CDB', tmp_cdb_path)
IOError: [Errno 2] Failed to create CDB: u'/srv/mediawiki-staging/php-1.30.0-wmf.16/cache/l10n/l10n_cache-hif-latn.cdb.tmp'
15:34:43 Failure processing (u'/srv/mediawiki-staging/php-1.30.0-wmf.16/cache/l10n', u'l10n_cache-mrj.cdb', True)
Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/scap/tasks.py", line 477, in update_l10n_cdb_wrapper
return update_l10n_cdb(*args)
File "/usr/lib/python2.7/dist-packages/scap/utils.py", line 401, in context_wrapper
return func(*args, **kwargs)
File "/usr/lib/python2.7/dist-packages/scap/tasks.py", line 458, in update_l10n_cdb
raise IOError(errno.ENOENT, 'Failed to create CDB', tmp_cdb_path)
IOError: [Errno 2] Failed to create CDB: u'/srv/mediawiki-staging/php-1.30.0-wmf.16/cache/l10n/l10n_cache-mrj.cdb.tmp'
15:34:43 Failure processing (u'/srv/mediawiki-staging/php-1.30.0-wmf.16/cache/l10n', u'l10n_cache-din.cdb', True)
Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/scap/tasks.py", line 477, in update_l10n_cdb_wrapper
return update_l10n_cdb(*args)
File "/usr/lib/python2.7/dist-packages/scap/utils.py", line 401, in context_wrapper
return func(*args, **kwargs)
File "/usr/lib/python2.7/dist-packages/scap/tasks.py", line 458, in update_l10n_cdb
raise IOError(errno.ENOENT, 'Failed to create CDB', tmp_cdb_path)
IOError: [Errno 2] Failed to create CDB: u'/srv/mediawiki-staging/php-1.30.0-wmf.16/cache/l10n/l10n_cache-din.cdb.tmp'
15:34:43 Unhandled error:
Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/scap/cli.py", line 308, in run
exit_status = app.main(app.extra_arguments)
File "/usr/lib/python2.7/dist-packages/scap/main.py", line 416, in main
cache_dir, use_cores, True, self.arguments.mute)
File "/usr/lib/python2.7/dist-packages/scap/utils.py", line 401, in context_wrapper
return func(*args, **kwargs)
File "/usr/lib/python2.7/dist-packages/scap/tasks.py", line 280, in merge_cdb_updates
itertools.repeat(trust_mtime))), 1):
File "/usr/lib/python2.7/multiprocessing/pool.py", line 659, in next
raise value
IOError: [Errno 2] Failed to create CDB: u'/srv/mediawiki-staging/php-1.30.0-wmf.16/cache/l10n/l10n_cache-mrj.cdb.tmp'
15:34:43 cdb-rebuild failed: <IOError> [Errno 2] Failed to create CDB: u'/srv/mediawiki-staging/php-1.30.0-wmf.16/cache/l10n/l10n_cache-mrj.cdb.tmp'
15:34:43 Finished rebuild CDB staging files (duration: 00m 29s)
15:34:43 Unhandled error:
Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/scap/cli.py", line 308, in run
exit_status = app.main(app.extra_arguments)
File "/usr/lib/python2.7/dist-packages/scap/main.py", line 548, in main
verbose=self.verbose
File "/usr/lib/python2.7/dist-packages/scap/utils.py", line 401, in context_wrapper
return func(*args, **kwargs)
File "/usr/lib/python2.7/dist-packages/scap/tasks.py", line 322, in sync_master
'--staging', '--verbose'])
File "/usr/lib/python2.7/subprocess.py", line 540, in check_call
raise CalledProcessError(retcode, cmd)
CalledProcessError: Command '['sudo', '-u', 'l10nupdate', '-n', '--', '/usr/bin/scap', 'cdb-rebuild', '--no-progress', '--staging', '--verbose']' returned non-zero exit status 70
15:34:43 pull-master failed: <CalledProcessError> Command '['sudo', '-u', 'l10nupdate', '-n', '--', '/usr/bin/scap', 'cdb-rebuild', '--no-progress', '--staging', '--verbose']' returned non-zero exit status 70
sync-masters: 100% (ok: 0; fail: 1; left: 0)
15:34:43 1 masters had sync errors
15:34:43 Finished sync-masters (duration: 01m 22s)
15:34:43 Started sync-pull-masters
sync-pull-masters: 100% (ok: 1; fail: 0; left: 0)
15:35:38 Finished sync-pull-masters (duration: 00m 54s)
15:35:38 Started sync-check-canaries
^C15:36:14 Finished sync-check-canaries (duration: 00m 36s)
15:36:14 scap aborted: Prepare to enable RCFilters (WLFilters) on Watchlist (duration: 08m 42s)