Since October 11 (that's the date mentioned on Special:Version on en.wp.beta.wmflabs), the beta cluster doesn't fetch the latest master version of our git repositories.
The beta-code-update-eqiad job in Jenkins runs without any failures, but scap seems to has a problem with a missing dbfile:
https://integration.wikimedia.org/ci/view/Beta/job/beta-scap-eqiad/74056/console
I'm not sure, if this is the cause of the problem (but I think so):
06:04:21 06:04:21 Started scap: beta-scap-eqiad (build #74056)
06:04:22 06:04:22 Copying to deployment-bastion.deployment-prep.eqiad.wmflabs from deployment-bastion.eqiad.wmflabs
06:04:22 06:04:22 Started rsync common
06:04:29 06:04:29 Finished rsync common (duration: 00m 07s)
06:04:30 06:04:30 Last output:
06:04:30 06:04:30 Unhandled error:
06:04:30 Traceback (most recent call last):
06:04:30 File "/mnt/srv/deployment/scap/scap/scap/cli.py", line 284, in run
06:04:30 exit_status = app.main(extra_args)
06:04:30 File "/mnt/srv/deployment/scap/scap/scap/main.py", line 127, in main
06:04:30 tasks.compile_wikiversions('deploy', self.config)
06:04:30 File "/mnt/srv/deployment/scap/scap/scap/utils.py", line 338, in context_wrapper
06:04:30 return func(*args, **kwargs)
06:04:30 File "/mnt/srv/deployment/scap/scap/scap/tasks.py", line 139, in compile_wikiversions
06:04:30 all_dbs = set(line.strip() for line in open(all_dblist_file))
06:04:30 IOError: [Errno 2] No such file or directory: '/srv/mediawiki/all.dblist'
06:04:30 06:04:30 compile-wikiversions failed: <IOError> [Errno 2] No such file or directory: '/srv/mediawiki/all.dblist'
06:04:30 06:04:30 Unhandled error:
06:04:30 Traceback (most recent call last):
06:04:30 File "/mnt/srv/deployment/scap/scap/scap/cli.py", line 284, in run
06:04:30 exit_status = app.main(extra_args)
06:04:30 File "/mnt/srv/deployment/scap/scap/scap/main.py", line 216, in main
06:04:30 return super(Scap, self).main(*extra_args)
06:04:30 File "/mnt/srv/deployment/scap/scap/scap/main.py", line 52, in main
06:04:30 self._before_cluster_sync()
06:04:30 File "/mnt/srv/deployment/scap/scap/scap/main.py", line 231, in _before_cluster_sync
06:04:30 self.get_script_path('compile-wikiversions'))
06:04:30 File "/mnt/srv/deployment/scap/scap/scap/utils.py", line 338, in context_wrapper
06:04:30 return func(*args, **kwargs)
06:04:30 File "/mnt/srv/deployment/scap/scap/scap/utils.py", line 448, in sudo_check_call
06:04:30 raise subprocess.CalledProcessError(proc.returncode, cmd)
06:04:30 CalledProcessError: Command '/srv/deployment/scap/scap/bin/compile-wikiversions' returned non-zero exit status 70
06:04:30 06:04:30 scap failed: CalledProcessError Command '/srv/deployment/scap/scap/bin/compile-wikiversions' returned non-zero exit status 70 (duration: 00m 08s)Btw.: I'm not sure, if this is correct, but Jenkins was unable to send an information email to qa-alert list, which should be investigated, too, I think:
06:04:30 Email was triggered for: Failure - Any 06:04:30 Sending email for trigger: Failure - Any 06:04:30 Sending email to: qa-alerts@lists.wikimedia.org 06:04:37 Connection error sending email, retrying once more in 10 seconds... 06:04:54 Connection error sending email, retrying once more in 10 seconds... 06:05:04 Failed after second try sending email