On our last deployment for kartotherian to maps cluster scap throws this error:
jgiannelos@deploy1002:/srv/deployment/kartotherian/deploy$ scap deploy-log -- Opening log file: '/srv/deployment/kartotherian/deploy/scap/log/scap-sync-2021-09-28-0009.log' 18:18:02 [deploy1002] Started deploy [kartotherian/deploy@0a38bc5] 18:18:02 [deploy1002] Deploying Rev: scap/sync/2021-09-28/0009^{} = 04d2df495685f09f8b931840ff438b37c4ab3257 18:18:02 [deploy1002] Started deploy [kartotherian/deploy@0a38bc5]: tegola: use eqiad discovery endpoin 18:18:02 [deploy1002] == DEFAULT == :* maps1010.eqiad.wmnet 18:18:03 [maps1010.eqiad.wmnet] Unhandled error: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/scap/cli.py", line 352, in run exit_status = app.main(app.extra_arguments) File "/usr/lib/python3/dist-packages/scap/deploy.py", line 157, in main getattr(self, stage)() File "/usr/lib/python3/dist-packages/scap/deploy.py", line 252, in config_diff overrides=overrides, File "/usr/lib/python3/dist-packages/scap/template.py", line 87, in __init__ env_args = self._make_env_args(loader, erb_syntax, output_format) File "/usr/lib/python3/dist-packages/scap/template.py", line 95, in _make_env_args loader = {n: f.decode("utf-8") for n, f in loader.items()} File "/usr/lib/python3/dist-packages/scap/template.py", line 95, in <dictcomp> loader = {n: f.decode("utf-8") for n, f in loader.items()} AttributeError: 'str' object has no attribute 'decode' 18:18:03 [maps1010.eqiad.wmnet] deploy-local failed: <AttributeError> {} 18:18:03 [deploy1002] [u'/usr/bin/scap', u'deploy-local', u'-v', u'--repo', u'kartotherian/deploy', u'-g', u'default', u'config_diff', u'--refresh-config'] on maps1010.eqiad.wmnet returned [70]: Unhandled error: deploy-local failed: <AttributeError> {} 18:18:03 [deploy1002] 1 targets had deploy errors 18:18:03 [deploy1002] 1 targets failed 18:18:03 [deploy1002] 1 of 1 default targets failed, exceeding limit
At first we thought its one of the variables that we changed but it failed even for a deployment version that was previously working.