Page MenuHomePhabricator
Paste P8477

(An Untitled Masterwork)
ActivePublic

Authored by ema on May 6 2019, 10:43 AM.
Tags
None
Referenced Files
F28939712: raw.txt
May 6 2019, 10:43 AM
Subscribers
None
OK: puppet-merge on rhodium.eqiad.wmnet succeeded
Fetching new commits from https://gerrit.wikimedia.org/r/p/operations/puppet
error: cannot lock ref 'refs/remotes/origin/production': is at 73820b7f34685628be58c2166da5baf16c3830fe but expected da491ce740b81ddfdd43166ab3583dc646c5a89e
From https://gerrit.wikimedia.org/r/p/operations/puppet
! da491ce740..73820b7f34 production -> origin/production (unable to update local ref)
Connection to puppetmaster2001.codfw.wmnet closed.
ERROR: puppet-merge on puppetmaster2001.codfw.wmnet failed
Fetching new commits from https://gerrit.wikimedia.org/r/p/operations/puppet
error: cannot lock ref 'refs/remotes/origin/production': is at 73820b7f34685628be58c2166da5baf16c3830fe but expected da491ce740b81ddfdd43166ab3583dc646c5a89e
From https://gerrit.wikimedia.org/r/p/operations/puppet
! da491ce740..73820b7f34 production -> origin/production (unable to update local ref)
Connection to puppetmaster2002.codfw.wmnet closed.
ERROR: puppet-merge on puppetmaster2002.codfw.wmnet failed
Fetching new commits from https://gerrit.wikimedia.org/r/p/operations/puppet
error: Ref refs/remotes/origin/production is at 73820b7f34685628be58c2166da5baf16c3830fe but expected da491ce740b81ddfdd43166ab3583dc646c5a89e
From https://gerrit.wikimedia.org/r/p/operations/puppet
! da491ce..73820b7 production -> origin/production (unable to update local ref)
Connection to labpuppetmaster1001.wikimedia.org closed.
ERROR: puppet-merge on labpuppetmaster1001.wikimedia.org failed
Fetching new commits from https://gerrit.wikimedia.org/r/p/operations/puppet
error: Ref refs/remotes/origin/production is at 73820b7f34685628be58c2166da5baf16c3830fe but expected da491ce740b81ddfdd43166ab3583dc646c5a89e
From https://gerrit.wikimedia.org/r/p/operations/puppet
! da491ce..73820b7 production -> origin/production (unable to update local ref)
Connection to labpuppetmaster1002.wikimedia.org closed.
ERROR: puppet-merge on labpuppetmaster1002.wikimedia.org failed
Now running conftool-merge to sync any changes to conftool data
Running conftool-sync on /etc/conftool/data
2019-05-06 10:29:06 [INFO] conftool::yaml_log_error: Error parsing yaml file /etc/conftool/etcdrc: [Errno 2] No such file or directory: '/etc/conftool/etcdrc'
2019-05-06 10:29:06 [INFO] conftool::load_files: Loading data for entity mwconfig from /etc/conftool/data
2019-05-06 10:29:06 [INFO] conftool::load_files: Parsing file /etc/conftool/data/mwconfig/data.yaml
2019-05-06 10:29:06 [INFO] conftool::load_files: Loading data for entity discovery from /etc/conftool/data
2019-05-06 10:29:06 [INFO] conftool::load_files: Parsing file /etc/conftool/data/discovery/mediawiki.yaml
2019-05-06 10:29:06 [INFO] conftool::load_files: Parsing file /etc/conftool/data/discovery/services.yaml
2019-05-06 10:29:06 [INFO] conftool::load_files: Loading data for entity service from /etc/conftool/data
2019-05-06 10:29:06 [INFO] conftool::load_files: Parsing file /etc/conftool/data/service/mediawiki.yaml
2019-05-06 10:29:06 [INFO] conftool::load_files: Parsing file /etc/conftool/data/service/services.yaml
2019-05-06 10:29:06 [INFO] conftool::load_files: Parsing file /etc/conftool/data/service/cache.yaml
2019-05-06 10:29:06 [INFO] conftool::load_files: Parsing file /etc/conftool/data/service/misc.yaml
2019-05-06 10:29:06 [INFO] conftool::load_files: Loading data for entity node from /etc/conftool/data
2019-05-06 10:29:06 [INFO] conftool::load_files: Parsing file /etc/conftool/data/node/eqsin.yaml
2019-05-06 10:29:06 [INFO] conftool::load_files: Parsing file /etc/conftool/data/node/codfw.yaml
2019-05-06 10:29:06 [INFO] conftool::load_files: Parsing file /etc/conftool/data/node/ulsfo.yaml
2019-05-06 10:29:06 [INFO] conftool::load_files: Parsing file /etc/conftool/data/node/esams.yaml
2019-05-06 10:29:06 [INFO] conftool::load_files: Parsing file /etc/conftool/data/node/eqiad.yaml
2019-05-06 10:29:06 [INFO] conftool::load: Adding objects for mwconfig
2019-05-06 10:29:06 [INFO] conftool::load: Adding objects for service
2019-05-06 10:29:06 [INFO] conftool::load: Adding objects for discovery
2019-05-06 10:29:06 [INFO] conftool::load: Adding objects for node
2019-05-06 10:29:07 [INFO] conftool::load: Removing stale objects for node
2019-05-06 10:29:07 [INFO] conftool::cleanup: Removing node with tags codfw/scb/cxserver/scb2005.codfw.wmnet
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/conftool/drivers/__init__.py", line 79, in _wrapper
return fn(*args, **kwdargs)
File "/usr/lib/python3/dist-packages/conftool/drivers/etcd.py", line 119, in delete
self.client.delete(key)
File "/usr/lib/python3/dist-packages/etcd/client.py", line 584, in delete
self.key_endpoint + key, self._MDELETE, params=kwds)
File "/usr/lib/python3/dist-packages/etcd/client.py", line 848, in wrapper
return self._handle_server_response(response)
File "/usr/lib/python3/dist-packages/etcd/client.py", line 928, in _handle_server_response
etcd.EtcdError.handle(r)
File "/usr/lib/python3/dist-packages/etcd/__init__.py", line 304, in handle
raise exc(msg, payload)
etcd.EtcdKeyNotFound: Key not found : /conftool/v1/pools/codfw/scb/cxserver/scb2005.codfw.wmnet
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/bin/conftool-sync", line 11, in <module>
load_entry_point('conftool==1.0.1', 'console_scripts', 'conftool-sync')()
File "/usr/lib/python3/dist-packages/conftool/cli/syncer.py", line 232, in main
sync.load()
File "/usr/lib/python3/dist-packages/conftool/cli/syncer.py", line 89, in load
syncers[name].cleanup()
File "/usr/lib/python3/dist-packages/conftool/cli/syncer.py", line 161, in cleanup
obj.delete()
File "/usr/lib/python3/dist-packages/conftool/kvobject.py", line 95, in delete
self.backend.driver.delete(self.key)
File "/usr/lib/python3/dist-packages/conftool/drivers/__init__.py", line 81, in _wrapper
raise BackendError("Backend error: {}".format(e))
conftool.drivers.BackendError: Backend error: Key not found : /conftool/v1/pools/codfw/scb/cxserver/scb2005.codfw.wmnet