Page MenuHomePhabricator
Paste P8296

(An Untitled Masterwork)
ActivePublic

Authored by Bstorm on Mar 27 2019, 4:02 PM.
Tags
None
Referenced Files
F28484769: raw.txt
Mar 27 2019, 4:02 PM
Subscribers
None
ar 27 11:18:41 tools-proxy-03 kube2proxy[10739]: 2019-03-27 11:18:41,474 Service zppixbot/zppixbot/.* is ADDED
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: 2019-03-27 11:24:48,520 An error occurred while watching for changes, starting from scratch
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: 2019-03-27 11:24:48,521 Exception was: ('Connection broken: IncompleteRead(0 bytes read)', IncompleteRead(0 bytes read))
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: Traceback (most recent call last):
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/lib/python3/dist-packages/urllib3/response.py", line 451, in _update_chunk_length
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: self.chunk_left = int(line, 16)
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: ValueError: invalid literal for int() with base 16: b''
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: During handling of the above exception, another exception occurred:
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: Traceback (most recent call last):
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/lib/python3/dist-packages/urllib3/response.py", line 232, in _error_catcher
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: yield
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/lib/python3/dist-packages/urllib3/response.py", line 502, in read_chunked
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: self._update_chunk_length()
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/lib/python3/dist-packages/urllib3/response.py", line 455, in _update_chunk_length
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: raise httplib.IncompleteRead(line)
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: http.client.IncompleteRead: IncompleteRead(0 bytes read)
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: During handling of the above exception, another exception occurred:
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: Traceback (most recent call last):
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/lib/python3/dist-packages/requests/models.py", line 676, in generate
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: for chunk in self.raw.stream(chunk_size, decode_content=True):
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/lib/python3/dist-packages/urllib3/response.py", line 353, in stream
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: for line in self.read_chunked(amt, decode_content=decode_content):
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/lib/python3/dist-packages/urllib3/response.py", line 530, in read_chunked
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: self._original_response.close()
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/lib/python3.4/contextlib.py", line 77, in __exit__
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: self.gen.throw(type, value, traceback)
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/lib/python3/dist-packages/urllib3/response.py", line 250, in _error_catcher
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: raise ProtocolError('Connection broken: %r' % e, e)
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: requests.packages.urllib3.exceptions.ProtocolError: ('Connection broken: IncompleteRead(0 bytes read)', IncompleteRead(0 bytes read))
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: During handling of the above exception, another exception occurred:
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: Traceback (most recent call last):
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/local/sbin/kube2proxy", line 100, in services
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: for line in resp.iter_lines():
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/lib/python3/dist-packages/requests/models.py", line 720, in iter_lines
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: for chunk in self.iter_content(chunk_size=chunk_size, decode_unicode=decode_unicode):
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/lib/python3/dist-packages/requests/models.py", line 679, in generate
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: raise ChunkedEncodingError(e)
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: requests.exceptions.ChunkedEncodingError: ('Connection broken: IncompleteRead(0 bytes read)', IncompleteRead(0 bytes read))
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: 2019-03-27 11:24:48,524 Resetting dropped connection: k8s-master.tools.wmflabs.org
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: Traceback (most recent call last):
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/lib/python3/dist-packages/urllib3/connection.py", line 142, in _new_conn
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: (self.host, self.port), self.timeout, **extra_kw)
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/lib/python3/dist-packages/urllib3/util/connection.py", line 98, in create_connection
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: raise err
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/lib/python3/dist-packages/urllib3/util/connection.py", line 88, in create_connection
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: sock.connect(sa)
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: ConnectionRefusedError: [Errno 111] Connection refused
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: During handling of the above exception, another exception occurred:
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: Traceback (most recent call last):
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 595, in urlopen
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: chunked=chunked)
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 352, in _make_request
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: self._validate_conn(conn)
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 833, in _validate_conn
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: conn.connect()
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/lib/python3/dist-packages/urllib3/connection.py", line 254, in connect
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: conn = self._new_conn()
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/lib/python3/dist-packages/urllib3/connection.py", line 151, in _new_conn
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: self, "Failed to establish a new connection: %s" % e)
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: requests.packages.urllib3.exceptions.NewConnectionError: <requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f91ff36d198>: Failed to establish a new connection: [Errno 111] Connection refused
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: During handling of the above exception, another exception occurred:
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: Traceback (most recent call last):
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/lib/python3/dist-packages/requests/adapters.py", line 423, in send
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: timeout=timeout
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 640, in urlopen
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: _stacktrace=sys.exc_info()[2])
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/lib/python3/dist-packages/urllib3/util/retry.py", line 287, in increment
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: raise MaxRetryError(_pool, url, error or ResponseError(cause))
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: requests.packages.urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='k8s-master.tools.wmflabs.org', port=6443): Max retries exceeded with url: /api/v1/services?labelSelector=tools.wmflabs.org%2Fwebservice%3Dtrue (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f91ff36d198>: Failed to establish a new connection: [Errno 111] Connection refused',))
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: During handling of the above exception, another exception occurred:
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: Traceback (most recent call last):
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/local/sbin/kube2proxy", line 235, in <module>
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: main()
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/local/sbin/kube2proxy", line 230, in main
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: for service in kubecl.services:
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/local/sbin/kube2proxy", line 95, in services
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: for service in self.sync_services():
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/local/sbin/kube2proxy", line 69, in sync_services
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: services = self.get_services()
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/local/sbin/kube2proxy", line 44, in get_services
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: params=self.base_params)
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/lib/python3/dist-packages/requests/sessions.py", line 488, in get
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: return self.request('GET', url, **kwargs)
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/lib/python3/dist-packages/requests/sessions.py", line 475, in request
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: resp = self.send(prep, **send_kwargs)
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/lib/python3/dist-packages/requests/sessions.py", line 596, in send
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: r = adapter.send(request, **kwargs)
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: File "/usr/lib/python3/dist-packages/requests/adapters.py", line 487, in send
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: raise ConnectionError(e, request=request)
Mar 27 11:24:48 tools-proxy-03 kube2proxy[10739]: requests.exceptions.ConnectionError: HTTPSConnectionPool(host='k8s-master.tools.wmflabs.org', port=6443): Max retries exceeded with url: /api/v1/services?labelSelector=tools.wmflabs.org%2Fwebservice%3Dtrue (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f91ff36d198>: Failed to establish a new connection: [Errno 111] Connection refused',))
Mar 27 11:24:48 tools-proxy-03 systemd[1]: kube2proxy.service: main process exited, code=exited, status=1/FAILURE
Mar 27 11:24:48 tools-proxy-03 systemd[1]: Unit kube2proxy.service entered failed state.
Mar 27 11:24:48 tools-proxy-03 systemd[1]: kube2proxy.service holdoff time over, scheduling restart.
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: 2019-03-27 11:24:49,000 Starting new HTTPS connection (1): k8s-master.tools.wmflabs.org
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: Traceback (most recent call last):
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: File "/usr/lib/python3/dist-packages/urllib3/connection.py", line 142, in _new_conn
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: (self.host, self.port), self.timeout, **extra_kw)
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: File "/usr/lib/python3/dist-packages/urllib3/util/connection.py", line 98, in create_connection
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: raise err
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: File "/usr/lib/python3/dist-packages/urllib3/util/connection.py", line 88, in create_connection
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: sock.connect(sa)
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: ConnectionRefusedError: [Errno 111] Connection refused
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: During handling of the above exception, another exception occurred:
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: Traceback (most recent call last):
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 595, in urlopen
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: chunked=chunked)
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 352, in _make_request
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: self._validate_conn(conn)
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 833, in _validate_conn
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: conn.connect()
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: File "/usr/lib/python3/dist-packages/urllib3/connection.py", line 254, in connect
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: conn = self._new_conn()
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: File "/usr/lib/python3/dist-packages/urllib3/connection.py", line 151, in _new_conn
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: self, "Failed to establish a new connection: %s" % e)
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: requests.packages.urllib3.exceptions.NewConnectionError: <requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7fcf9f202128>: Failed to establish a new connection: [Errno 111] Connection refused
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: During handling of the above exception, another exception occurred:
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: Traceback (most recent call last):
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: File "/usr/lib/python3/dist-packages/requests/adapters.py", line 423, in send
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: timeout=timeout
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 640, in urlopen
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: _stacktrace=sys.exc_info()[2])
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: File "/usr/lib/python3/dist-packages/urllib3/util/retry.py", line 287, in increment
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: raise MaxRetryError(_pool, url, error or ResponseError(cause))
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: requests.packages.urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='k8s-master.tools.wmflabs.org', port=6443): Max retries exceeded with url: /api/v1/services?labelSelector=tools.wmflabs.org%2Fwebservice%3Dtrue (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7fcf9f202128>: Failed to establish a new connection: [Errno 111] Connection refused',))
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: During handling of the above exception, another exception occurred:
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: Traceback (most recent call last):
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: File "/usr/local/sbin/kube2proxy", line 235, in <module>
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: main()
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: File "/usr/local/sbin/kube2proxy", line 230, in main
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: for service in kubecl.services:
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: File "/usr/local/sbin/kube2proxy", line 95, in services
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: for service in self.sync_services():
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: File "/usr/local/sbin/kube2proxy", line 69, in sync_services
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: services = self.get_services()
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: File "/usr/local/sbin/kube2proxy", line 44, in get_services
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: params=self.base_params)
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: File "/usr/lib/python3/dist-packages/requests/sessions.py", line 488, in get
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: return self.request('GET', url, **kwargs)
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: File "/usr/lib/python3/dist-packages/requests/sessions.py", line 475, in request
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: resp = self.send(prep, **send_kwargs)
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: File "/usr/lib/python3/dist-packages/requests/sessions.py", line 596, in send
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: r = adapter.send(request, **kwargs)
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: File "/usr/lib/python3/dist-packages/requests/adapters.py", line 487, in send
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: raise ConnectionError(e, request=request)
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24000]: requests.exceptions.ConnectionError: HTTPSConnectionPool(host='k8s-master.tools.wmflabs.org', port=6443): Max retries exceeded with url: /api/v1/services?labelSelector=tools.wmflabs.org%2Fwebservice%3Dtrue (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7fcf9f202128>: Failed to establish a new connection: [Errno 111] Connection refused',))
Mar 27 11:24:49 tools-proxy-03 systemd[1]: kube2proxy.service: main process exited, code=exited, status=1/FAILURE
Mar 27 11:24:49 tools-proxy-03 systemd[1]: Unit kube2proxy.service entered failed state.
Mar 27 11:24:49 tools-proxy-03 systemd[1]: kube2proxy.service holdoff time over, scheduling restart.
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: 2019-03-27 11:24:49,486 Starting new HTTPS connection (1): k8s-master.tools.wmflabs.org
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: Traceback (most recent call last):
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: File "/usr/lib/python3/dist-packages/urllib3/connection.py", line 142, in _new_conn
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: (self.host, self.port), self.timeout, **extra_kw)
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: File "/usr/lib/python3/dist-packages/urllib3/util/connection.py", line 98, in create_connection
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: raise err
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: File "/usr/lib/python3/dist-packages/urllib3/util/connection.py", line 88, in create_connection
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: sock.connect(sa)
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: ConnectionRefusedError: [Errno 111] Connection refused
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: During handling of the above exception, another exception occurred:
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: Traceback (most recent call last):
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 595, in urlopen
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: chunked=chunked)
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 352, in _make_request
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: self._validate_conn(conn)
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 833, in _validate_conn
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: conn.connect()
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: File "/usr/lib/python3/dist-packages/urllib3/connection.py", line 254, in connect
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: conn = self._new_conn()
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: File "/usr/lib/python3/dist-packages/urllib3/connection.py", line 151, in _new_conn
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: self, "Failed to establish a new connection: %s" % e)
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: requests.packages.urllib3.exceptions.NewConnectionError: <requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7fbac864b198>: Failed to establish a new connection: [Errno 111] Connection refused
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: During handling of the above exception, another exception occurred:
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: Traceback (most recent call last):
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: File "/usr/lib/python3/dist-packages/requests/adapters.py", line 423, in send
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: timeout=timeout
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 640, in urlopen
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: _stacktrace=sys.exc_info()[2])
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: File "/usr/lib/python3/dist-packages/urllib3/util/retry.py", line 287, in increment
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: raise MaxRetryError(_pool, url, error or ResponseError(cause))
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: requests.packages.urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='k8s-master.tools.wmflabs.org', port=6443): Max retries exceeded with url: /api/v1/services?labelSelector=tools.wmflabs.org%2Fwebservice%3Dtrue (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7fbac864b198>: Failed to establish a new connection: [Errno 111] Connection refused',))
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: During handling of the above exception, another exception occurred:
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: Traceback (most recent call last):
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: File "/usr/local/sbin/kube2proxy", line 235, in <module>
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: main()
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: File "/usr/local/sbin/kube2proxy", line 230, in main
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: for service in kubecl.services:
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: File "/usr/local/sbin/kube2proxy", line 95, in services
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: for service in self.sync_services():
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: File "/usr/local/sbin/kube2proxy", line 69, in sync_services
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: services = self.get_services()
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: File "/usr/local/sbin/kube2proxy", line 44, in get_services
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: params=self.base_params)
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: File "/usr/lib/python3/dist-packages/requests/sessions.py", line 488, in get
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: return self.request('GET', url, **kwargs)
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: File "/usr/lib/python3/dist-packages/requests/sessions.py", line 475, in request
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: resp = self.send(prep, **send_kwargs)
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: File "/usr/lib/python3/dist-packages/requests/sessions.py", line 596, in send
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: r = adapter.send(request, **kwargs)
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: File "/usr/lib/python3/dist-packages/requests/adapters.py", line 487, in send
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: raise ConnectionError(e, request=request)
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24012]: requests.exceptions.ConnectionError: HTTPSConnectionPool(host='k8s-master.tools.wmflabs.org', port=6443): Max retries exceeded with url: /api/v1/services?labelSelector=tools.wmflabs.org%2Fwebservice%3Dtrue (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7fbac864b198>: Failed to establish a new connection: [Errno 111] Connection refused',))
Mar 27 11:24:49 tools-proxy-03 systemd[1]: kube2proxy.service: main process exited, code=exited, status=1/FAILURE
Mar 27 11:24:49 tools-proxy-03 systemd[1]: Unit kube2proxy.service entered failed state.
Mar 27 11:24:49 tools-proxy-03 systemd[1]: kube2proxy.service holdoff time over, scheduling restart.
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24015]: 2019-03-27 11:24:49,992 Starting new HTTPS connection (1): k8s-master.tools.wmflabs.org
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24015]: Traceback (most recent call last):
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24015]: File "/usr/lib/python3/dist-packages/urllib3/connection.py", line 142, in _new_conn
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24015]: (self.host, self.port), self.timeout, **extra_kw)
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24015]: File "/usr/lib/python3/dist-packages/urllib3/util/connection.py", line 98, in create_connection
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24015]: raise err
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24015]: File "/usr/lib/python3/dist-packages/urllib3/util/connection.py", line 88, in create_connection
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24015]: sock.connect(sa)
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24015]: ConnectionRefusedError: [Errno 111] Connection refused
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24015]: During handling of the above exception, another exception occurred:
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24015]: Traceback (most recent call last):
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24015]: File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 595, in urlopen
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24015]: chunked=chunked)
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24015]: File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 352, in _make_request
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24015]: self._validate_conn(conn)
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24015]: File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 833, in _validate_conn
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24015]: conn.connect()
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24015]: File "/usr/lib/python3/dist-packages/urllib3/connection.py", line 254, in connect
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24015]: conn = self._new_conn()
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24015]: File "/usr/lib/python3/dist-packages/urllib3/connection.py", line 151, in _new_conn
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24015]: self, "Failed to establish a new connection: %s" % e)
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24015]: requests.packages.urllib3.exceptions.NewConnectionError: <requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7fc0c5baa128>: Failed to establish a new connection: [Errno 111] Connection refused
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24015]: During handling of the above exception, another exception occurred:
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24015]: Traceback (most recent call last):
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24015]: File "/usr/lib/python3/dist-packages/requests/adapters.py", line 423, in send
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24015]: timeout=timeout
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24015]: File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 640, in urlopen
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24015]: _stacktrace=sys.exc_info()[2])
Mar 27 11:24:49 tools-proxy-03 kube2proxy[24015]: File "/usr/lib/python3/dist-packages/urllib3/util/retry.py", line 287, in increment
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24015]: raise MaxRetryError(_pool, url, error or ResponseError(cause))
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24015]: requests.packages.urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='k8s-master.tools.wmflabs.org', port=6443): Max retries exceeded with url: /api/v1/services?labelSelector=tools.wmflabs.org%2Fwebservice%3Dtrue (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7fc0c5baa128>: Failed to establish a new connection: [Errno 111] Connection refused',))
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24015]: During handling of the above exception, another exception occurred:
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24015]: Traceback (most recent call last):
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24015]: File "/usr/local/sbin/kube2proxy", line 235, in <module>
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24015]: main()
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24015]: File "/usr/local/sbin/kube2proxy", line 230, in main
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24015]: for service in kubecl.services:
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24015]: File "/usr/local/sbin/kube2proxy", line 95, in services
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24015]: for service in self.sync_services():
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24015]: File "/usr/local/sbin/kube2proxy", line 69, in sync_services
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24015]: services = self.get_services()
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24015]: File "/usr/local/sbin/kube2proxy", line 44, in get_services
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24015]: params=self.base_params)
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24015]: File "/usr/lib/python3/dist-packages/requests/sessions.py", line 488, in get
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24015]: return self.request('GET', url, **kwargs)
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24015]: File "/usr/lib/python3/dist-packages/requests/sessions.py", line 475, in request
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24015]: resp = self.send(prep, **send_kwargs)
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24015]: File "/usr/lib/python3/dist-packages/requests/sessions.py", line 596, in send
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24015]: r = adapter.send(request, **kwargs)
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24015]: File "/usr/lib/python3/dist-packages/requests/adapters.py", line 487, in send
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24015]: raise ConnectionError(e, request=request)
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24015]: requests.exceptions.ConnectionError: HTTPSConnectionPool(host='k8s-master.tools.wmflabs.org', port=6443): Max retries exceeded with url: /api/v1/services?labelSelector=tools.wmflabs.org%2Fwebservice%3Dtrue (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7fc0c5baa128>: Failed to establish a new connection: [Errno 111] Connection refused',))
Mar 27 11:24:50 tools-proxy-03 systemd[1]: kube2proxy.service: main process exited, code=exited, status=1/FAILURE
Mar 27 11:24:50 tools-proxy-03 systemd[1]: Unit kube2proxy.service entered failed state.
Mar 27 11:24:50 tools-proxy-03 systemd[1]: kube2proxy.service holdoff time over, scheduling restart.
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: 2019-03-27 11:24:50,509 Starting new HTTPS connection (1): k8s-master.tools.wmflabs.org
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: Traceback (most recent call last):
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: File "/usr/lib/python3/dist-packages/urllib3/connection.py", line 142, in _new_conn
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: (self.host, self.port), self.timeout, **extra_kw)
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: File "/usr/lib/python3/dist-packages/urllib3/util/connection.py", line 98, in create_connection
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: raise err
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: File "/usr/lib/python3/dist-packages/urllib3/util/connection.py", line 88, in create_connection
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: sock.connect(sa)
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: ConnectionRefusedError: [Errno 111] Connection refused
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: During handling of the above exception, another exception occurred:
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: Traceback (most recent call last):
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 595, in urlopen
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: chunked=chunked)
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 352, in _make_request
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: self._validate_conn(conn)
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 833, in _validate_conn
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: conn.connect()
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: File "/usr/lib/python3/dist-packages/urllib3/connection.py", line 254, in connect
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: conn = self._new_conn()
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: File "/usr/lib/python3/dist-packages/urllib3/connection.py", line 151, in _new_conn
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: self, "Failed to establish a new connection: %s" % e)
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: requests.packages.urllib3.exceptions.NewConnectionError: <requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7fc06745b198>: Failed to establish a new connection: [Errno 111] Connection refused
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: During handling of the above exception, another exception occurred:
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: Traceback (most recent call last):
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: File "/usr/lib/python3/dist-packages/requests/adapters.py", line 423, in send
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: timeout=timeout
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 640, in urlopen
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: _stacktrace=sys.exc_info()[2])
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: File "/usr/lib/python3/dist-packages/urllib3/util/retry.py", line 287, in increment
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: raise MaxRetryError(_pool, url, error or ResponseError(cause))
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: requests.packages.urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='k8s-master.tools.wmflabs.org', port=6443): Max retries exceeded with url: /api/v1/services?labelSelector=tools.wmflabs.org%2Fwebservice%3Dtrue (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7fc06745b198>: Failed to establish a new connection: [Errno 111] Connection refused',))
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: During handling of the above exception, another exception occurred:
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: Traceback (most recent call last):
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: File "/usr/local/sbin/kube2proxy", line 235, in <module>
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: main()
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: File "/usr/local/sbin/kube2proxy", line 230, in main
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: for service in kubecl.services:
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: File "/usr/local/sbin/kube2proxy", line 95, in services
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: for service in self.sync_services():
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: File "/usr/local/sbin/kube2proxy", line 69, in sync_services
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: services = self.get_services()
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: File "/usr/local/sbin/kube2proxy", line 44, in get_services
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: params=self.base_params)
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: File "/usr/lib/python3/dist-packages/requests/sessions.py", line 488, in get
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: return self.request('GET', url, **kwargs)
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: File "/usr/lib/python3/dist-packages/requests/sessions.py", line 475, in request
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: resp = self.send(prep, **send_kwargs)
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: File "/usr/lib/python3/dist-packages/requests/sessions.py", line 596, in send
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: r = adapter.send(request, **kwargs)
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: File "/usr/lib/python3/dist-packages/requests/adapters.py", line 487, in send
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: raise ConnectionError(e, request=request)
Mar 27 11:24:50 tools-proxy-03 kube2proxy[24018]: requests.exceptions.ConnectionError: HTTPSConnectionPool(host='k8s-master.tools.wmflabs.org', port=6443): Max retries exceeded with url: /api/v1/services?labelSelector=tools.wmflabs.org%2Fwebservice%3Dtrue (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7fc06745b198>: Failed to establish a new connection: [Errno 111] Connection refused',))
Mar 27 11:24:50 tools-proxy-03 systemd[1]: kube2proxy.service: main process exited, code=exited, status=1/FAILURE
Mar 27 11:24:50 tools-proxy-03 systemd[1]: Unit kube2proxy.service entered failed state.
Mar 27 11:24:50 tools-proxy-03 systemd[1]: kube2proxy.service holdoff time over, scheduling restart.
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: 2019-03-27 11:24:51,008 Starting new HTTPS connection (1): k8s-master.tools.wmflabs.org
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: Traceback (most recent call last):
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: File "/usr/lib/python3/dist-packages/urllib3/connection.py", line 142, in _new_conn
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: (self.host, self.port), self.timeout, **extra_kw)
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: File "/usr/lib/python3/dist-packages/urllib3/util/connection.py", line 98, in create_connection
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: raise err
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: File "/usr/lib/python3/dist-packages/urllib3/util/connection.py", line 88, in create_connection
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: sock.connect(sa)
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: ConnectionRefusedError: [Errno 111] Connection refused
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: During handling of the above exception, another exception occurred:
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: Traceback (most recent call last):
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 595, in urlopen
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: chunked=chunked)
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 352, in _make_request
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: self._validate_conn(conn)
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 833, in _validate_conn
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: conn.connect()
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: File "/usr/lib/python3/dist-packages/urllib3/connection.py", line 254, in connect
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: conn = self._new_conn()
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: File "/usr/lib/python3/dist-packages/urllib3/connection.py", line 151, in _new_conn
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: self, "Failed to establish a new connection: %s" % e)
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: requests.packages.urllib3.exceptions.NewConnectionError: <requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7fc6ee814128>: Failed to establish a new connection: [Errno 111] Connection refused
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: During handling of the above exception, another exception occurred:
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: Traceback (most recent call last):
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: File "/usr/lib/python3/dist-packages/requests/adapters.py", line 423, in send
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: timeout=timeout
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 640, in urlopen
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: _stacktrace=sys.exc_info()[2])
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: File "/usr/lib/python3/dist-packages/urllib3/util/retry.py", line 287, in increment
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: raise MaxRetryError(_pool, url, error or ResponseError(cause))
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: requests.packages.urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='k8s-master.tools.wmflabs.org', port=6443): Max retries exceeded with url: /api/v1/services?labelSelector=tools.wmflabs.org%2Fwebservice%3Dtrue (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7fc6ee814128>: Failed to establish a new connection: [Errno 111] Connection refused',))
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: During handling of the above exception, another exception occurred:
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: Traceback (most recent call last):
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: File "/usr/local/sbin/kube2proxy", line 235, in <module>
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: main()
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: File "/usr/local/sbin/kube2proxy", line 230, in main
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: for service in kubecl.services:
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: File "/usr/local/sbin/kube2proxy", line 95, in services
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: for service in self.sync_services():
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: File "/usr/local/sbin/kube2proxy", line 69, in sync_services
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: services = self.get_services()
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: File "/usr/local/sbin/kube2proxy", line 44, in get_services
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: params=self.base_params)
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: File "/usr/lib/python3/dist-packages/requests/sessions.py", line 488, in get
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: return self.request('GET', url, **kwargs)
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: File "/usr/lib/python3/dist-packages/requests/sessions.py", line 475, in request
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: resp = self.send(prep, **send_kwargs)
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: File "/usr/lib/python3/dist-packages/requests/sessions.py", line 596, in send
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: r = adapter.send(request, **kwargs)
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: File "/usr/lib/python3/dist-packages/requests/adapters.py", line 487, in send
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: raise ConnectionError(e, request=request)
Mar 27 11:24:51 tools-proxy-03 kube2proxy[24021]: requests.exceptions.ConnectionError: HTTPSConnectionPool(host='k8s-master.tools.wmflabs.org', port=6443): Max retries exceeded with url: /api/v1/services?labelSelector=tools.wmflabs.org%2Fwebservice%3Dtrue (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7fc6ee814128>: Failed to establish a new connection: [Errno 111] Connection refused',))
Mar 27 11:24:51 tools-proxy-03 systemd[1]: kube2proxy.service: main process exited, code=exited, status=1/FAILURE
Mar 27 11:24:51 tools-proxy-03 systemd[1]: Unit kube2proxy.service entered failed state.
Mar 27 11:24:51 tools-proxy-03 systemd[1]: kube2proxy.service holdoff time over, scheduling restart.
Mar 27 11:24:51 tools-proxy-03 systemd[1]: kube2proxy.service start request repeated too quickly, refusing to start.
Mar 27 11:24:51 tools-proxy-03 systemd[1]: Unit kube2proxy.service entered failed state.