Page MenuHomePhabricator

Keyholder does not start on translatewiki.net
Closed, ResolvedPublic

Description

I had rebooted the server and now keyholder doesn't want to start:

Apr 01 18:46:39 web1.translatewiki.net ssh-agent[19054]: bind: No such file or directory
Apr 01 18:46:39 web1.translatewiki.net ssh-agent[19054]: unix_listener: cannot bind to path: /run/keyholder/agent.sock
Apr 01 18:46:39 web1.translatewiki.net sudo[19049]: pam_unix(sudo:session): session closed for user root
Apr 01 18:46:39 web1.translatewiki.net systemd[1]: keyholder-agent.service: Main process exited, code=exited, status=1/FAILURE
Apr 01 18:46:39 web1.translatewiki.net systemd[1]: keyholder-agent.service: Unit entered failed state.
Apr 01 18:46:39 web1.translatewiki.net systemd[1]: keyholder-agent.service: Failed with result 'exit-code'.
Apr 01 18:46:39 web1.translatewiki.net ssh-agent-proxy[19052]: Successfully loaded 1 key(s)
Apr 01 18:46:39 web1.translatewiki.net ssh-agent-proxy[19052]: Initialized and serving requests
Apr 01 18:46:39 web1.translatewiki.net ssh-agent-proxy[19052]: Traceback (most recent call last):
Apr 01 18:46:39 web1.translatewiki.net ssh-agent-proxy[19052]:   File "/usr/local/bin/ssh-agent-proxy", line 301, in <module>
Apr 01 18:46:39 web1.translatewiki.net ssh-agent-proxy[19052]:     main()
Apr 01 18:46:39 web1.translatewiki.net ssh-agent-proxy[19052]:   File "/usr/local/bin/ssh-agent-proxy", line 291, in main
Apr 01 18:46:39 web1.translatewiki.net ssh-agent-proxy[19052]:     server = SshAgentProxyServer(args.bind, args.connect, perms)
Apr 01 18:46:39 web1.translatewiki.net ssh-agent-proxy[19052]:   File "/usr/local/bin/ssh-agent-proxy", line 125, in __init__
Apr 01 18:46:39 web1.translatewiki.net ssh-agent-proxy[19052]:     super().__init__(server_address, SshAgentProxyHandler)
Apr 01 18:46:39 web1.translatewiki.net ssh-agent-proxy[19052]:   File "/usr/lib/python3.5/socketserver.py", line 440, in __init__
Apr 01 18:46:39 web1.translatewiki.net ssh-agent-proxy[19052]:     self.server_bind()
Apr 01 18:46:39 web1.translatewiki.net ssh-agent-proxy[19052]:   File "/usr/lib/python3.5/socketserver.py", line 454, in server_bind
Apr 01 18:46:39 web1.translatewiki.net ssh-agent-proxy[19052]:     self.socket.bind(self.server_address)
Apr 01 18:46:39 web1.translatewiki.net ssh-agent-proxy[19052]: FileNotFoundError: [Errno 2] No such file or directory
Apr 01 18:46:39 web1.translatewiki.net systemd[1]: keyholder-proxy.service: Main process exited, code=exited, status=1/FAILURE
Apr 01 18:46:39 web1.translatewiki.net systemd[1]: keyholder-proxy.service: Unit entered failed state.
Apr 01 18:46:39 web1.translatewiki.net systemd[1]: keyholder-proxy.service: Failed with result 'exit-code'.

Impact

No translation exports can be done.

Event Timeline

Change 500492 had a related patch set uploaded (by Nikerabbit; owner: Nikerabbit):
[translatewiki@master] Keyholder: add RuntimeDirectory=keyholder

https://gerrit.wikimedia.org/r/500492

The patch fixes this. I still need to remember to arm the key after future reboots though.

Change 500492 merged by jenkins-bot:
[translatewiki@master] Keyholder: add RuntimeDirectory=keyholder

https://gerrit.wikimedia.org/r/500492

Nikerabbit removed a project: Patch-For-Review.