etcd is not configured and should be attempting to run on tools-k8s-master-01.
This seems harmless but it's cluttering the logs.
Description
Description
Related Objects
Related Objects
Event Timeline
Comment Actions
I heard that this was installed there incorrectly in the past and isn't needed. However, I've heard a lot of things, 😁
Comment Actions
tools-k8s-master-01:~$ systemctl status etcd ● etcd.service - etcd Loaded: loaded (/lib/systemd/system/etcd.service; enabled) Active: activating (auto-restart) (Result: exit-code) since Wed 2018-12-12 14:42:06 UTC; 2s ago Process: 26899 ExecStart=/usr/bin/etcd (code=exited, status=1/FAILURE) Main PID: 26899 (code=exited, status=1/FAILURE) Dec 12 14:42:06 tools-k8s-master-01 systemd[1]: Unit etcd.service entered failed state.
Dec 12 14:43:07 tools-k8s-master-01 systemd[1]: Starting etcd... Dec 12 14:43:07 tools-k8s-master-01 systemd[1]: Started etcd. Dec 12 14:43:07 tools-k8s-master-01 etcd[26959]: recognized and used environment variable ETCD_ADVERTISE_CLIENT_URLS=https://tools-k8s-master-01.tools.eqiad.wmflabs:2379 Dec 12 14:43:07 tools-k8s-master-01 etcd[26959]: recognized and used environment variable ETCD_CERT_FILE=/var/lib/etcd/ssl/certs/cert.pem Dec 12 14:43:07 tools-k8s-master-01 etcd[26959]: recognized and used environment variable ETCD_DATA_DIR=/var/lib/etcd/tools-k8s Dec 12 14:43:07 tools-k8s-master-01 etcd[26959]: recognized and used environment variable ETCD_INITIAL_ADVERTISE_PEER_URLS=http://tools-k8s-master-01.tools.eqiad.wmflabs:2380 Dec 12 14:43:07 tools-k8s-master-01 etcd[26959]: recognized and used environment variable ETCD_INITIAL_CLUSTER=tools-k8s-master-01=http://tools-k8s-master-01.tools.eqiad.wmflabs:2380 Dec 12 14:43:07 tools-k8s-master-01 etcd[26959]: recognized and used environment variable ETCD_INITIAL_CLUSTER_STATE=existing Dec 12 14:43:07 tools-k8s-master-01 etcd[26959]: recognized and used environment variable ETCD_KEY_FILE=/var/lib/etcd/ssl/private_keys/server.key Dec 12 14:43:07 tools-k8s-master-01 etcd[26959]: recognized and used environment variable ETCD_LISTEN_CLIENT_URLS=https://tools-k8s-master-01.tools.eqiad.wmflabs:2379 Dec 12 14:43:07 tools-k8s-master-01 etcd[26959]: recognized and used environment variable ETCD_LISTEN_PEER_URLS=http://tools-k8s-master-01.tools.eqiad.wmflabs:2380 Dec 12 14:43:07 tools-k8s-master-01 etcd[26959]: recognized and used environment variable ETCD_NAME=tools-k8s-master-01 Dec 12 14:43:07 tools-k8s-master-01 etcd[26959]: setting maximum number of CPUs to 2, total number of available CPUs is 2 Dec 12 14:43:07 tools-k8s-master-01 etcd[26959]: the server is already initialized as member before, starting as etcd member... Dec 12 14:43:07 tools-k8s-master-01 etcd[26959]: listening for peers on http://tools-k8s-master-01.tools.eqiad.wmflabs:2380 Dec 12 14:43:07 tools-k8s-master-01 etcd[26959]: clientTLS: cert = /var/lib/etcd/ssl/certs/cert.pem, key = /var/lib/etcd/ssl/private_keys/server.key, ca = , trusted-ca = , client-cert-auth = false Dec 12 14:43:07 tools-k8s-master-01 etcd[26959]: stopping listening for peers on http://tools-k8s-master-01.tools.eqiad.wmflabs:2380 Dec 12 14:43:07 tools-k8s-master-01 etcd[26959]: open /var/lib/etcd/ssl/certs/cert.pem: no such file or directory Dec 12 14:43:07 tools-k8s-master-01 systemd[1]: etcd.service: main process exited, code=exited, status=1/FAILURE Dec 12 14:43:07 tools-k8s-master-01 systemd[1]: Unit etcd.service entered failed state.
tools-k8s-master-01:~4 dpkg -l | grep etcd ii etcd 2.2.1+dfsg-1 amd64 highly-available key value store -- daemon
` tools-k8s-master-01:/var/lib/etcd$ find . -ls 659128 4 drwx------ 6 etcd etcd 4096 Dec 7 2015 . 659151 4 drwx------ 3 etcd etcd 4096 Jun 21 2017 ./tools-k8s 786790 4 drwx------ 4 etcd etcd 4096 Jun 21 2017 ./tools-k8s/member 786792 4 drwx------ 2 etcd etcd 4096 Jan 15 2018 ./tools-k8s/member/wal 787077 62504 -rw------- 1 etcd etcd 64000213 Jan 12 2018 ./tools-k8s/member/wal/000000000000017e-000000000806defc.wal 787085 62504 -rw------- 1 etcd etcd 64000200 Jan 8 2018 ./tools-k8s/member/wal/000000000000017d-0000000007fe83f5.wal 786455 62500 -rw------- 1 etcd etcd 28511448 Jan 16 2018 ./tools-k8s/member/wal/0000000000000180-000000000817950a.wal 787082 62504 -rw------- 1 etcd etcd 64000117 Jan 15 2018 ./tools-k8s/member/wal/000000000000017f-00000000080f3a01.wal 787078 62504 -rw------- 1 etcd etcd 64000163 Jan 5 2018 ./tools-k8s/member/wal/000000000000017c-0000000007f628f1.wal 786791 4 drwx------ 2 etcd etcd 4096 Jan 16 2018 ./tools-k8s/member/snap 787079 3220 -rw-r--r-- 1 etcd etcd 3293972 Jan 16 2018 ./tools-k8s/member/snap/000000000000000c-00000000081acadc.snap 787080 3220 -rw-r--r-- 1 etcd etcd 3293972 Jan 16 2018 ./tools-k8s/member/snap/000000000000000c-00000000081af1ed.snap 787083 3220 -rw-r--r-- 1 etcd etcd 3293972 Jan 16 2018 ./tools-k8s/member/snap/000000000000000c-00000000081aa3cb.snap 786440 3220 -rw-r--r-- 1 etcd etcd 3293972 Jan 16 2018 ./tools-k8s/member/snap/000000000000000c-00000000081b18fe.snap 787081 3220 -rw-r--r-- 1 etcd etcd 3293972 Jan 16 2018 ./tools-k8s/member/snap/000000000000000c-00000000081b400f.snap 659145 4 drwx------ 4 etcd etcd 4096 Dec 6 2015 ./member 659148 4 drwx------ 2 etcd etcd 4096 Dec 6 2015 ./member/wal 659150 316 -rw------- 1 etcd etcd 316495 Dec 6 2015 ./member/wal/0000000000000000-0000000000000000.wal 659146 4 drwx------ 2 etcd etcd 4096 Dec 6 2015 ./member/snap 786793 4 drwx------ 3 etcd etcd 4096 Dec 7 2015 ./default 786856 4 drwx------ 4 etcd etcd 4096 Dec 7 2015 ./default/member 786861 4 drwx------ 2 etcd etcd 4096 Dec 7 2015 ./default/member/wal 786862 100 -rw------- 1 etcd etcd 95992 Dec 7 2015 ./default/member/wal/0000000000000000-0000000000000000.wal 786860 4 drwx------ 2 etcd etcd 4096 Dec 7 2015 ./default/member/snap 656809 4 dr-x------ 2 etcd etcd 4096 Jun 29 2017 ./ssl
tools-k8s-master-01$ systemctl disable etcd Synchronizing state for etcd.service with sysvinit using update-rc.d... Executing /usr/sbin/update-rc.d etcd defaults Executing /usr/sbin/update-rc.d etcd disable insserv: warning: current start runlevel(s) (empty) of script `etcd' overrides LSB defaults (2 3 4 5). insserv: warning: current stop runlevel(s) (0 1 2 3 4 5 6) of script `etcd' overrides LSB defaults (0 1 6). Removed symlink /etc/systemd/system/multi-user.target.wants/etcd.service. tools-k8s-master-01$ puppet agent -t Info: Using configured environment 'production' Info: Retrieving pluginfacts Info: Retrieving plugin Info: Loading facts Info: Caching catalog for tools-k8s-master-01.tools.eqiad.wmflabs Notice: /Stage[main]/Base::Environment/Tidy[/var/tmp/core]: Tidying 0 files Info: Applying configuration version '1544625989' Notice: Applied catalog in 10.35 seconds tools-k8s-master-01$ systemctl status etcd ● etcd.service - etcd Loaded: loaded (/lib/systemd/system/etcd.service; static) Active: inactive (dead) (Result: exit-code) since Wed 2018-12-12 14:45:48 UTC; 1min 10s ago Main PID: 27108 (code=exited, status=1/FAILURE) Dec 12 14:45:41 tools-k8s-master-01 systemd[1]: etcd.service: main process exited, code=exited, status=1/FAILURE Dec 12 14:45:41 tools-k8s-master-01 systemd[1]: Unit etcd.service entered failed state. Dec 12 14:45:48 tools-k8s-master-01 systemd[1]: Stopping etcd... Dec 12 14:45:48 tools-k8s-master-01 systemd[1]: Stopped etcd.
tools-bastion-03$ kubectl get nodes NAME STATUS AGE tools-worker-1001.tools.eqiad.wmflabs Ready 2y tools-worker-1002.tools.eqiad.wmflabs Ready 2y tools-worker-1003.tools.eqiad.wmflabs Ready 2y tools-worker-1004.tools.eqiad.wmflabs Ready 2y tools-worker-1005.tools.eqiad.wmflabs Ready 2y tools-worker-1006.tools.eqiad.wmflabs Ready 2y tools-worker-1007.tools.eqiad.wmflabs Ready 2y tools-worker-1008.tools.eqiad.wmflabs Ready 2y tools-worker-1009.tools.eqiad.wmflabs Ready 2y tools-worker-1010.tools.eqiad.wmflabs Ready,SchedulingDisabled 2y tools-worker-1011.tools.eqiad.wmflabs Ready 2y tools-worker-1012.tools.eqiad.wmflabs Ready,SchedulingDisabled 2y tools-worker-1013.tools.eqiad.wmflabs Ready 2y tools-worker-1014.tools.eqiad.wmflabs Ready 2y tools-worker-1015.tools.eqiad.wmflabs Ready 2y tools-worker-1016.tools.eqiad.wmflabs Ready 2y tools-worker-1017.tools.eqiad.wmflabs Ready 2y tools-worker-1018.tools.eqiad.wmflabs Ready 2y tools-worker-1019.tools.eqiad.wmflabs Ready 2y tools-worker-1020.tools.eqiad.wmflabs Ready,SchedulingDisabled 2y tools-worker-1021.tools.eqiad.wmflabs Ready 2y tools-worker-1022.tools.eqiad.wmflabs Ready,SchedulingDisabled 2y tools-worker-1023.tools.eqiad.wmflabs Ready 2y tools-worker-1025.tools.eqiad.wmflabs Ready 2y tools-worker-1026.tools.eqiad.wmflabs Ready 1y tools-worker-1027.tools.eqiad.wmflabs Ready 1y tools-worker-1028.tools.eqiad.wmflabs Ready,SchedulingDisabled 1y
tools-k8s-master-01$ apt remove etcd Reading package lists... Done Building dependency tree Reading state information... Done The following packages will be REMOVED: etcd 0 upgraded, 0 newly installed, 1 to remove and 3 not upgraded. After this operation, 58.0 MB disk space will be freed. Do you want to continue? [Y/n] y (Reading database ... 65703 files and directories currently installed.) Removing etcd (2.2.1+dfsg-1) ... Processing triggers for man-db (2.7.0.2-5) ...