Page MenuHomePhabricator
Files F34945327

kubernetes1014_2.log
JMeybohm
Actions

Authored By
JMeybohm
Feb 8 2022, 9:59 AM
Size
18 KB
Referenced Files
None
Subscribers
None

kubernetes1014_2.log
View Options

root@deploy1002:~# kubectl describe node kubernetes1014.eqiad.wmnet
Name: kubernetes1014.eqiad.wmnet
Roles: <none>
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
failure-domain.beta.kubernetes.io/region=eqiad
failure-domain.beta.kubernetes.io/zone=row-d
kubernetes.io/arch=amd64
kubernetes.io/hostname=kubernetes1014.eqiad.wmnet
kubernetes.io/os=linux
node.kubernetes.io/disk-type=ssd
Annotations: node.alpha.kubernetes.io/ttl: 0
projectcalico.org/IPv4Address: 10.64.48.230/22
projectcalico.org/IPv6Address: 2620:0:861:107:10:64:48:230/64
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Tue, 23 Mar 2021 09:53:07 +0000
Taints: node.kubernetes.io/not-ready:NoExecute
node.kubernetes.io/not-ready:NoSchedule
node.kubernetes.io/unschedulable:NoSchedule
Unschedulable: true
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
NetworkUnavailable False Thu, 09 Dec 2021 14:34:47 +0000 Thu, 09 Dec 2021 14:34:47 +0000 CalicoIsUp Calico is running on this
node
MemoryPressure False Mon, 07 Feb 2022 06:26:37 +0000 Tue, 23 Mar 2021 09:53:07 +0000 KubeletHasSufficientMemory kubelet has sufficient mem
ory available
DiskPressure False Mon, 07 Feb 2022 06:26:37 +0000 Wed, 29 Sep 2021 07:28:27 +0000 KubeletHasNoDiskPressure kubelet has no disk pressu
re
PIDPressure False Mon, 07 Feb 2022 06:26:37 +0000 Tue, 23 Mar 2021 09:53:07 +0000 KubeletHasSufficientPID kubelet has sufficient PID
available
Ready False Mon, 07 Feb 2022 06:26:37 +0000 Mon, 07 Feb 2022 06:15:04 +0000 KubeletNotReady PLEG is not healthy: pleg
was last seen active 14m34.990341285s ago; threshold is 3m0s
Addresses:
InternalIP: 10.64.48.230
Hostname: kubernetes1014.eqiad.wmnet
Capacity:
cpu: 48
ephemeral-storage: 28688292Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 97409220Ki
pods: 110
Allocatable:
cpu: 48
ephemeral-storage: 26439129864
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 97306820Ki
pods: 110
System Info:
Machine ID: 73679900aa984a45bf760f538524aba6
System UUID: 4c4c4544-004b-4310-8051-b1c04f473133
Boot ID: 7d518087-e900-48d4-86bd-3ce1104ad812
Kernel Version: 4.19.0-0.bpo.14-amd64
OS Image: Debian GNU/Linux 9 (stretch)
Operating System: linux
Architecture: amd64
Container Runtime Version: docker://18.6.3
Kubelet Version: v1.16.15
Kube-Proxy Version: v1.16.15
Non-terminated Pods: (35 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
apertium apertium-production-6b99ff7694-8d6pw 300m (0%) 1600m (3%) 300Mi (0%) 1300Mi (1%) 20d
api-gateway api-gateway-production-5889589fc-dz2p8 900m (1%) 1400m (2%) 900Mi (0%) 1200Mi (1%) 12d
blubberoid blubberoid-production-66947dddf9-4df7f 300m (0%) 1500m (3%) 200Mi (0%) 600Mi (0%) 5d17
h
changeprop-jobqueue changeprop-production-b5fbcffbb-x9q7n 700m (1%) 1200m (2%) 500Mi (0%) 1700Mi (1%) 18d
changeprop changeprop-production-78fb8b7cd4-hfpwf 700m (1%) 3200m (6%) 500Mi (0%) 1700Mi (1%) 18d
cxserver cxserver-production-694c7db9c-6zkjh 300m (0%) 1500m (3%) 200Mi (0%) 900Mi (0%) 3d18
h
eventgate-analytics-external eventgate-analytics-external-production-7577b69644-lzzhx 400m (0%) 2500m (5%) 250Mi (0%) 800Mi (0%) 11d
eventgate-analytics eventgate-analytics-production-7b8ccf799b-gwhzj 400m (0%) 2500m (5%) 250Mi (0%) 800Mi (0%) 10d
eventgate-analytics eventgate-analytics-production-7b8ccf799b-twbq8 400m (0%) 2500m (5%) 250Mi (0%) 800Mi (0%) 10d
eventgate-logging-external eventgate-logging-external-production-99fd8cc75-m2l47 700m (1%) 3 (6%) 250Mi (0%) 800Mi (0%) 11d
eventgate-main eventgate-main-production-fb5d896b9-rdxsn 400m (0%) 2500m (5%) 250Mi (0%) 1100Mi (1%) 4d16
h
eventstreams-internal eventstreams-internal-main-5bffd6d7c6-t2xkt 400m (0%) 2 (4%) 600Mi (0%) 1500Mi (1%) 10d
eventstreams eventstreams-production-7b64d578d8-nzhzq 400m (0%) 2 (4%) 600Mi (0%) 1500Mi (1%) 10d
kube-system calico-node-86v2g 350m (0%) 0 (0%) 400Mi (0%) 400Mi (0%) 59d
kube-system coredns-584d8549b5-hr6tg 100m (0%) 0 (0%) 70Mi (0%) 170Mi (0%) 130d
linkrecommendation linkrecommendation-internal-58fd7dd4d8-vvdh5 2050m (4%) 4600m (9%) 700Mi (0%) 1250Mi (1%) 3d17
h
mathoid mathoid-production-596cb7c944-v6brp 300m (0%) 1500m (3%) 300Mi (0%) 1524288k (1%) 73d
mathoid mathoid-production-596cb7c944-wmhrs 300m (0%) 1500m (3%) 300Mi (0%) 1524288k (1%) 73d
mobileapps mobileapps-production-746f7579c9-58b7q 1300m (2%) 1800m (3%) 550Mi (0%) 1200Mi (1%) 73d
mobileapps mobileapps-production-746f7579c9-79hdk 1300m (2%) 1800m (3%) 550Mi (0%) 1200Mi (1%) 73d
mobileapps mobileapps-production-746f7579c9-7wx27 1300m (2%) 1800m (3%) 550Mi (0%) 1200Mi (1%) 73d
mobileapps mobileapps-production-746f7579c9-8ncx6 1300m (2%) 1800m (3%) 550Mi (0%) 1200Mi (1%) 73d
mobileapps mobileapps-production-746f7579c9-96xk7 1300m (2%) 1800m (3%) 550Mi (0%) 1200Mi (1%) 73d
mobileapps mobileapps-production-746f7579c9-ck7bl 1300m (2%) 1800m (3%) 550Mi (0%) 1200Mi (1%) 73d
mobileapps mobileapps-production-746f7579c9-kjdng 1300m (2%) 1800m (3%) 550Mi (0%) 1200Mi (1%) 73d
rdf-streaming-updater flink-session-cluster-main-taskmanager-6cdd5c87b7-kd5fp 1200m (2%) 4500m (9%) 2152857600 (2%) 2624288k (2%) 32d
recommendation-api recommendation-api-production-64d668997b-nmlsh 700m (1%) 2100m (4%) 350Mi (0%) 900Mi (0%) 73d
shellbox-constraints shellbox-main-64999bc485-djmbd 700m (1%) 2700m (5%) 1524Mi (1%) 3148Mi (3%) 25d
shellbox-media shellbox-main-5c56fb99cc-nblgf 3600m (7%) 4700m (9%) 1524Mi (1%) 3148Mi (3%) 25d
shellbox-syntaxhighlight shellbox-main-7795bf4db7-b5cbs 2100m (4%) 3700m (7%) 1524Mi (1%) 3148Mi (3%) 25d
shellbox-timeline shellbox-main-6796665947-n5cr9 2100m (4%) 3700m (7%) 1524Mi (1%) 3148Mi (3%) 25d
shellbox shellbox-main-7765d7c9db-l4wt5 700m (1%) 2700m (5%) 1524Mi (1%) 3148Mi (3%) 25d
termbox termbox-production-6f5b9d8cf-tlmjf 400m (0%) 1600m (3%) 340Mi (0%) 900Mi (0%) 6d15
h
wikifeeds wikifeeds-production-84d464cb98-74dzk 1600m (3%) 3600m (7%) 1200Mi (1%) 1900Mi (1%) 69d
zotero zotero-production-685c4f4cb6-cmckq 400m (0%) 1500m (3%) 300Mi (0%) 2548Mi (2%) 73d
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 32 (66%) 78400m (163%)
memory 23073920Ki (23%) 54859467008 (55%)
ephemeral-storage 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal NodeNotSchedulable 17m kubelet, kubernetes1014.eqiad.wmnet Node kubernetes1014.eqiad.wmnet status is now: NodeNotSchedulable
Normal NodeNotReady 11m kubelet, kubernetes1014.eqiad.wmnet Node kubernetes1014.eqiad.wmnet status is now: NodeNotReady
root@deploy1002:~#
root@deploy1002:~#
root@deploy1002:~#
root@deploy1002:~#
root@deploy1002:~#
root@deploy1002:~# kubectl describe node kubernetes1014.eqiad.wmnet
Name: kubernetes1014.eqiad.wmnet
Roles: <none>
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
failure-domain.beta.kubernetes.io/region=eqiad
failure-domain.beta.kubernetes.io/zone=row-d
kubernetes.io/arch=amd64
kubernetes.io/hostname=kubernetes1014.eqiad.wmnet
kubernetes.io/os=linux
node.kubernetes.io/disk-type=ssd
Annotations: node.alpha.kubernetes.io/ttl: 0
projectcalico.org/IPv4Address: 10.64.48.230/22
projectcalico.org/IPv6Address: 2620:0:861:107:10:64:48:230/64
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Tue, 23 Mar 2021 09:53:07 +0000
Taints: node.kubernetes.io/not-ready:NoExecute
node.kubernetes.io/not-ready:NoSchedule
node.kubernetes.io/unschedulable:NoSchedule
Unschedulable: true
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
NetworkUnavailable False Thu, 09 Dec 2021 14:34:47 +0000 Thu, 09 Dec 2021 14:34:47 +0000 CalicoIsUp Calico is running on this
node
MemoryPressure False Mon, 07 Feb 2022 07:49:05 +0000 Tue, 23 Mar 2021 09:53:07 +0000 KubeletHasSufficientMemory kubelet has sufficient mem
ory available
DiskPressure False Mon, 07 Feb 2022 07:49:05 +0000 Wed, 29 Sep 2021 07:28:27 +0000 KubeletHasNoDiskPressure kubelet has no disk pressu
re
PIDPressure False Mon, 07 Feb 2022 07:49:05 +0000 Tue, 23 Mar 2021 09:53:07 +0000 KubeletHasSufficientPID kubelet has sufficient PID
available
Ready False Mon, 07 Feb 2022 07:49:05 +0000 Mon, 07 Feb 2022 06:15:04 +0000 KubeletNotReady PLEG is not healthy: pleg
was last seen active 1h37m3.571711204s ago; threshold is 3m0s
Addresses:
InternalIP: 10.64.48.230
Hostname: kubernetes1014.eqiad.wmnet
Capacity:
cpu: 48
ephemeral-storage: 28688292Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 97409220Ki
pods: 110
Allocatable:
cpu: 48
ephemeral-storage: 26439129864
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 97306820Ki
pods: 110
System Info:
Machine ID: 73679900aa984a45bf760f538524aba6
System UUID: 4c4c4544-004b-4310-8051-b1c04f473133
Boot ID: 7d518087-e900-48d4-86bd-3ce1104ad812
Kernel Version: 4.19.0-0.bpo.14-amd64
OS Image: Debian GNU/Linux 9 (stretch)
Operating System: linux
Architecture: amd64
Container Runtime Version: docker://18.6.3
Kubelet Version: v1.16.15
Kube-Proxy Version: v1.16.15
Non-terminated Pods: (35 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
apertium apertium-production-6b99ff7694-8d6pw 300m (0%) 1600m (3%) 300Mi (0%) 1300Mi (1%) 20d
api-gateway api-gateway-production-5889589fc-dz2p8 900m (1%) 1400m (2%) 900Mi (0%) 1200Mi (1%) 12d
blubberoid blubberoid-production-66947dddf9-4df7f 300m (0%) 1500m (3%) 200Mi (0%) 600Mi (0%) 5d19
h
changeprop-jobqueue changeprop-production-b5fbcffbb-x9q7n 700m (1%) 1200m (2%) 500Mi (0%) 1700Mi (1%) 18d
changeprop changeprop-production-78fb8b7cd4-hfpwf 700m (1%) 3200m (6%) 500Mi (0%) 1700Mi (1%) 18d
cxserver cxserver-production-694c7db9c-6zkjh 300m (0%) 1500m (3%) 200Mi (0%) 900Mi (0%) 3d19
h
eventgate-analytics-external eventgate-analytics-external-production-7577b69644-lzzhx 400m (0%) 2500m (5%) 250Mi (0%) 800Mi (0%) 11d
eventgate-analytics eventgate-analytics-production-7b8ccf799b-gwhzj 400m (0%) 2500m (5%) 250Mi (0%) 800Mi (0%) 10d
eventgate-analytics eventgate-analytics-production-7b8ccf799b-twbq8 400m (0%) 2500m (5%) 250Mi (0%) 800Mi (0%) 10d
eventgate-logging-external eventgate-logging-external-production-99fd8cc75-m2l47 700m (1%) 3 (6%) 250Mi (0%) 800Mi (0%) 11d
eventgate-main eventgate-main-production-fb5d896b9-rdxsn 400m (0%) 2500m (5%) 250Mi (0%) 1100Mi (1%) 4d18
h
eventstreams-internal eventstreams-internal-main-5bffd6d7c6-t2xkt 400m (0%) 2 (4%) 600Mi (0%) 1500Mi (1%) 10d
eventstreams eventstreams-production-7b64d578d8-nzhzq 400m (0%) 2 (4%) 600Mi (0%) 1500Mi (1%) 10d
kube-system calico-node-86v2g 350m (0%) 0 (0%) 400Mi (0%) 400Mi (0%) 59d
kube-system coredns-584d8549b5-hr6tg 100m (0%) 0 (0%) 70Mi (0%) 170Mi (0%) 130d
linkrecommendation linkrecommendation-internal-58fd7dd4d8-vvdh5 2050m (4%) 4600m (9%) 700Mi (0%) 1250Mi (1%) 3d18
h
mathoid mathoid-production-596cb7c944-v6brp 300m (0%) 1500m (3%) 300Mi (0%) 1524288k (1%) 73d
mathoid mathoid-production-596cb7c944-wmhrs 300m (0%) 1500m (3%) 300Mi (0%) 1524288k (1%) 73d
mobileapps mobileapps-production-746f7579c9-58b7q 1300m (2%) 1800m (3%) 550Mi (0%) 1200Mi (1%) 73d
mobileapps mobileapps-production-746f7579c9-79hdk 1300m (2%) 1800m (3%) 550Mi (0%) 1200Mi (1%) 73d
mobileapps mobileapps-production-746f7579c9-7wx27 1300m (2%) 1800m (3%) 550Mi (0%) 1200Mi (1%) 73d
mobileapps mobileapps-production-746f7579c9-8ncx6 1300m (2%) 1800m (3%) 550Mi (0%) 1200Mi (1%) 73d
mobileapps mobileapps-production-746f7579c9-96xk7 1300m (2%) 1800m (3%) 550Mi (0%) 1200Mi (1%) 73d
mobileapps mobileapps-production-746f7579c9-ck7bl 1300m (2%) 1800m (3%) 550Mi (0%) 1200Mi (1%) 73d
mobileapps mobileapps-production-746f7579c9-kjdng 1300m (2%) 1800m (3%) 550Mi (0%) 1200Mi (1%) 73d
rdf-streaming-updater flink-session-cluster-main-taskmanager-6cdd5c87b7-kd5fp 1200m (2%) 4500m (9%) 2152857600 (2%) 2624288k (2%) 32d
recommendation-api recommendation-api-production-64d668997b-nmlsh 700m (1%) 2100m (4%) 350Mi (0%) 900Mi (0%) 73d
shellbox-constraints shellbox-main-64999bc485-djmbd 700m (1%) 2700m (5%) 1524Mi (1%) 3148Mi (3%) 25d
shellbox-media shellbox-main-5c56fb99cc-nblgf 3600m (7%) 4700m (9%) 1524Mi (1%) 3148Mi (3%) 25d
shellbox-syntaxhighlight shellbox-main-7795bf4db7-b5cbs 2100m (4%) 3700m (7%) 1524Mi (1%) 3148Mi (3%) 25d
shellbox-timeline shellbox-main-6796665947-n5cr9 2100m (4%) 3700m (7%) 1524Mi (1%) 3148Mi (3%) 25d
shellbox shellbox-main-7765d7c9db-l4wt5 700m (1%) 2700m (5%) 1524Mi (1%) 3148Mi (3%) 25d
termbox termbox-production-6f5b9d8cf-tlmjf 400m (0%) 1600m (3%) 340Mi (0%) 900Mi (0%) 6d16
h
wikifeeds wikifeeds-production-84d464cb98-74dzk 1600m (3%) 3600m (7%) 1200Mi (1%) 1900Mi (1%) 69d
zotero zotero-production-685c4f4cb6-cmckq 400m (0%) 1500m (3%) 300Mi (0%) 2548Mi (2%) 73d
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 32 (66%) 78400m (163%)
memory 23073920Ki (23%) 54859467008 (55%)
ephemeral-storage 0 (0%) 0 (0%)
Events: <none>
root@deploy1002:~#

File Metadata

Mime Type
text/plain
Storage Engine
blob
Storage Format
Raw Data
Storage Handle
9342491
Default Alt Text
kubernetes1014_2.log (18 KB)

Event Timeline

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL