Kernel error Server cloudvirt1035 may have kernel errors
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	phaultfinder
	Dec 4 2024, 2:57 PM

Description

Common information

dashboard: https://grafana.wikimedia.org/d/b013af4c-d405-4d9f-85d4-985abb3dec0c/wmcs-kernel-panic-detector?orgId=1&var-instance=cloudvirt1035
description: The server cloudvirt1035 logged some kernel errors in the past 24h
runbook: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Kernel_panic
summary: Server cloudvirt1035 may have kernel errors

alertname: Kernel error
cluster: wmcs
instance: cloudvirt1035:9100
job: node
prometheus: ops
severity: critical
site: eqiad
source: prometheus
team: wmcs

Firing alerts

dashboard: https://grafana.wikimedia.org/d/b013af4c-d405-4d9f-85d4-985abb3dec0c/wmcs-kernel-panic-detector?orgId=1&var-instance=cloudvirt1035
description: The server cloudvirt1035 logged some kernel errors in the past 24h
runbook: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Kernel_panic
summary: Server cloudvirt1035 may have kernel errors
alertname: Kernel error
cluster: wmcs
instance: cloudvirt1035:9100
job: node
prometheus: ops
severity: critical
site: eqiad
source: prometheus
team: wmcs
Source

Related Objects

Mentioned Here: T380893: decommission cloudcephmon100[1-3].eqiad.wmnet

Event Timeline

phaultfinder created this task.Dec 4 2024, 2:57 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptDec 4 2024, 2:57 PM

This was rebooted today by @Andrew (T380893) and a kernel error was logged during shutdown:

root@cloudvirt1035:~# journalctl --quiet _TRANSPORT=kernel --since today --priority=err
Dec 04 14:50:39 cloudvirt1035 kernel: watchdog: watchdog0: watchdog did not stop!

It should be safe to ignore.

Kernel error Server cloudvirt1035 may have kernel errorsClosed, ResolvedPublicActions