Page MenuHomePhabricator

scs-c1-eqiad CPU usage over 85%
Closed, ResolvedPublic

Description

Since 01:08 UTC, scs-c1-eqiad reports a CPU usage at 100% as it can be seen in librenms: https://librenms.wikimedia.org/device/device=158/tab=health/metric=processor/

CPU usage suddenly went from a 15% on average to a 100%

Event Timeline

Restricted Application added a project: Operations. · View Herald TranscriptTue, Nov 12, 4:02 AM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript

Mentioned in SAL (#wikimedia-operations) [2019-11-12T16:21:02Z] <XioNoX> reboot scs-c1-eqiad.mgmt.eqiad.wmnet - T238036

PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND    
1855 root      20   0  4576 2084  876 S  2.7  0.8  26623:27 portmanager

did a kill -9 portmanager just in case but it didn't change anything (the process restarted with the same 2% CPU load).
Then killed snmpd, which lower the CPU for a bit but then went back up.
Trying a reboot.

ayounsi closed this task as Resolved.Tue, Nov 12, 4:33 PM
ayounsi claimed this task.

CPU is back to normal.