Page MenuHomePhabricator
Paste P9043

Console output of a crashing cloudvirt1015
ActivePublic

Authored by Andrew on Sep 4 2019, 8:24 PM.
Tags
None
Referenced Files
F30223827: raw.txt
Sep 4 2019, 8:24 PM
Subscribers
None
[ 1028.330239] 39-...: (6 GPs behind) idle=5f1/140000000000000/0 softirq=35610/35612 fqs=2510
[ 1028.339659] (detected by 20, t=5256 jiffies, g=36760, c=36759, q=20573)
[ 1057.561642] NMI watchdog: BUG: soft lockup - CPU#69 stuck for 22s! [sshd:39668]
[ 1065.166255] NMI watchdog: BUG: soft lockup - CPU#20 stuck for 23s! [kworker/20:1:499]
[ 1065.394273] NMI watchdog: BUG: soft lockup - CPU#48 stuck for 23s! [sshd:39696]
[ 1076.312415] BUG: unable to handle kernel paging request at 000000f62e072f10
[ 1076.320216] IP: [<ffffffff8aeadb95>] pick_next_entity+0x65/0x130
[ 1076.326944] PGD 0 [ 1076.328993]
[ 1076.330663] Oops: 0000 [#1] SMP
[ 1076.334167] Modules linked in: ebt_arp ebt_among ip6table_raw ip6table_mangle nf_conntrack_ipv6 nf_defrag_ipv6 iptable_nat nf_nat_ipv4 nf_nat xt_cont
[ 1076.466425] CPU: 43 PID: 0 Comm: swapper/43 Tainted: G L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1076.477595] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.8.0 005/17/2018
[ 1076.486053] task: ffff9495e5831100 task.stack: ffffb091714b0000
[ 1076.492666] RIP: 0010:[<ffffffff8aeadb95>] [<ffffffff8aeadb95>] pick_next_entity+0x65/0x130
[ 1076.502102] RSP: 0018:ffffb091714b3dd8 EFLAGS: 00010006
[ 1076.508037] RAX: 000000f62e072ec0 RBX: ffff94932e088400 RCX: 0000000000000000
[ 1076.516006] RDX: 0000000000000001 RSI: 0000000000000000 RDI: ffff94932e088400
[ 1076.523977] RBP: ffff949141029080 R08: 000000fa993763fe R09: 0000000000000018
[ 1076.531948] R10: 00000000000002e9 R11: 000000000000038f R12: ffff949141029080
[ 1076.539917] R13: ffff9495e5831100 R14: ffff94932e088400 R15: ffff9495ff158980
[ 1076.547888] FS: 0000000000000000(0000) GS:ffff9495ff140000(0000) knlGS:0000000000000000
[ 1076.556924] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1076.563343] CR2: 000000f62e072f10 CR3: 0000000520c08000 CR4: 0000000000362670
[ 1076.571313] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1076.579285] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1076.587254] Stack:
[ 1076.589501] ffff9491edd7ea00 ffffb091714b3eb8 ffff9495ff158980 ffff9495e5831100
[ 1076.597803] ffffffff8aeb7bea ffff9495e5831100 ffff949200000000 ffff9495ff1448c0
[ 1076.606105] ffff94932e088400 0000000000018980 ffffffff8b41b930 ccabf890fab52363
[ 1076.614400] Call Trace:
[ 1076.617139] [<ffffffff8aeb7bea>] ? pick_next_task_fair+0x7a/0x4b0
[ 1076.624051] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1076.630480] [<ffffffff8b416c1e>] ? __schedule+0x3fe/0x6f0
[ 1076.636618] [<ffffffff8ae2f8f5>] ? sched_clock+0x5/0x10
[ 1076.642559] [<ffffffff8b416f42>] ? schedule+0x32/0x80
[ 1076.648305] [<ffffffff8b4171fa>] ? schedule_preempt_disabled+0xa/0x10
[ 1076.655606] [<ffffffff8aebdf31>] ? cpu_startup_entry+0x1b1/0x240
[ 1076.662421] [<ffffffff8ae4aa20>] ? start_secondary+0x170/0x1b0
[ 1076.669032] Code: 74 5f 4c 89 e5 48 8b 43 48 48 85 c0 74 14 48 8b 78 50 48 89 ee e8 5c ff ff ff 85 c0 0f 8e 85 00 00 00 48 8b 43 40 48 85 c0 74 10 <4
[ 1076.690739] RIP [<ffffffff8aeadb95>] pick_next_entity+0x65/0x130
[ 1076.697564] RSP <ffffb091714b3dd8>
[ 1076.701458] CR2: 000000f62e072f10
[ 1076.705167] NMI watchdog: Watchdog detected hard LOCKUP on cpu 39dModules linked in:c ebt_arpc ebt_amongc ip6table_rawc ip6table_manglec nf_conntracc
[ 1076.802733] CPU: 39 PID: 9835 Comm: qemu-system-x86 Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1076.813321] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.8.0 005/17/2018
[ 1076.821777] task: ffff9455dedd1100 task.stack: ffffb091bd430000
[ 1076.828389] RIP: 0010:[<ffffffff8aec5bdc>] c [<ffffffff8aec5bdc>] native_queued_spin_lock_slowpath+0x10c/0x1a0
[ 1076.839655] RSP: 0018:ffffb091bd433a48 EFLAGS: 00000046
[ 1076.845589] RAX: 0000000000000000 RBX: 0000000000000286 RCX: 0000000000000001
[ 1076.853559] RDX: ffff9495ff0d9480 RSI: 0000000000a00000 RDI: ffff94914eddc948
[ 1076.861529] RBP: ffff94914eddc948 R08: 0000000000000000 R09: ffff9455e07d93c0
[ 1076.869498] R10: 0000000000000063 R11: ffff9492b2517a38 R12: ffffb091bd433c40
[ 1076.877468] R13: ffff948e5e4cb000 R14: 0000000000000004 R15: ffff948f7eb8c164
[ 1076.885440] FS: 00007fa6213a5c40(0000) GS:ffff9495ff0c0000(0000) knlGS:0000000000000000
[ 1076.894477] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1076.900896] CR2: 00005640e8946000 CR3: 0000007bd1224000 CR4: 0000000000362670
[ 1076.908868] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1076.916839] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1076.924809] Stack:
[ 1076.927053] ffffffff8b41b542c ffffb091bd433d10c ffffffff8aebd474c ffffb091bd433d00c
[ 1076.936086] ffffb091bd433c10c ffffb091bd433c40c ffffffff8b02133dc 0000000000000000c
[ 1076.945123] ffffb091bd433ec0c 0000000000000000c ffff948f7eb8c164c 0000000000000000c
[ 1076.954160] Call Trace:
[ 1076.956888] [<ffffffff8b41b542>] ? _raw_spin_lock_irqsave+0x32/0x40
[ 1076.963984] [<ffffffff8aebd474>] ? remove_wait_queue+0x14/0x30
[ 1076.970595] [<ffffffff8b02133d>] ? poll_freewait+0x3d/0xa0
[ 1076.976819] [<ffffffff8b02293d>] ? do_sys_poll+0x37d/0x560
[ 1076.983044] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1076.990724] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1076.998404] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1077.006084] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1077.013763] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1077.021443] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1077.029122] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1077.036801] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1077.044481] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1077.052160] [<ffffffff8b022e28>] ? SyS_ppoll+0x168/0x190
[ 1077.058188] [<ffffffff8ae03b7d>] ? do_syscall_64+0x8d/0x100
[ 1077.064511] [<ffffffff8b41b80e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
[ 1077.072288] Code: c41 cc1 ce9 c12 c83 ce0 c03 c83 ce9 c01 c48 cc1 ce0 c04 c48 c63 cc9 c48 c05 c80 c94 c01 c00 c48 c03 c04 ccd c00 cf4 c86 c8b c48 c8c
[ 1083.923730] ------------[ cut here ]------------
[ 1083.928904] WARNING: CPU: 28 PID: 11622 at /build/linux-ErBBHn/linux-4.9.168/net/sched/sch_generic.c:316 dev_watchdog+0x233/0x240
[ 1083.941924] NETDEV WATCHDOG: enp4s0f1 (bnx2x): transmit queue 0 timed out
[ 1083.949508] Modules linked in: ebt_arp ebt_among ip6table_raw ip6table_mangle nf_conntrack_ipv6 nf_defrag_ipv6 iptable_nat nf_nat_ipv4 nf_nat xt_cons
[ 1084.081974] CPU: 28 PID: 11622 Comm: CPU 0/KVM Tainted: G L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1084.093432] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.8.0 005/17/2018
[ 1084.101875] 0000000000000000 ffffffff8b135514 ffff9455ff783e20 0000000000000000
[ 1084.110168] ffffffff8ae7a6ab 0000000000000000 ffff9455ff783e78 ffff9455de8d4000
[ 1084.118467] 000000000000001c ffff9455de8df100 000000000000005b ffffffff8ae7a72f
[ 1084.126767] Call Trace:
[ 1084.129496] <IRQ> [ 1084.131649] [<ffffffff8b135514>] ? dump_stack+0x5c/0x78
[ 1084.137588] [<ffffffff8ae7a6ab>] ? __warn+0xcb/0xf0
[ 1084.143134] [<ffffffff8ae7a72f>] ? warn_slowpath_fmt+0x5f/0x80
[ 1084.149746] [<ffffffff8aeb554d>] ? task_tick_fair+0x52d/0x930
[ 1084.156264] [<ffffffff8b33ca03>] ? dev_watchdog+0x233/0x240
[ 1084.162585] [<ffffffff8b33c7d0>] ? dev_deactivate_queue.constprop.26+0x60/0x60
[ 1084.170750] [<ffffffff8aee8d92>] ? call_timer_fn+0x32/0x120
[ 1084.177072] [<ffffffff8aee9107>] ? run_timer_softirq+0x1d7/0x430
[ 1084.183878] [<ffffffff8aefa260>] ? tick_sched_do_timer+0x30/0x30
[ 1084.190684] [<ffffffff8b13e604>] ? timerqueue_add+0x54/0xa0
[ 1084.197004] [<ffffffff8aeeadf8>] ? enqueue_hrtimer+0x38/0x80
[ 1084.203423] [<ffffffff8b41f4ed>] ? __do_softirq+0x10d/0x2b0
[ 1084.209747] [<ffffffff8ae80c62>] ? irq_exit+0xc2/0xd0
[ 1084.215487] [<ffffffff8b41ef6c>] ? smp_apic_timer_interrupt+0x4c/0x60
[ 1084.222779] [<ffffffff8b41d69e>] ? apic_timer_interrupt+0x9e/0xb0
[ 1084.229677] <EOI> [ 1084.231829] [<ffffffff8b41d600>] ? __entry_text_end+0x1/0x1
[ 1084.238150] [<ffffffffc065a6b7>] ? vmx_handle_external_intr+0x57/0x60 [kvm_intel]
[ 1084.246607] [<ffffffffc065a660>] ? vmx_get_exit_info+0x30/0x30 [kvm_intel]
[ 1084.254407] [<ffffffffc0976fd8>] ? kvm_arch_vcpu_ioctl_run+0x798/0x16d0 [kvm]
[ 1084.262497] [<ffffffffc0970bf1>] ? kvm_arch_vcpu_load+0x61/0x290 [kvm]
[ 1084.269908] [<ffffffffc095c665>] ? kvm_vcpu_ioctl+0x315/0x5e0 [kvm]
[ 1084.277004] [<ffffffff8aea5e00>] ? wake_up_q+0x70/0x70
[ 1084.282843] [<ffffffff8aebd17f>] ? __wake_up_common+0x4f/0x90
[ 1084.289359] [<ffffffff8b0203c2>] ? do_vfs_ioctl+0xa2/0x620
[ 1084.295584] [<ffffffff8b00bd84>] ? vfs_write+0x144/0x190
[ 1084.301615] [<ffffffff8b0209b4>] ? SyS_ioctl+0x74/0x80
[ 1084.307450] [<ffffffff8ae03b7d>] ? do_syscall_64+0x8d/0x100
[ 1084.313773] [<ffffffff8b41b80e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
[ 1084.321560] ---[ end trace 5b9b3b58e542fbb4 ]---
[ 1084.326753] bnx2x: [bnx2x_sp_rtnl_task:10324(enp4s0f1)]Indicating link is down due to Tx-timeout
[ 1085.563842] NMI watchdog: BUG: soft lockup - CPU#69 stuck for 23s! [sshd:39668]
[ 1085.572007] Modules linked in: ebt_arp ebt_among ip6table_raw ip6table_mangle nf_conntrack_ipv6 nf_defrag_ipv6 iptable_nat nf_nat_ipv4 nf_nat xt_conc
[ 1085.704415] CPU: 69 PID: 39668 Comm: sshd Tainted: G W L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1085.715387] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.8.0 005/17/2018
[ 1085.723842] task: ffff9449256f0100 task.stack: ffffb0919b7d8000
[ 1085.730452] RIP: 0010:[<ffffffff8aefee25>] [<ffffffff8aefee25>] smp_call_function_many+0x1f5/0x250
[ 1085.740575] RSP: 0018:ffffb0919b7dbbe0 EFLAGS: 00000202
[ 1085.746497] RAX: 0000000000000003 RBX: 0000000000000200 RCX: 0000000000000027
[ 1085.754465] RDX: ffffd0913f8c3da0 RSI: 0000000000000200 RDI: ffff9495ff4998c8
[ 1085.762433] RBP: ffff9495ff4998c8 R08: ffffff8000000000 R09: ffffffffffffffff
[ 1085.770400] R10: 0000000000000008 R11: 0000000000000010 R12: ffff9495ff4998c0
[ 1085.778367] R13: ffffffff8ae696f0 R14: 0000000000000000 R15: 0000000000000001
[ 1085.786335] FS: 00007f4bb07818c0(0000) GS:ffff9495ff480000(0000) knlGS:0000000000000000
[ 1085.795369] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1085.801784] CR2: 00007ffd9ece5f0e CR3: 0000003847f9c000 CR4: 0000000000362670
[ 1085.809751] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1085.817709] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1085.825675] Stack:
[ 1085.827922] 0000000000019880 000000019b7dbc88 ffff945478341900 ffffffff8ae696f0
[ 1085.836232] 0000000000000000 ffffb0919b7dbcd8 ffffb0919b7dbce0 ffff9495ff4d6d08
[ 1085.844537] ffffffff8aeff0b8 ffff945478341900 ffffb0919b7dbc88 ffff9495ff4d6cd8
[ 1085.852843] Call Trace:
[ 1085.855582] [<ffffffff8ae696f0>] ? leave_mm+0xa0/0xa0
[ 1085.861326] [<ffffffff8aeff0b8>] ? on_each_cpu+0x28/0x60
[ 1085.867363] [<ffffffff8ae69e38>] ? flush_tlb_kernel_range+0x48/0x90
[ 1085.874454] [<ffffffff8afca516>] ? __purge_vmap_area_lazy+0x66/0x300
[ 1085.881650] [<ffffffff8afca764>] ? __purge_vmap_area_lazy+0x2b4/0x300
[ 1085.888941] [<ffffffff8afca8c4>] ? vm_unmap_aliases+0x114/0x140
[ 1085.895655] [<ffffffff8ae65313>] ? change_page_attr_set_clr+0xe3/0x4a0
[ 1085.903045] [<ffffffff8b32ab99>] ? bpf_convert_filter+0x9a9/0xa00
[ 1085.909951] [<ffffffff8ae6623d>] ? set_memory_ro+0x2d/0x40
[ 1085.916180] [<ffffffff8af60e35>] ? bpf_prog_select_runtime+0x25/0xd0
[ 1085.923378] [<ffffffff8b32ceae>] ? bpf_prepare_filter+0x38e/0x410
[ 1085.930285] [<ffffffff8afa5272>] ? kmemdup+0x32/0x40
[ 1085.935931] [<ffffffff8b32d08c>] ? bpf_prog_create_from_user+0xbc/0x110
[ 1085.943419] [<ffffffff8af2bfc0>] ? watchdog_nmi_disable+0x60/0x60
[ 1085.950325] [<ffffffff8af2c571>] ? do_seccomp+0x121/0x620
[ 1085.956452] [<ffffffff8ae902bc>] ? SyS_prctl+0x15c/0x490
[ 1085.962486] [<ffffffff8ae03b7d>] ? do_syscall_64+0x8d/0x100
[ 1085.968811] [<ffffffff8b41b80e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
[ 1085.976583] Code: ca 24 00 3b 05 61 ac c1 00 89 c1 0f 8d 93 fe ff ff 48 98 49 8b 14 24 48 03 14 c5 00 f4 86 8b 8b 42 18 a8 01 74 09 f3 90 8b 42 18 <a
[ 1086.337226] bnx2x: [bnx2x_clean_tx_queue:1205(enp4s0f1)]timeout waiting for queue[0]: txdata->tx_pkt_prod(13326) != txdata->tx_pkt_cons(13296)
[ 1088.352085] bnx2x: [bnx2x_clean_tx_queue:1205(enp4s0f1)]timeout waiting for queue[1]: txdata->tx_pkt_prod(13176) != txdata->tx_pkt_cons(13112)
[ 1090.366234] bnx2x: [bnx2x_clean_tx_queue:1205(enp4s0f1)]timeout waiting for queue[2]: txdata->tx_pkt_prod(15211) != txdata->tx_pkt_cons(15184)
[ 1091.348272] INFO: rcu_sched detected stalls on CPUs/tasks:
[ 1091.354414] 39-...: (6 GPs behind) idle=5f1/140000000000000/0 softirq=35610/35612 fqs=10088
[ 1091.363923] (detected by 28, t=21011 jiffies, g=36760, c=36759, q=60596)
[ 1091.371521] Task dump for CPU 39:
[ 1091.375222] qemu-system-x86 R running task 0 9835 1 0x00000008
[ 1091.383109] ffff9495e5826080 ffff9495ff0d8980 ffff9455dedd1100 0000000000000000
[ 1091.391410] ffff9495e3744c00 ffffb091bd4339f0 ffffffff8b416a61 ffffffff8aeeb6f4
[ 1091.399707] 0000000000000040 ffff9495ff0d8980 00ff9455dedd18d8 ffff9455dedd1100
[ 1091.408008] Call Trace:
[ 1091.410745] [<ffffffff8b416a61>] ? __schedule+0x241/0x6f0
[ 1091.416875] [<ffffffff8aeeb6f4>] ? hrtimer_start_range_ns+0x194/0x360
[ 1091.424168] [<ffffffff8aeeb117>] ? hrtimer_try_to_cancel+0x27/0x110
[ 1091.431270] [<ffffffff8b41a795>] ? schedule_hrtimeout_range_clock+0xc5/0x1a0
[ 1091.439233] [<ffffffff8aeeaee0>] ? __hrtimer_init+0xa0/0xa0
[ 1091.445561] [<ffffffff8b41b542>] ? _raw_spin_lock_irqsave+0x32/0x40
[ 1091.452661] [<ffffffff8aebd474>] ? remove_wait_queue+0x14/0x30
[ 1091.459277] [<ffffffff8b02133d>] ? poll_freewait+0x3d/0xa0
[ 1091.465507] [<ffffffff8b02293d>] ? do_sys_poll+0x37d/0x560
[ 1091.471728] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1091.479410] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1091.487094] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1091.494777] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1091.502458] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1091.510141] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1091.517822] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1091.525504] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1091.533184] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1091.540866] [<ffffffff8b022e28>] ? SyS_ppoll+0x168/0x190
[ 1091.546897] [<ffffffff8ae03b7d>] ? do_syscall_64+0x8d/0x100
[ 1091.553223] [<ffffffff8b41b80e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
[ 1092.586381] bnx2x: [bnx2x_clean_tx_queue:1205(enp4s0f1)]timeout waiting for queue[3]: txdata->tx_pkt_prod(14677) != txdata->tx_pkt_cons(14624)
[ 1093.168408] NMI watchdog: BUG: soft lockup - CPU#20 stuck for 23s! [kworker/20:1:499]
[ 1093.177152] Modules linked in: ebt_arp ebt_among ip6table_raw ip6table_mangle nf_conntrack_ipv6 nf_defrag_ipv6 iptable_nat nf_nat_ipv4 nf_nat xt_con
[ 1093.309483] CPU: 20 PID: 499 Comm: kworker/20:1 Tainted: G W L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1093.321038] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.8.0 005/17/2018
[ 1093.329495] Workqueue: events netstamp_clear
[ 1093.334271] task: ffff9455e55f4140 task.stack: ffffb09172f1c000
[ 1093.340879] RIP: 0010:[<ffffffff8aefee25>] [<ffffffff8aefee25>] smp_call_function_many+0x1f5/0x250
[ 1093.350996] RSP: 0018:ffffb09172f1fd28 EFLAGS: 00000202
[ 1093.356925] RAX: 0000000000000003 RBX: 0000000000000200 RCX: 0000000000000027
[ 1093.364893] RDX: ffffd0913f8c3780 RSI: 0000000000000200 RDI: ffff9455ff6998c8
[ 1093.372859] RBP: ffff9455ff6998c8 R08: ffffff8000000000 R09: ffffffffffefffff
[ 1093.380824] R10: 0000000000000008 R11: ffff9455de009140 R12: ffff9455ff6998c0
[ 1093.388792] R13: ffffffff8ae2d930 R14: 0000000000000000 R15: 0000000000000001
[ 1093.396425] NMI watchdog: BUG: soft lockup - CPU#48 stuck for 23s! [sshd:39696]
[ 1093.396473] Modules linked in: ebt_arp ebt_among ip6table_raw ip6table_mangle nf_conntrack_ipv6 nf_defrag_ipv6 iptable_nat nf_nat_ipv4 nf_nat xt_conm
[ 1093.396506] libiscsi_tcp libiscsi scsi_transport_iscsi nbd ipmi_devintf ipmi_msghandler br_netfilter bridge stp llc ip_tables x_tables autofs4 ext4g
[ 1093.396509] CPU: 48 PID: 39696 Comm: sshd Tainted: G W L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1093.396510] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.8.0 005/17/2018
[ 1093.396511] task: ffff945399bf7000 task.stack: ffffb0919bd4c000
[ 1093.396517] RIP: 0010:[<ffffffff8aec5b2f>] [<ffffffff8aec5b2f>] native_queued_spin_lock_slowpath+0x5f/0x1a0
[ 1093.396518] RSP: 0018:ffffb0919bd4fc60 EFLAGS: 00000202
[ 1093.396519] RAX: 0000000000000101 RBX: 0000000000000001 RCX: 0000000000000000
[ 1093.396519] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffffff8bce8580
[ 1093.396520] RBP: ffff9495ff4d6d08 R08: ffffffffffffff00 R09: 00000000000000ff
[ 1093.396521] R10: ffffb09171dbd028 R11: 0000000000000010 R12: 0000000000000200
[ 1093.396522] R13: ffffb0919bd4fcd8 R14: ffffb0919bd4fce0 R15: 0000000000000000
[ 1093.396523] FS: 00007fb13029d8c0(0000) GS:ffff9455ffa00000(0000) knlGS:0000000000000000
[ 1093.396524] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1093.396525] CR2: 00007ffcc7254f0e CR3: 00000032c1da0000 CR4: 0000000000362670
[ 1093.396525] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1093.396526] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1093.396526] Stack:
[ 1093.396529] ffffffff8b41b74d ffffffff8afca5a1 ffffffff8afca97d 0000000000000246
[ 1093.396530] 0000000100000000 ffffffff8af8d256 ffffffffffffffff d4628bc0f20e6a68
[ 1093.396532] ffff9495ff4d6cd8 ffff9495ff4d6d08 0000000000000200 0000000000016d00
[ 1093.396532] Call Trace:
[ 1093.396536] [<ffffffff8b41b74d>] ? _raw_spin_lock+0x1d/0x20
[ 1093.396538] [<ffffffff8afca5a1>] ? __purge_vmap_area_lazy+0xf1/0x300
[ 1093.396539] [<ffffffff8afca97d>] ? alloc_vmap_area+0x8d/0x3d0
[ 1093.396544] [<ffffffff8af8d256>] ? __alloc_pages_nodemask+0xf6/0x260
[ 1093.396545] [<ffffffff8afca8c4>] ? vm_unmap_aliases+0x114/0x140
[ 1093.396548] [<ffffffff8ae65313>] ? change_page_attr_set_clr+0xe3/0x4a0
[ 1093.396550] [<ffffffff8b32ab99>] ? bpf_convert_filter+0x9a9/0xa00
[ 1093.396552] [<ffffffff8ae6623d>] ? set_memory_ro+0x2d/0x40
[ 1093.396556] [<ffffffff8af60e35>] ? bpf_prog_select_runtime+0x25/0xd0
[ 1093.396557] [<ffffffff8b32ceae>] ? bpf_prepare_filter+0x38e/0x410
[ 1093.396560] [<ffffffff8afa5272>] ? kmemdup+0x32/0x40
[ 1093.396562] [<ffffffff8b32d08c>] ? bpf_prog_create_from_user+0xbc/0x110
[ 1093.396564] [<ffffffff8af2bfc0>] ? watchdog_nmi_disable+0x60/0x60
[ 1093.396566] [<ffffffff8af2c571>] ? do_seccomp+0x121/0x620
[ 1093.396567] [<ffffffff8ae902bc>] ? SyS_prctl+0x15c/0x490
[ 1093.396570] [<ffffffff8ae03b7d>] ? do_syscall_64+0x8d/0x100
[ 1093.396571] [<ffffffff8b41b80e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
[ 1093.396591] Code: 75 42 f0 0f ba 2f 08 b8 00 01 00 00 0f 42 f0 8b 07 30 e4 09 c6 f7 c6 00 ff ff ff 75 1b 85 f6 74 0e 8b 07 84 c0 74 08 f3 90 8b 07 <8
[ 1093.824966] FS: 0000000000000000(0000) GS:ffff9455ff680000(0000) knlGS:0000000000000000
[ 1093.833998] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1093.840412] CR2: 000055f2752ac028 CR3: 0000007f61e66000 CR4: 0000000000362670
[ 1093.848378] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1093.856343] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1093.864309] Stack:
[ 1093.866556] 0000000000019880 0000000114814440 ffffffff8b3119cd ffffffff8ae2d930
[ 1093.874849] 0000000000000000 ffffffff8b3119ce 0000000000000000 ffffffff8bade1c8
[ 1093.883149] ffffffff8aeff0b8 ffffffff8b3119cd 0000000000000005 ffffb09172f1fdcb
[ 1093.891447] Call Trace:
[ 1093.894186] [<ffffffff8b3119cd>] ? netif_receive_skb_internal+0x1d/0xa0
[ 1093.901674] [<ffffffff8ae2d930>] ? arch_unregister_cpu+0x20/0x20
[ 1093.908490] [<ffffffff8b3119ce>] ? netif_receive_skb_internal+0x1e/0xa0
[ 1093.915981] [<ffffffff8aeff0b8>] ? on_each_cpu+0x28/0x60
[ 1093.922020] [<ffffffff8b3119cd>] ? netif_receive_skb_internal+0x1d/0xa0
[ 1093.929508] [<ffffffff8ae2e848>] ? text_poke_bp+0x68/0xe0
[ 1093.935639] [<ffffffff8b3119cd>] ? netif_receive_skb_internal+0x1d/0xa0
[ 1093.943122] [<ffffffff8ae2b64c>] ? arch_jump_label_transform+0x9c/0x120
[ 1093.950599] [<ffffffff8af80102>] ? __jump_label_update+0x72/0x80
[ 1093.957406] [<ffffffff8af803df>] ? static_key_slow_inc+0x8f/0xa0
[ 1093.964213] [<ffffffff8ae9460a>] ? process_one_work+0x18a/0x430
[ 1093.970921] [<ffffffff8ae948fd>] ? worker_thread+0x4d/0x490
[ 1093.977242] [<ffffffff8ae948b0>] ? process_one_work+0x430/0x430
[ 1093.983956] [<ffffffff8ae9a969>] ? kthread+0xd9/0xf0
[ 1093.989598] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1093.996015] [<ffffffff8ae9a890>] ? kthread_park+0x60/0x60
[ 1094.002140] [<ffffffff8b41b9b7>] ? ret_from_fork+0x57/0x70
[ 1094.008361] Code: ca 24 00 3b 05 61 ac c1 00 89 c1 0f 8d 93 fe ff ff 48 98 49 8b 14 24 48 03 14 c5 00 f4 86 8b 8b 42 18 a8 01 74 09 f3 90 8b 42 18 <a
[ 1094.597761] bnx2x: [bnx2x_clean_tx_queue:1205(enp4s0f1)]timeout waiting for queue[4]: txdata->tx_pkt_prod(11890) != txdata->tx_pkt_cons(11856)
[ 1096.610693] bnx2x: [bnx2x_clean_tx_queue:1205(enp4s0f1)]timeout waiting for queue[5]: txdata->tx_pkt_prod(15219) != txdata->tx_pkt_cons(15182)
[ 1098.624849] bnx2x: [bnx2x_clean_tx_queue:1205(enp4s0f1)]timeout waiting for queue[6]: txdata->tx_pkt_prod(17968) != txdata->tx_pkt_cons(17925)
[ 1100.638989] bnx2x: [bnx2x_clean_tx_queue:1205(enp4s0f1)]timeout waiting for queue[7]: txdata->tx_pkt_prod(14854) != txdata->tx_pkt_cons(14827)
[ 1102.653128] bnx2x: [bnx2x_clean_tx_queue:1205(enp4s0f1)]timeout waiting for queue[0]: txdata->tx_pkt_prod(13326) != txdata->tx_pkt_cons(13296)
[ 1104.667263] bnx2x: [bnx2x_clean_tx_queue:1205(enp4s0f1)]timeout waiting for queue[1]: txdata->tx_pkt_prod(13176) != txdata->tx_pkt_cons(13112)
[ 1106.681401] bnx2x: [bnx2x_clean_tx_queue:1205(enp4s0f1)]timeout waiting for queue[2]: txdata->tx_pkt_prod(15211) != txdata->tx_pkt_cons(15184)
[ 1108.695612] bnx2x: [bnx2x_clean_tx_queue:1205(enp4s0f1)]timeout waiting for queue[3]: txdata->tx_pkt_prod(14677) != txdata->tx_pkt_cons(14624)
[ 1110.709750] bnx2x: [bnx2x_clean_tx_queue:1205(enp4s0f1)]timeout waiting for queue[4]: txdata->tx_pkt_prod(11890) != txdata->tx_pkt_cons(11856)
[ 1112.723849] bnx2x: [bnx2x_clean_tx_queue:1205(enp4s0f1)]timeout waiting for queue[5]: txdata->tx_pkt_prod(15219) != txdata->tx_pkt_cons(15182)
[ 1113.565877] NMI watchdog: BUG: soft lockup - CPU#69 stuck for 23s! [sshd:39668]
[ 1113.574042] Modules linked in: ebt_arp ebt_among ip6table_raw ip6table_mangle nf_conntrack_ipv6 nf_defrag_ipv6 iptable_nat nf_nat_ipv4 nf_nat xt_cont
[ 1113.706415] CPU: 69 PID: 39668 Comm: sshd Tainted: G W L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1113.717388] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.8.0 005/17/2018
[ 1113.725843] task: ffff9449256f0100 task.stack: ffffb0919b7d8000
[ 1113.732455] RIP: 0010:[<ffffffff8aefee25>] [<ffffffff8aefee25>] smp_call_function_many+0x1f5/0x250
[ 1113.742579] RSP: 0018:ffffb0919b7dbbe0 EFLAGS: 00000202
[ 1113.748510] RAX: 0000000000000003 RBX: 0000000000000200 RCX: 0000000000000027
[ 1113.756478] RDX: ffffd0913f8c3da0 RSI: 0000000000000200 RDI: ffff9495ff4998c8
[ 1113.764447] RBP: ffff9495ff4998c8 R08: ffffff8000000000 R09: ffffffffffffffff
[ 1113.772420] R10: 0000000000000008 R11: 0000000000000010 R12: ffff9495ff4998c0
[ 1113.780390] R13: ffffffff8ae696f0 R14: 0000000000000000 R15: 0000000000000001
[ 1113.788362] FS: 00007f4bb07818c0(0000) GS:ffff9495ff480000(0000) knlGS:0000000000000000
[ 1113.797398] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1113.803813] CR2: 00007ffd9ece5f0e CR3: 0000003847f9c000 CR4: 0000000000362670
[ 1113.811772] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1113.819738] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1113.827696] Stack:
[ 1113.829941] 0000000000019880 000000019b7dbc88 ffff945478341900 ffffffff8ae696f0
[ 1113.838246] 0000000000000000 ffffb0919b7dbcd8 ffffb0919b7dbce0 ffff9495ff4d6d08
[ 1113.846548] ffffffff8aeff0b8 ffff945478341900 ffffb0919b7dbc88 ffff9495ff4d6cd8
[ 1113.854850] Call Trace:
[ 1113.857589] [<ffffffff8ae696f0>] ? leave_mm+0xa0/0xa0
[ 1113.863328] [<ffffffff8aeff0b8>] ? on_each_cpu+0x28/0x60
[ 1113.869362] [<ffffffff8ae69e38>] ? flush_tlb_kernel_range+0x48/0x90
[ 1113.876461] [<ffffffff8afca516>] ? __purge_vmap_area_lazy+0x66/0x300
[ 1113.883658] [<ffffffff8afca764>] ? __purge_vmap_area_lazy+0x2b4/0x300
[ 1113.890951] [<ffffffff8afca8c4>] ? vm_unmap_aliases+0x114/0x140
[ 1113.897674] [<ffffffff8ae65313>] ? change_page_attr_set_clr+0xe3/0x4a0
[ 1113.905064] [<ffffffff8b32ab99>] ? bpf_convert_filter+0x9a9/0xa00
[ 1113.911971] [<ffffffff8ae6623d>] ? set_memory_ro+0x2d/0x40
[ 1113.918202] [<ffffffff8af60e35>] ? bpf_prog_select_runtime+0x25/0xd0
[ 1113.925399] [<ffffffff8b32ceae>] ? bpf_prepare_filter+0x38e/0x410
[ 1113.932309] [<ffffffff8afa5272>] ? kmemdup+0x32/0x40
[ 1113.937957] [<ffffffff8b32d08c>] ? bpf_prog_create_from_user+0xbc/0x110
[ 1113.945447] [<ffffffff8af2bfc0>] ? watchdog_nmi_disable+0x60/0x60
[ 1113.952348] [<ffffffff8af2c571>] ? do_seccomp+0x121/0x620
[ 1113.958478] [<ffffffff8ae902bc>] ? SyS_prctl+0x15c/0x490
[ 1113.964515] [<ffffffff8ae03b7d>] ? do_syscall_64+0x8d/0x100
[ 1113.970841] [<ffffffff8b41b80e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
[ 1113.978615] Code: ca 24 00 3b 05 61 ac c1 00 89 c1 0f 8d 93 fe ff ff 48 98 49 8b 14 24 48 03 14 c5 00 f4 86 8b 8b 42 18 a8 01 74 09 f3 90 8b 42 18 <a
[ 1114.737968] bnx2x: [bnx2x_clean_tx_queue:1205(enp4s0f1)]timeout waiting for queue[6]: txdata->tx_pkt_prod(17968) != txdata->tx_pkt_cons(17925)
[ 1116.752129] bnx2x: [bnx2x_clean_tx_queue:1205(enp4s0f1)]timeout waiting for queue[7]: txdata->tx_pkt_prod(14854) != txdata->tx_pkt_cons(14827)
[ 1121.170402] NMI watchdog: BUG: soft lockup - CPU#20 stuck for 23s! [kworker/20:1:499]
[ 1121.179145] Modules linked in: ebt_arp ebt_among ip6table_raw ip6table_mangle nf_conntrack_ipv6 nf_defrag_ipv6 iptable_nat nf_nat_ipv4 nf_nat xt_conl
[ 1121.311419] CPU: 20 PID: 499 Comm: kworker/20:1 Tainted: G W L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1121.322972] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.8.0 005/17/2018
[ 1121.331429] Workqueue: events netstamp_clear
[ 1121.336203] task: ffff9455e55f4140 task.stack: ffffb09172f1c000
[ 1121.342810] RIP: 0010:[<ffffffff8aefee20>] [<ffffffff8aefee20>] smp_call_function_many+0x1f0/0x250
[ 1121.352928] RSP: 0018:ffffb09172f1fd28 EFLAGS: 00000202
[ 1121.358858] RAX: 0000000000000003 RBX: 0000000000000200 RCX: 0000000000000027
[ 1121.366823] RDX: ffffd0913f8c3780 RSI: 0000000000000200 RDI: ffff9455ff6998c8
[ 1121.374787] RBP: ffff9455ff6998c8 R08: ffffff8000000000 R09: ffffffffffefffff
[ 1121.382753] R10: 0000000000000008 R11: ffff9455de009140 R12: ffff9455ff6998c0
[ 1121.390719] R13: ffffffff8ae2d930 R14: 0000000000000000 R15: 0000000000000001
[ 1121.398417] NMI watchdog: BUG: soft lockup - CPU#48 stuck for 22s! [sshd:39696]
[ 1121.398466] Modules linked in: ebt_arp ebt_among ip6table_raw ip6table_mangle nf_conntrack_ipv6 nf_defrag_ipv6 iptable_nat nf_nat_ipv4 nf_nat xt_con
[ 1121.398497] libiscsi_tcp libiscsi scsi_transport_iscsi nbd ipmi_devintf ipmi_msghandler br_netfilter bridge stp llc ip_tables x_tables autofs4 ext4
[ 1121.398500] CPU: 48 PID: 39696 Comm: sshd Tainted: G W L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1121.398501] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.8.0 005/17/2018
[ 1121.398502] task: ffff945399bf7000 task.stack: ffffb0919bd4c000
[ 1121.398507] RIP: 0010:[<ffffffff8aec5b2d>] [<ffffffff8aec5b2d>] native_queued_spin_lock_slowpath+0x5d/0x1a0
[ 1121.398508] RSP: 0018:ffffb0919bd4fc60 EFLAGS: 00000202
[ 1121.398509] RAX: 0000000000000101 RBX: 0000000000000001 RCX: 0000000000000000
[ 1121.398510] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffffff8bce8580
[ 1121.398510] RBP: ffff9495ff4d6d08 R08: ffffffffffffff00 R09: 00000000000000ff
[ 1121.398511] R10: ffffb09171dbd028 R11: 0000000000000010 R12: 0000000000000200
[ 1121.398512] R13: ffffb0919bd4fcd8 R14: ffffb0919bd4fce0 R15: 0000000000000000
[ 1121.398513] FS: 00007fb13029d8c0(0000) GS:ffff9455ffa00000(0000) knlGS:0000000000000000
[ 1121.398514] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1121.398515] CR2: 00007ffcc7254f0e CR3: 00000032c1da0000 CR4: 0000000000362670
[ 1121.398516] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1121.398516] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1121.398517] Stack:
[ 1121.398519] ffffffff8b41b74d ffffffff8afca5a1 ffffffff8afca97d 0000000000000246
[ 1121.398521] 0000000100000000 ffffffff8af8d256 ffffffffffffffff d4628bc0f20e6a68
[ 1121.398522] ffff9495ff4d6cd8 ffff9495ff4d6d08 0000000000000200 0000000000016d00
[ 1121.398523] Call Trace:
[ 1121.398527] [<ffffffff8b41b74d>] ? _raw_spin_lock+0x1d/0x20
[ 1121.398529] [<ffffffff8afca5a1>] ? __purge_vmap_area_lazy+0xf1/0x300
[ 1121.398530] [<ffffffff8afca97d>] ? alloc_vmap_area+0x8d/0x3d0
[ 1121.398535] [<ffffffff8af8d256>] ? __alloc_pages_nodemask+0xf6/0x260
[ 1121.398536] [<ffffffff8afca8c4>] ? vm_unmap_aliases+0x114/0x140
[ 1121.398539] [<ffffffff8ae65313>] ? change_page_attr_set_clr+0xe3/0x4a0
[ 1121.398541] [<ffffffff8b32ab99>] ? bpf_convert_filter+0x9a9/0xa00
[ 1121.398543] [<ffffffff8ae6623d>] ? set_memory_ro+0x2d/0x40
[ 1121.398547] [<ffffffff8af60e35>] ? bpf_prog_select_runtime+0x25/0xd0
[ 1121.398548] [<ffffffff8b32ceae>] ? bpf_prepare_filter+0x38e/0x410
[ 1121.398551] [<ffffffff8afa5272>] ? kmemdup+0x32/0x40
[ 1121.398553] [<ffffffff8b32d08c>] ? bpf_prog_create_from_user+0xbc/0x110
[ 1121.398555] [<ffffffff8af2bfc0>] ? watchdog_nmi_disable+0x60/0x60
[ 1121.398557] [<ffffffff8af2c571>] ? do_seccomp+0x121/0x620
[ 1121.398558] [<ffffffff8ae902bc>] ? SyS_prctl+0x15c/0x490
[ 1121.398561] [<ffffffff8ae03b7d>] ? do_syscall_64+0x8d/0x100
[ 1121.398562] [<ffffffff8b41b80e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
[ 1121.398581] Code: 85 f6 75 42 f0 0f ba 2f 08 b8 00 01 00 00 0f 42 f0 8b 07 30 e4 09 c6 f7 c6 00 ff ff ff 75 1b 85 f6 74 0e 8b 07 84 c0 74 08 f3 90 <f
[ 1121.826892] FS: 0000000000000000(0000) GS:ffff9455ff680000(0000) knlGS:0000000000000000
[ 1121.835924] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1121.842338] CR2: 000055f2752ac028 CR3: 0000007f61e66000 CR4: 0000000000362670
[ 1121.850302] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1121.858268] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1121.866224] Stack:
[ 1121.868467] 0000000000019880 0000000114814440 ffffffff8b3119cd ffffffff8ae2d930
[ 1121.876766] 0000000000000000 ffffffff8b3119ce 0000000000000000 ffffffff8bade1c8
[ 1121.885066] ffffffff8aeff0b8 ffffffff8b3119cd 0000000000000005 ffffb09172f1fdcb
[ 1121.893362] Call Trace:
[ 1121.896097] [<ffffffff8b3119cd>] ? netif_receive_skb_internal+0x1d/0xa0
[ 1121.903582] [<ffffffff8ae2d930>] ? arch_unregister_cpu+0x20/0x20
[ 1121.910390] [<ffffffff8b3119ce>] ? netif_receive_skb_internal+0x1e/0xa0
[ 1121.917875] [<ffffffff8aeff0b8>] ? on_each_cpu+0x28/0x60
[ 1121.923908] [<ffffffff8b3119cd>] ? netif_receive_skb_internal+0x1d/0xa0
[ 1121.931391] [<ffffffff8ae2e848>] ? text_poke_bp+0x68/0xe0
[ 1121.937519] [<ffffffff8b3119cd>] ? netif_receive_skb_internal+0x1d/0xa0
[ 1121.945005] [<ffffffff8ae2b64c>] ? arch_jump_label_transform+0x9c/0x120
[ 1121.952489] [<ffffffff8af80102>] ? __jump_label_update+0x72/0x80
[ 1121.959295] [<ffffffff8af803df>] ? static_key_slow_inc+0x8f/0xa0
[ 1121.966102] [<ffffffff8ae9460a>] ? process_one_work+0x18a/0x430
[ 1121.972809] [<ffffffff8ae948fd>] ? worker_thread+0x4d/0x490
[ 1121.979131] [<ffffffff8ae948b0>] ? process_one_work+0x430/0x430
[ 1121.985841] [<ffffffff8ae9a969>] ? kthread+0xd9/0xf0
[ 1121.991484] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1121.997902] [<ffffffff8ae9a890>] ? kthread_park+0x60/0x60
[ 1122.004028] [<ffffffff8b41b9b7>] ? ret_from_fork+0x57/0x70
[ 1122.010249] Code: 48 63 d2 e8 53 ca 24 00 3b 05 61 ac c1 00 89 c1 0f 8d 93 fe ff ff 48 98 49 8b 14 24 48 03 14 c5 00 f4 86 8b 8b 42 18 a8 01 74 09 <f
[ 1125.290685] NMI watchdog: BUG: soft lockup - CPU#35 stuck for 23s! [CPU 0/KVM:8532]
[ 1125.299237] Modules linked in: ebt_arp ebt_among ip6table_raw ip6table_mangle nf_conntrack_ipv6 nf_defrag_ipv6 iptable_nat nf_nat_ipv4 nf_nat xt_con
[ 1125.431567] CPU: 35 PID: 8532 Comm: CPU 0/KVM Tainted: G W L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1125.442930] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.8.0 005/17/2018
[ 1125.451384] task: ffff9493c1b9f080 task.stack: ffffb091aef38000
[ 1125.458001] RIP: 0010:[<ffffffff8aefeaa7>] [<ffffffff8aefeaa7>] smp_call_function_single+0xd7/0x130
[ 1125.468222] RSP: 0018:ffffb091aef3bab0 EFLAGS: 00000202
[ 1125.474153] RAX: 0000000000000000 RBX: 0000000000000043 RCX: 0000000000000000
[ 1125.482112] RDX: 0000000000000003 RSI: 00000000000000fb RDI: 0000000000000202
[ 1125.490079] RBP: ffffffffc065f620 R08: 0000010010d16781 R09: 0000000000003fe0
[ 1125.498038] R10: 0000000080604800 R11: 0000000000000000 R12: 0000000000000043
[ 1125.506006] R13: ffff9492a1b90540 R14: 0000000000000000 R15: 0000000000000023
[ 1125.513974] FS: 00007f6caae2e700(0000) GS:ffff9495ff040000(0000) knlGS:0000000000000000
[ 1125.523007] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1125.529422] CR2: 00007f1faffbb4f0 CR3: 0000007c21b8e000 CR4: 0000000000362670
[ 1125.537380] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1125.545349] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1125.553314] Stack:
[ 1125.555560] 000000070000001e 0000000100000024 0000000000000000 ffffffffc065f620
[ 1125.563861] ffff9492a1b94ad8 0000000000000003 bfd58d00d1c4bf99 0000000000000023
[ 1125.572164] ffffb091aef3bc00 ffffffffc065eabf ffff9455ffa18980 0000000000000016
[ 1125.580467] Call Trace:
[ 1125.583209] [<ffffffffc065f620>] ? update_debugctlmsr+0x20/0x20 [kvm_intel]
[ 1125.591090] [<ffffffffc065eabf>] ? vmx_vcpu_load+0x9f/0x350 [kvm_intel]
[ 1125.598583] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1125.605008] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1125.611423] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1125.617845] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1125.624273] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1125.630697] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1125.637117] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1125.643538] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1125.649959] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1125.656380] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1125.662801] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1125.669223] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1125.675645] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1125.682060] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1125.688483] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1125.694904] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1125.701326] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1125.707782] [<ffffffffc0970bd6>] ? kvm_arch_vcpu_load+0x46/0x290 [kvm]
[ 1125.715176] [<ffffffff8aea1de7>] ? finish_task_switch+0x137/0x210
[ 1125.722083] [<ffffffff8b416a61>] ? __schedule+0x241/0x6f0
[ 1125.728220] [<ffffffffc065ded0>] ? vmx_set_supported_cpuid+0x20/0x20 [kvm_intel]
[ 1125.736587] [<ffffffffc065bbe0>] ? vmx_set_tss_addr+0x130/0x130 [kvm_intel]
[ 1125.744466] [<ffffffff8b416f42>] ? schedule+0x32/0x80
[ 1125.750240] [<ffffffffc095a45a>] ? kvm_vcpu_block+0x8a/0x2f0 [kvm]
[ 1125.757273] [<ffffffffc0976c8a>] ? kvm_arch_vcpu_ioctl_run+0x44a/0x16d0 [kvm]
[ 1125.765342] [<ffffffff8aea4d8e>] ? check_preempt_curr+0x4e/0x90
[ 1125.772082] [<ffffffffc0970bf1>] ? kvm_arch_vcpu_load+0x61/0x290 [kvm]
[ 1125.779503] [<ffffffffc095c665>] ? kvm_vcpu_ioctl+0x315/0x5e0 [kvm]
[ 1125.786603] [<ffffffff8aea5e00>] ? wake_up_q+0x70/0x70
[ 1125.792446] [<ffffffff8aebd17f>] ? __wake_up_common+0x4f/0x90
[ 1125.798967] [<ffffffff8b0203c2>] ? do_vfs_ioctl+0xa2/0x620
[ 1125.805188] [<ffffffff8b00bd84>] ? vfs_write+0x144/0x190
[ 1125.811223] [<ffffffff8b0209b4>] ? SyS_ioctl+0x74/0x80
[ 1125.817063] [<ffffffff8ae03b7d>] ? do_syscall_64+0x8d/0x100
[ 1125.823390] [<ffffffff8b41b80e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
[ 1125.831164] Code: 00 75 73 48 83 c4 38 5b 5d c3 48 8d 74 24 10 48 89 d1 89 df 48 89 ea e8 28 fe ff ff 8b 54 24 28 83 e2 01 74 0b f3 90 8b 54 24 28 <8
[ 1126.768801] bnx2x: [bnx2x_state_wait:310(enp4s0f1)]timeout waiting for state 0
[ 1126.776884] bnx2x: [bnx2x_del_all_macs:8528(enp4s0f1)]Failed to delete MACs: -16
[ 1126.785159] bnx2x: [bnx2x_chip_cleanup:9348(enp4s0f1)]Failed to schedule DEL commands for UC MACs list: -16
[ 1136.440567] bnx2x: [bnx2x_state_wait:310(enp4s0f1)]timeout waiting for state 1
[ 1136.448682] bnx2x: [bnx2x_chip_cleanup:9358(enp4s0f1)]Failed to delete all VLANs
[ 1141.567766] NMI watchdog: BUG: soft lockup - CPU#69 stuck for 23s! [sshd:39668]
[ 1141.575930] Modules linked in: ebt_arp ebt_among ip6table_raw ip6table_mangle nf_conntrack_ipv6 nf_defrag_ipv6 iptable_nat nf_nat_ipv4 nf_nat xt_conr
[ 1141.708248] CPU: 69 PID: 39668 Comm: sshd Tainted: G W L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1141.719212] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.8.0 005/17/2018
[ 1141.727664] task: ffff9449256f0100 task.stack: ffffb0919b7d8000
[ 1141.734274] RIP: 0010:[<ffffffff8aefee25>] [<ffffffff8aefee25>] smp_call_function_many+0x1f5/0x250
[ 1141.744389] RSP: 0018:ffffb0919b7dbbe0 EFLAGS: 00000202
[ 1141.750320] RAX: 0000000000000003 RBX: 0000000000000200 RCX: 0000000000000027
[ 1141.758278] RDX: ffffd0913f8c3da0 RSI: 0000000000000200 RDI: ffff9495ff4998c8
[ 1141.766246] RBP: ffff9495ff4998c8 R08: ffffff8000000000 R09: ffffffffffffffff
[ 1141.774205] R10: 0000000000000008 R11: 0000000000000010 R12: ffff9495ff4998c0
[ 1141.782171] R13: ffffffff8ae696f0 R14: 0000000000000000 R15: 0000000000000001
[ 1141.790139] FS: 00007f4bb07818c0(0000) GS:ffff9495ff480000(0000) knlGS:0000000000000000
[ 1141.799173] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1141.805580] CR2: 00007ffd9ece5f0e CR3: 0000003847f9c000 CR4: 0000000000362670
[ 1141.813546] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1141.821512] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1141.829479] Stack:
[ 1141.831722] 0000000000019880 000000019b7dbc88 ffff945478341900 ffffffff8ae696f0
[ 1141.840026] 0000000000000000 ffffb0919b7dbcd8 ffffb0919b7dbce0 ffff9495ff4d6d08
[ 1141.848322] ffffffff8aeff0b8 ffff945478341900 ffffb0919b7dbc88 ffff9495ff4d6cd8
[ 1141.856624] Call Trace:
[ 1141.859362] [<ffffffff8ae696f0>] ? leave_mm+0xa0/0xa0
[ 1141.865106] [<ffffffff8aeff0b8>] ? on_each_cpu+0x28/0x60
[ 1141.871133] [<ffffffff8ae69e38>] ? flush_tlb_kernel_range+0x48/0x90
[ 1141.878233] [<ffffffff8afca516>] ? __purge_vmap_area_lazy+0x66/0x300
[ 1141.885427] [<ffffffff8afca764>] ? __purge_vmap_area_lazy+0x2b4/0x300
[ 1141.892720] [<ffffffff8afca8c4>] ? vm_unmap_aliases+0x114/0x140
[ 1141.899434] [<ffffffff8ae65313>] ? change_page_attr_set_clr+0xe3/0x4a0
[ 1141.906824] [<ffffffff8b32ab99>] ? bpf_convert_filter+0x9a9/0xa00
[ 1141.913730] [<ffffffff8ae6623d>] ? set_memory_ro+0x2d/0x40
[ 1141.919956] [<ffffffff8af60e35>] ? bpf_prog_select_runtime+0x25/0xd0
[ 1141.927153] [<ffffffff8b32ceae>] ? bpf_prepare_filter+0x38e/0x410
[ 1141.934060] [<ffffffff8afa5272>] ? kmemdup+0x32/0x40
[ 1141.939704] [<ffffffff8b32d08c>] ? bpf_prog_create_from_user+0xbc/0x110
[ 1141.947193] [<ffffffff8af2bfc0>] ? watchdog_nmi_disable+0x60/0x60
[ 1141.954100] [<ffffffff8af2c571>] ? do_seccomp+0x121/0x620
[ 1141.960230] [<ffffffff8ae902bc>] ? SyS_prctl+0x15c/0x490
[ 1141.966263] [<ffffffff8ae03b7d>] ? do_syscall_64+0x8d/0x100
[ 1141.972589] [<ffffffff8b41b80e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
[ 1141.980362] Code: ca 24 00 3b 05 61 ac c1 00 89 c1 0f 8d 93 fe ff ff 48 98 49 8b 14 24 48 03 14 c5 00 f4 86 8b 8b 42 18 a8 01 74 09 f3 90 8b 42 18 <a
[ 1146.057697] bnx2x: [bnx2x_state_wait:310(enp4s0f1)]timeout waiting for state 9
[ 1149.172253] NMI watchdog: BUG: soft lockup - CPU#20 stuck for 23s! [kworker/20:1:499]
[ 1149.180995] Modules linked in: ebt_arp ebt_among ip6table_raw ip6table_mangle nf_conntrack_ipv6 nf_defrag_ipv6 iptable_nat nf_nat_ipv4 nf_nat xt_cons
[ 1149.313225] CPU: 20 PID: 499 Comm: kworker/20:1 Tainted: G W L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1149.324778] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.8.0 005/17/2018
[ 1149.333236] Workqueue: events netstamp_clear
[ 1149.338010] task: ffff9455e55f4140 task.stack: ffffb09172f1c000
[ 1149.344618] RIP: 0010:[<ffffffff8aefee25>] [<ffffffff8aefee25>] smp_call_function_many+0x1f5/0x250
[ 1149.354737] RSP: 0018:ffffb09172f1fd28 EFLAGS: 00000202
[ 1149.360658] RAX: 0000000000000003 RBX: 0000000000000200 RCX: 0000000000000027
[ 1149.368625] RDX: ffffd0913f8c3780 RSI: 0000000000000200 RDI: ffff9455ff6998c8
[ 1149.376592] RBP: ffff9455ff6998c8 R08: ffffff8000000000 R09: ffffffffffefffff
[ 1149.384550] R10: 0000000000000008 R11: ffff9455de009140 R12: ffff9455ff6998c0
[ 1149.392515] R13: ffffffff8ae2d930 R14: 0000000000000000 R15: 0000000000000001
[ 1149.400268] NMI watchdog: BUG: soft lockup - CPU#48 stuck for 22s! [sshd:39696]
[ 1149.400311] Modules linked in: ebt_arp ebt_among ip6table_raw ip6table_mangle nf_conntrack_ipv6 nf_defrag_ipv6 iptable_nat nf_nat_ipv4 nf_nat xt_cono
[ 1149.400342] libiscsi_tcp libiscsi scsi_transport_iscsi nbd ipmi_devintf ipmi_msghandler br_netfilter bridge stp llc ip_tables x_tables autofs4 ext4i
[ 1149.400345] CPU: 48 PID: 39696 Comm: sshd Tainted: G W L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1149.400346] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.8.0 005/17/2018
[ 1149.400347] task: ffff945399bf7000 task.stack: ffffb0919bd4c000
[ 1149.400352] RIP: 0010:[<ffffffff8aec5b2f>] [<ffffffff8aec5b2f>] native_queued_spin_lock_slowpath+0x5f/0x1a0
[ 1149.400353] RSP: 0018:ffffb0919bd4fc60 EFLAGS: 00000202
[ 1149.400354] RAX: 0000000000000101 RBX: 0000000000000001 RCX: 0000000000000000
[ 1149.400354] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffffff8bce8580
[ 1149.400355] RBP: ffff9495ff4d6d08 R08: ffffffffffffff00 R09: 00000000000000ff
[ 1149.400356] R10: ffffb09171dbd028 R11: 0000000000000010 R12: 0000000000000200
[ 1149.400357] R13: ffffb0919bd4fcd8 R14: ffffb0919bd4fce0 R15: 0000000000000000
[ 1149.400358] FS: 00007fb13029d8c0(0000) GS:ffff9455ffa00000(0000) knlGS:0000000000000000
[ 1149.400359] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1149.400360] CR2: 00007ffcc7254f0e CR3: 00000032c1da0000 CR4: 0000000000362670
[ 1149.400361] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1149.400361] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1149.400362] Stack:
[ 1149.400364] ffffffff8b41b74d ffffffff8afca5a1 ffffffff8afca97d 0000000000000246
[ 1149.400365] 0000000100000000 ffffffff8af8d256 ffffffffffffffff d4628bc0f20e6a68
[ 1149.400367] ffff9495ff4d6cd8 ffff9495ff4d6d08 0000000000000200 0000000000016d00
[ 1149.400367] Call Trace:
[ 1149.400372] [<ffffffff8b41b74d>] ? _raw_spin_lock+0x1d/0x20
[ 1149.400374] [<ffffffff8afca5a1>] ? __purge_vmap_area_lazy+0xf1/0x300
[ 1149.400375] [<ffffffff8afca97d>] ? alloc_vmap_area+0x8d/0x3d0
[ 1149.400379] [<ffffffff8af8d256>] ? __alloc_pages_nodemask+0xf6/0x260
[ 1149.400381] [<ffffffff8afca8c4>] ? vm_unmap_aliases+0x114/0x140
[ 1149.400384] [<ffffffff8ae65313>] ? change_page_attr_set_clr+0xe3/0x4a0
[ 1149.400386] [<ffffffff8b32ab99>] ? bpf_convert_filter+0x9a9/0xa00
[ 1149.400387] [<ffffffff8ae6623d>] ? set_memory_ro+0x2d/0x40
[ 1149.400392] [<ffffffff8af60e35>] ? bpf_prog_select_runtime+0x25/0xd0
[ 1149.400393] [<ffffffff8b32ceae>] ? bpf_prepare_filter+0x38e/0x410
[ 1149.400396] [<ffffffff8afa5272>] ? kmemdup+0x32/0x40
[ 1149.400397] [<ffffffff8b32d08c>] ? bpf_prog_create_from_user+0xbc/0x110
[ 1149.400400] [<ffffffff8af2bfc0>] ? watchdog_nmi_disable+0x60/0x60
[ 1149.400402] [<ffffffff8af2c571>] ? do_seccomp+0x121/0x620
[ 1149.400403] [<ffffffff8ae902bc>] ? SyS_prctl+0x15c/0x490
[ 1149.400406] [<ffffffff8ae03b7d>] ? do_syscall_64+0x8d/0x100
[ 1149.400408] [<ffffffff8b41b80e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
[ 1149.400426] Code: 75 42 f0 0f ba 2f 08 b8 00 01 00 00 0f 42 f0 8b 07 30 e4 09 c6 f7 c6 00 ff ff ff 75 1b 85 f6 74 0e 8b 07 84 c0 74 08 f3 90 8b 07 <1
[ 1149.828691] FS: 0000000000000000(0000) GS:ffff9455ff680000(0000) knlGS:0000000000000000
[ 1149.837725] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1149.844130] CR2: 000055f2752ac028 CR3: 0000007f61e66000 CR4: 0000000000362670
[ 1149.852096] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1149.860060] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1149.868024] Stack:
[ 1149.870268] 0000000000019880 0000000114814440 ffffffff8b3119cd ffffffff8ae2d930
[ 1149.878568] 0000000000000000 ffffffff8b3119ce 0000000000000000 ffffffff8bade1c8
[ 1149.886868] ffffffff8aeff0b8 ffffffff8b3119cd 0000000000000005 ffffb09172f1fdcb
[ 1149.895160] Call Trace:
[ 1149.897897] [<ffffffff8b3119cd>] ? netif_receive_skb_internal+0x1d/0xa0
[ 1149.905382] [<ffffffff8ae2d930>] ? arch_unregister_cpu+0x20/0x20
[ 1149.912189] [<ffffffff8b3119ce>] ? netif_receive_skb_internal+0x1e/0xa0
[ 1149.919674] [<ffffffff8aeff0b8>] ? on_each_cpu+0x28/0x60
[ 1149.925706] [<ffffffff8b3119cd>] ? netif_receive_skb_internal+0x1d/0xa0
[ 1149.933186] [<ffffffff8ae2e848>] ? text_poke_bp+0x68/0xe0
[ 1149.939325] [<ffffffff8b3119cd>] ? netif_receive_skb_internal+0x1d/0xa0
[ 1149.946809] [<ffffffff8ae2b64c>] ? arch_jump_label_transform+0x9c/0x120
[ 1149.954294] [<ffffffff8af80102>] ? __jump_label_update+0x72/0x80
[ 1149.961102] [<ffffffff8af803df>] ? static_key_slow_inc+0x8f/0xa0
[ 1149.967907] [<ffffffff8ae9460a>] ? process_one_work+0x18a/0x430
[ 1149.974617] [<ffffffff8ae948fd>] ? worker_thread+0x4d/0x490
[ 1149.980939] [<ffffffff8ae948b0>] ? process_one_work+0x430/0x430
[ 1149.987652] [<ffffffff8ae9a969>] ? kthread+0xd9/0xf0
[ 1149.993297] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1149.999718] [<ffffffff8ae9a890>] ? kthread_park+0x60/0x60
[ 1150.005847] [<ffffffff8b41b9b7>] ? ret_from_fork+0x57/0x70
[ 1150.012068] Code: ca 24 00 3b 05 61 ac c1 00 89 c1 0f 8d 93 fe ff ff 48 98 49 8b 14 24 48 03 14 c5 00 f4 86 8b 8b 42 18 a8 01 74 09 f3 90 8b 42 18 <a
[ 1153.292518] NMI watchdog: BUG: soft lockup - CPU#35 stuck for 23s! [CPU 0/KVM:8532]
[ 1153.301070] Modules linked in: ebt_arp ebt_among ip6table_raw ip6table_mangle nf_conntrack_ipv6 nf_defrag_ipv6 iptable_nat nf_nat_ipv4 nf_nat xt_con4
[ 1153.433423] CPU: 35 PID: 8532 Comm: CPU 0/KVM Tainted: G W L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1153.444784] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.8.0 005/17/2018
[ 1153.453239] task: ffff9493c1b9f080 task.stack: ffffb091aef38000
[ 1153.459849] RIP: 0010:[<ffffffff8aefeaa7>] [<ffffffff8aefeaa7>] smp_call_function_single+0xd7/0x130
[ 1153.470061] RSP: 0018:ffffb091aef3bab0 EFLAGS: 00000202
[ 1153.475991] RAX: 0000000000000000 RBX: 0000000000000043 RCX: 0000000000000000
[ 1153.483959] RDX: 0000000000000003 RSI: 00000000000000fb RDI: 0000000000000202
[ 1153.491925] RBP: ffffffffc065f620 R08: 0000010010d16781 R09: 0000000000003fe0
[ 1153.499884] R10: 0000000080604800 R11: 0000000000000000 R12: 0000000000000043
[ 1153.507852] R13: ffff9492a1b90540 R14: 0000000000000000 R15: 0000000000000023
[ 1153.515822] FS: 00007f6caae2e700(0000) GS:ffff9495ff040000(0000) knlGS:0000000000000000
[ 1153.524856] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1153.531264] CR2: 00007f1faffbb4f0 CR3: 0000007c21b8e000 CR4: 0000000000362670
[ 1153.539231] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1153.547190] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1153.555156] Stack:
[ 1153.557403] 000000070000001e 0000000100000024 0000000000000000 ffffffffc065f620
[ 1153.565707] ffff9492a1b94ad8 0000000000000003 bfd58d00d1c4bf99 0000000000000023
[ 1153.574009] ffffb091aef3bc00 ffffffffc065eabf ffff9455ffa18980 0000000000000016
[ 1153.582309] Call Trace:
[ 1153.585050] [<ffffffffc065f620>] ? update_debugctlmsr+0x20/0x20 [kvm_intel]
[ 1153.592927] [<ffffffffc065eabf>] ? vmx_vcpu_load+0x9f/0x350 [kvm_intel]
[ 1153.600411] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1153.606831] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1153.613253] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1153.619674] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1153.626096] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1153.632517] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1153.638935] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1153.645357] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1153.651779] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1153.658201] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1153.664622] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1153.671045] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1153.677467] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1153.683888] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1153.690308] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1153.696728] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1153.703151] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1153.709604] [<ffffffffc0970bd6>] ? kvm_arch_vcpu_load+0x46/0x290 [kvm]
[ 1153.716997] [<ffffffff8aea1de7>] ? finish_task_switch+0x137/0x210
[ 1153.723906] [<ffffffff8b416a61>] ? __schedule+0x241/0x6f0
[ 1153.730031] [<ffffffffc065ded0>] ? vmx_set_supported_cpuid+0x20/0x20 [kvm_intel]
[ 1153.738386] [<ffffffffc065bbe0>] ? vmx_set_tss_addr+0x130/0x130 [kvm_intel]
[ 1153.746262] [<ffffffff8b416f42>] ? schedule+0x32/0x80
[ 1153.752035] [<ffffffffc095a45a>] ? kvm_vcpu_block+0x8a/0x2f0 [kvm]
[ 1153.759069] [<ffffffffc0976c8a>] ? kvm_arch_vcpu_ioctl_run+0x44a/0x16d0 [kvm]
[ 1153.767139] [<ffffffff8aea4d8e>] ? check_preempt_curr+0x4e/0x90
[ 1153.773884] [<ffffffffc0970bf1>] ? kvm_arch_vcpu_load+0x61/0x290 [kvm]
[ 1153.781310] [<ffffffffc095c665>] ? kvm_vcpu_ioctl+0x315/0x5e0 [kvm]
[ 1153.788410] [<ffffffff8aea5e00>] ? wake_up_q+0x70/0x70
[ 1153.794248] [<ffffffff8aebd17f>] ? __wake_up_common+0x4f/0x90
[ 1153.800767] [<ffffffff8b0203c2>] ? do_vfs_ioctl+0xa2/0x620
[ 1153.806997] [<ffffffff8b00bd84>] ? vfs_write+0x144/0x190
[ 1153.813030] [<ffffffff8b0209b4>] ? SyS_ioctl+0x74/0x80
[ 1153.818870] [<ffffffff8ae03b7d>] ? do_syscall_64+0x8d/0x100
[ 1153.825198] [<ffffffff8b41b80e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
[ 1153.832971] Code: 00 75 73 48 83 c4 38 5b 5d c3 48 8d 74 24 10 48 89 d1 89 df 48 89 ea e8 28 fe ff ff 8b 54 24 28 83 e2 01 74 0b f3 90 8b 54 24 28 <8
[ 1154.372584] INFO: rcu_sched detected stalls on CPUs/tasks:
[ 1154.378733] 39-...: (6 GPs behind) idle=5f1/140000000000000/0 softirq=35610/35612 fqs=17516
[ 1154.388253] (detected by 59, t=36766 jiffies, g=36760, c=36759, q=65834)
[ 1154.395855] Task dump for CPU 39:
[ 1154.399556] qemu-system-x86 R running task 0 9835 1 0x00000008
[ 1154.407449] ffff9495e5826080 ffff9495ff0d8980 ffff9455dedd1100 0000000000000000
[ 1154.415741] ffff9495e3744c00 ffffb091bd4339f0 ffffffff8b416a61 ffffffff8aeeb6f4
[ 1154.424035] 0000000000000040 ffff9495ff0d8980 00ff9455dedd18d8 ffff9455dedd1100
[ 1154.432334] Call Trace:
[ 1154.435075] [<ffffffff8b416a61>] ? __schedule+0x241/0x6f0
[ 1154.441208] [<ffffffff8aeeb6f4>] ? hrtimer_start_range_ns+0x194/0x360
[ 1154.448507] [<ffffffff8aeeb117>] ? hrtimer_try_to_cancel+0x27/0x110
[ 1154.455613] [<ffffffff8b41a795>] ? schedule_hrtimeout_range_clock+0xc5/0x1a0
[ 1154.463593] [<ffffffff8aeeaee0>] ? __hrtimer_init+0xa0/0xa0
[ 1154.469922] [<ffffffff8b41b542>] ? _raw_spin_lock_irqsave+0x32/0x40
[ 1154.477029] [<ffffffff8aebd474>] ? remove_wait_queue+0x14/0x30
[ 1154.483650] [<ffffffff8b02133d>] ? poll_freewait+0x3d/0xa0
[ 1154.489882] [<ffffffff8b02293d>] ? do_sys_poll+0x37d/0x560
[ 1154.496115] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1154.503802] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1154.511488] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1154.519174] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1154.526863] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1154.534550] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1154.542239] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1154.549928] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1154.557615] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1154.565306] [<ffffffff8b022e28>] ? SyS_ppoll+0x168/0x190
[ 1154.571342] [<ffffffff8ae03b7d>] ? do_syscall_64+0x8d/0x100
[ 1154.577671] [<ffffffff8b41b80e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
[ 1155.760313] bnx2x: [bnx2x_state_wait:310(enp4s0f1)]timeout waiting for state 2
[ 1155.768442] bnx2x: [bnx2x_func_stop:9107(enp4s0f1)]FUNC_STOP ramrod failed. Running a dry transaction
[ 1156.552284] bnx2x 0000:04:00.1 enp4s0f1: using MSI-X IRQs: sp 128 fp[0] 130 ... fp[7] 137
[ 1166.387344] bnx2x: [bnx2x_state_wait:310(enp4s0f1)]timeout waiting for state 1
[ 1166.395424] bnx2x: [bnx2x_nic_load:2764(enp4s0f1)]Function start failed!
[ 1169.569526] NMI watchdog: BUG: soft lockup - CPU#69 stuck for 23s! [sshd:39668]
[ 1169.577692] Modules linked in: ebt_arp ebt_among ip6table_raw ip6table_mangle nf_conntrack_ipv6 nf_defrag_ipv6 iptable_nat nf_nat_ipv4 nf_nat xt_cona
[ 1169.710295] CPU: 69 PID: 39668 Comm: sshd Tainted: G W L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1169.721273] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.8.0 005/17/2018
[ 1169.729731] task: ffff9449256f0100 task.stack: ffffb0919b7d8000
[ 1169.736344] RIP: 0010:[<ffffffff8aefee25>] [<ffffffff8aefee25>] smp_call_function_many+0x1f5/0x250
[ 1169.746480] RSP: 0018:ffffb0919b7dbbe0 EFLAGS: 00000202
[ 1169.752415] RAX: 0000000000000003 RBX: 0000000000000200 RCX: 0000000000000027
[ 1169.760386] RDX: ffffd0913f8c3da0 RSI: 0000000000000200 RDI: ffff9495ff4998c8
[ 1169.768357] RBP: ffff9495ff4998c8 R08: ffffff8000000000 R09: ffffffffffffffff
[ 1169.776328] R10: 0000000000000008 R11: 0000000000000010 R12: ffff9495ff4998c0
[ 1169.784300] R13: ffffffff8ae696f0 R14: 0000000000000000 R15: 0000000000000001
[ 1169.792273] FS: 00007f4bb07818c0(0000) GS:ffff9495ff480000(0000) knlGS:0000000000000000
[ 1169.801310] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1169.807731] CR2: 00007ffd9ece5f0e CR3: 0000003847f9c000 CR4: 0000000000362670
[ 1169.815705] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1169.823676] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1169.831646] Stack:
[ 1169.833897] 0000000000019880 000000019b7dbc88 ffff945478341900 ffffffff8ae696f0
[ 1169.842208] 0000000000000000 ffffb0919b7dbcd8 ffffb0919b7dbce0 ffff9495ff4d6d08
[ 1169.850519] ffffffff8aeff0b8 ffff945478341900 ffffb0919b7dbc88 ffff9495ff4d6cd8
[ 1169.858831] Call Trace:
[ 1169.861576] [<ffffffff8ae696f0>] ? leave_mm+0xa0/0xa0
[ 1169.867328] [<ffffffff8aeff0b8>] ? on_each_cpu+0x28/0x60
[ 1169.873368] [<ffffffff8ae69e38>] ? flush_tlb_kernel_range+0x48/0x90
[ 1169.880475] [<ffffffff8afca516>] ? __purge_vmap_area_lazy+0x66/0x300
[ 1169.887678] [<ffffffff8afca764>] ? __purge_vmap_area_lazy+0x2b4/0x300
[ 1169.894977] [<ffffffff8afca8c4>] ? vm_unmap_aliases+0x114/0x140
[ 1169.901696] [<ffffffff8ae65313>] ? change_page_attr_set_clr+0xe3/0x4a0
[ 1169.909102] [<ffffffff8b32ab99>] ? bpf_convert_filter+0x9a9/0xa00
[ 1169.916016] [<ffffffff8ae6623d>] ? set_memory_ro+0x2d/0x40
[ 1169.922253] [<ffffffff8af60e35>] ? bpf_prog_select_runtime+0x25/0xd0
[ 1169.929455] [<ffffffff8b32ceae>] ? bpf_prepare_filter+0x38e/0x410
[ 1169.936369] [<ffffffff8afa5272>] ? kmemdup+0x32/0x40
[ 1169.942021] [<ffffffff8b32d08c>] ? bpf_prog_create_from_user+0xbc/0x110
[ 1169.949516] [<ffffffff8af2bfc0>] ? watchdog_nmi_disable+0x60/0x60
[ 1169.956430] [<ffffffff8af2c571>] ? do_seccomp+0x121/0x620
[ 1169.962565] [<ffffffff8ae902bc>] ? SyS_prctl+0x15c/0x490
[ 1169.968607] [<ffffffff8ae03b7d>] ? do_syscall_64+0x8d/0x100
[ 1169.974938] [<ffffffff8b41b80e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
[ 1169.982716] Code: ca 24 00 3b 05 61 ac c1 00 89 c1 0f 8d 93 fe ff ff 48 98 49 8b 14 24 48 03 14 c5 00 f4 86 8b 8b 42 18 a8 01 74 09 f3 90 8b 42 18 <a
[ 1177.173979] NMI watchdog: BUG: soft lockup - CPU#20 stuck for 23s! [kworker/20:1:499]
[ 1177.182721] Modules linked in: ebt_arp ebt_among ip6table_raw ip6table_mangle nf_conntrack_ipv6 nf_defrag_ipv6 iptable_nat nf_nat_ipv4 nf_nat xt_conc
[ 1177.315033] CPU: 20 PID: 499 Comm: kworker/20:1 Tainted: G W L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1177.326587] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.8.0 005/17/2018
[ 1177.335042] Workqueue: events netstamp_clear
[ 1177.339820] task: ffff9455e55f4140 task.stack: ffffb09172f1c000
[ 1177.346427] RIP: 0010:[<ffffffff8aefee25>] [<ffffffff8aefee25>] smp_call_function_many+0x1f5/0x250
[ 1177.356544] RSP: 0018:ffffb09172f1fd28 EFLAGS: 00000202
[ 1177.362473] RAX: 0000000000000003 RBX: 0000000000000200 RCX: 0000000000000027
[ 1177.370439] RDX: ffffd0913f8c3780 RSI: 0000000000000200 RDI: ffff9455ff6998c8
[ 1177.378404] RBP: ffff9455ff6998c8 R08: ffffff8000000000 R09: ffffffffffefffff
[ 1177.386370] R10: 0000000000000008 R11: ffff9455de009140 R12: ffff9455ff6998c0
[ 1177.394335] R13: ffffffff8ae2d930 R14: 0000000000000000 R15: 0000000000000001
[ 1177.401993] NMI watchdog: BUG: soft lockup - CPU#48 stuck for 22s! [sshd:39696]
[ 1177.402042] Modules linked in: ebt_arp ebt_among ip6table_raw ip6table_mangle nf_conntrack_ipv6 nf_defrag_ipv6 iptable_nat nf_nat_ipv4 nf_nat xt_cont
[ 1177.402073] libiscsi_tcp libiscsi scsi_transport_iscsi nbd ipmi_devintf ipmi_msghandler br_netfilter bridge stp llc ip_tables x_tables autofs4 ext4
[ 1177.402076] CPU: 48 PID: 39696 Comm: sshd Tainted: G W L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1177.402077] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.8.0 005/17/2018
[ 1177.402078] task: ffff945399bf7000 task.stack: ffffb0919bd4c000
[ 1177.402083] RIP: 0010:[<ffffffff8aec5b2f>] [<ffffffff8aec5b2f>] native_queued_spin_lock_slowpath+0x5f/0x1a0
[ 1177.402084] RSP: 0018:ffffb0919bd4fc60 EFLAGS: 00000202
[ 1177.402085] RAX: 0000000000000101 RBX: 0000000000000001 RCX: 0000000000000000
[ 1177.402085] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffffff8bce8580
[ 1177.402086] RBP: ffff9495ff4d6d08 R08: ffffffffffffff00 R09: 00000000000000ff
[ 1177.402087] R10: ffffb09171dbd028 R11: 0000000000000010 R12: 0000000000000200
[ 1177.402087] R13: ffffb0919bd4fcd8 R14: ffffb0919bd4fce0 R15: 0000000000000000
[ 1177.402089] FS: 00007fb13029d8c0(0000) GS:ffff9455ffa00000(0000) knlGS:0000000000000000
[ 1177.402089] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1177.402090] CR2: 00007ffcc7254f0e CR3: 00000032c1da0000 CR4: 0000000000362670
[ 1177.402091] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1177.402091] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1177.402092] Stack:
[ 1177.402094] ffffffff8b41b74d ffffffff8afca5a1 ffffffff8afca97d 0000000000000246
[ 1177.402096] 0000000100000000 ffffffff8af8d256 ffffffffffffffff d4628bc0f20e6a68
[ 1177.402097] ffff9495ff4d6cd8 ffff9495ff4d6d08 0000000000000200 0000000000016d00
[ 1177.402098] Call Trace:
[ 1177.402102] [<ffffffff8b41b74d>] ? _raw_spin_lock+0x1d/0x20
[ 1177.402104] [<ffffffff8afca5a1>] ? __purge_vmap_area_lazy+0xf1/0x300
[ 1177.402105] [<ffffffff8afca97d>] ? alloc_vmap_area+0x8d/0x3d0
[ 1177.402110] [<ffffffff8af8d256>] ? __alloc_pages_nodemask+0xf6/0x260
[ 1177.402111] [<ffffffff8afca8c4>] ? vm_unmap_aliases+0x114/0x140
[ 1177.402114] [<ffffffff8ae65313>] ? change_page_attr_set_clr+0xe3/0x4a0
[ 1177.402117] [<ffffffff8b32ab99>] ? bpf_convert_filter+0x9a9/0xa00
[ 1177.402119] [<ffffffff8ae6623d>] ? set_memory_ro+0x2d/0x40
[ 1177.402123] [<ffffffff8af60e35>] ? bpf_prog_select_runtime+0x25/0xd0
[ 1177.402125] [<ffffffff8b32ceae>] ? bpf_prepare_filter+0x38e/0x410
[ 1177.402128] [<ffffffff8afa5272>] ? kmemdup+0x32/0x40
[ 1177.402129] [<ffffffff8b32d08c>] ? bpf_prog_create_from_user+0xbc/0x110
[ 1177.402132] [<ffffffff8af2bfc0>] ? watchdog_nmi_disable+0x60/0x60
[ 1177.402133] [<ffffffff8af2c571>] ? do_seccomp+0x121/0x620
[ 1177.402135] [<ffffffff8ae902bc>] ? SyS_prctl+0x15c/0x490
[ 1177.402137] [<ffffffff8ae03b7d>] ? do_syscall_64+0x8d/0x100
[ 1177.402139] [<ffffffff8b41b80e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
[ 1177.402158] Code: 75 42 f0 0f ba 2f 08 b8 00 01 00 00 0f 42 f0 8b 07 30 e4 09 c6 f7 c6 00 ff ff ff 75 1b 85 f6 74 0e 8b 07 84 c0 74 08 f3 90 8b 07 <8
[ 1177.830526] FS: 0000000000000000(0000) GS:ffff9455ff680000(0000) knlGS:0000000000000000
[ 1177.839564] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1177.845978] CR2: 000055f2752ac028 CR3: 0000007f61e66000 CR4: 0000000000362670
[ 1177.853938] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1177.861905] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1177.869870] Stack:
[ 1177.872117] 0000000000019880 0000000114814440 ffffffff8b3119cd ffffffff8ae2d930
[ 1177.880420] 0000000000000000 ffffffff8b3119ce 0000000000000000 ffffffff8bade1c8
[ 1177.888722] ffffffff8aeff0b8 ffffffff8b3119cd 0000000000000005 ffffb09172f1fdcb
[ 1177.897025] Call Trace:
[ 1177.899762] [<ffffffff8b3119cd>] ? netif_receive_skb_internal+0x1d/0xa0
[ 1177.907246] [<ffffffff8ae2d930>] ? arch_unregister_cpu+0x20/0x20
[ 1177.914053] [<ffffffff8b3119ce>] ? netif_receive_skb_internal+0x1e/0xa0
[ 1177.921539] [<ffffffff8aeff0b8>] ? on_each_cpu+0x28/0x60
[ 1177.927573] [<ffffffff8b3119cd>] ? netif_receive_skb_internal+0x1d/0xa0
[ 1177.935058] [<ffffffff8ae2e848>] ? text_poke_bp+0x68/0xe0
[ 1177.941188] [<ffffffff8b3119cd>] ? netif_receive_skb_internal+0x1d/0xa0
[ 1177.948672] [<ffffffff8ae2b64c>] ? arch_jump_label_transform+0x9c/0x120
[ 1177.956158] [<ffffffff8af80102>] ? __jump_label_update+0x72/0x80
[ 1177.962966] [<ffffffff8af803df>] ? static_key_slow_inc+0x8f/0xa0
[ 1177.969773] [<ffffffff8ae9460a>] ? process_one_work+0x18a/0x430
[ 1177.976480] [<ffffffff8ae948fd>] ? worker_thread+0x4d/0x490
[ 1177.982802] [<ffffffff8ae948b0>] ? process_one_work+0x430/0x430
[ 1177.989511] [<ffffffff8ae9a969>] ? kthread+0xd9/0xf0
[ 1177.995159] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1178.001581] [<ffffffff8ae9a890>] ? kthread_park+0x60/0x60
[ 1178.007711] [<ffffffff8b41b9b7>] ? ret_from_fork+0x57/0x70
[ 1178.013932] Code: ca 24 00 3b 05 61 ac c1 00 89 c1 0f 8d 93 fe ff ff 48 98 49 8b 14 24 48 03 14 c5 00 f4 86 8b 8b 42 18 a8 01 74 09 f3 90 8b 42 18 <a
[ 1181.294225] NMI watchdog: BUG: soft lockup - CPU#35 stuck for 23s! [CPU 0/KVM:8532]
[ 1181.302778] Modules linked in: ebt_arp ebt_among ip6table_raw ip6table_mangle nf_conntrack_ipv6 nf_defrag_ipv6 iptable_nat nf_nat_ipv4 nf_nat xt_coni
[ 1181.435122] CPU: 35 PID: 8532 Comm: CPU 0/KVM Tainted: G W L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1181.446482] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.8.0 005/17/2018
[ 1181.454936] task: ffff9493c1b9f080 task.stack: ffffb091aef38000
[ 1181.461546] RIP: 0010:[<ffffffff8aefeaa7>] [<ffffffff8aefeaa7>] smp_call_function_single+0xd7/0x130
[ 1181.471760] RSP: 0018:ffffb091aef3bab0 EFLAGS: 00000202
[ 1181.477689] RAX: 0000000000000000 RBX: 0000000000000043 RCX: 0000000000000000
[ 1181.485656] RDX: 0000000000000003 RSI: 00000000000000fb RDI: 0000000000000202
[ 1181.493614] RBP: ffffffffc065f620 R08: 0000010010d16781 R09: 0000000000003fe0
[ 1181.501573] R10: 0000000080604800 R11: 0000000000000000 R12: 0000000000000043
[ 1181.509540] R13: ffff9492a1b90540 R14: 0000000000000000 R15: 0000000000000023
[ 1181.517508] FS: 00007f6caae2e700(0000) GS:ffff9495ff040000(0000) knlGS:0000000000000000
[ 1181.526543] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1181.532958] CR2: 00007f1faffbb4f0 CR3: 0000007c21b8e000 CR4: 0000000000362670
[ 1181.540926] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1181.548893] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1181.556850] Stack:
[ 1181.559096] 000000070000001e 0000000100000024 0000000000000000 ffffffffc065f620
[ 1181.567397] ffff9492a1b94ad8 0000000000000003 bfd58d00d1c4bf99 0000000000000023
[ 1181.575699] ffffb091aef3bc00 ffffffffc065eabf ffff9455ffa18980 0000000000000016
[ 1181.583999] Call Trace:
[ 1181.586739] [<ffffffffc065f620>] ? update_debugctlmsr+0x20/0x20 [kvm_intel]
[ 1181.594615] [<ffffffffc065eabf>] ? vmx_vcpu_load+0x9f/0x350 [kvm_intel]
[ 1181.602107] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1181.608528] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1181.614948] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1181.621369] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1181.627791] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1181.634213] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1181.640633] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1181.647053] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1181.653475] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1181.659896] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1181.666318] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1181.672739] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1181.679160] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1181.685582] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1181.692003] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1181.698424] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1181.704845] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1181.711301] [<ffffffffc0970bd6>] ? kvm_arch_vcpu_load+0x46/0x290 [kvm]
[ 1181.718695] [<ffffffff8aea1de7>] ? finish_task_switch+0x137/0x210
[ 1181.725602] [<ffffffff8b416a61>] ? __schedule+0x241/0x6f0
[ 1181.731736] [<ffffffffc065ded0>] ? vmx_set_supported_cpuid+0x20/0x20 [kvm_intel]
[ 1181.740101] [<ffffffffc065bbe0>] ? vmx_set_tss_addr+0x130/0x130 [kvm_intel]
[ 1181.747977] [<ffffffff8b416f42>] ? schedule+0x32/0x80
[ 1181.753747] [<ffffffffc095a45a>] ? kvm_vcpu_block+0x8a/0x2f0 [kvm]
[ 1181.760785] [<ffffffffc0976c8a>] ? kvm_arch_vcpu_ioctl_run+0x44a/0x16d0 [kvm]
[ 1181.768853] [<ffffffff8aea4d8e>] ? check_preempt_curr+0x4e/0x90
[ 1181.775598] [<ffffffffc0970bf1>] ? kvm_arch_vcpu_load+0x61/0x290 [kvm]
[ 1181.783022] [<ffffffffc095c665>] ? kvm_vcpu_ioctl+0x315/0x5e0 [kvm]
[ 1181.790122] [<ffffffff8aea5e00>] ? wake_up_q+0x70/0x70
[ 1181.795962] [<ffffffff8aebd17f>] ? __wake_up_common+0x4f/0x90
[ 1181.802480] [<ffffffff8b0203c2>] ? do_vfs_ioctl+0xa2/0x620
[ 1181.808708] [<ffffffff8b00bd84>] ? vfs_write+0x144/0x190
[ 1181.814742] [<ffffffff8b0209b4>] ? SyS_ioctl+0x74/0x80
[ 1181.820581] [<ffffffff8ae03b7d>] ? do_syscall_64+0x8d/0x100
[ 1181.826908] [<ffffffff8b41b80e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
[ 1181.834680] Code: 00 75 73 48 83 c4 38 5b 5d c3 48 8d 74 24 10 48 89 d1 89 df 48 89 ea e8 28 fe ff ff 8b 54 24 28 83 e2 01 74 0b f3 90 8b 54 24 28 <8
[ 1193.238917] NMI watchdog: BUG: soft lockup - CPU#28 stuck for 23s! [kworker/28:1:506]
[ 1193.247653] Modules linked in: ebt_arp ebt_among ip6table_raw ip6table_mangle nf_conntrack_ipv6 nf_defrag_ipv6 iptable_nat nf_nat_ipv4 nf_nat xt_cono
[ 1193.379897] CPU: 28 PID: 506 Comm: kworker/28:1 Tainted: G W L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1193.391453] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.8.0 005/17/2018
[ 1193.399914] Workqueue: events wait_rcu_exp_gp
[ 1193.404789] task: ffff9455e57800c0 task.stack: ffffb09172fc4000
[ 1193.411397] RIP: 0010:[<ffffffff8aefea57>] [<ffffffff8aefea57>] smp_call_function_single+0x87/0x130
[ 1193.421614] RSP: 0018:ffffb09172fc7d78 EFLAGS: 00000202
[ 1193.427545] RAX: 0000000000000001 RBX: 0000000000000001 RCX: 0000000000000000
[ 1193.435505] RDX: ffffffff8ba4fd40 RSI: ffff9455ff799840 RDI: 0000000000000001
[ 1193.443472] RBP: ffffffff8aee1150 R08: fffffffffffffffe R09: ffffffffffffffff
[ 1193.451430] R10: 0000000000000000 R11: ffff9455e56ec1c0 R12: ffffffff8bb19880
[ 1193.459388] R13: 0000000000000001 R14: 0000000000000002 R15: ffffffff8ba4fd40
[ 1193.467356] FS: 0000000000000000(0000) GS:ffff9455ff780000(0000) knlGS:0000000000000000
[ 1193.476389] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1193.482797] CR2: 00007fff2357d3d8 CR3: 0000000520c08000 CR4: 0000000000362670
[ 1193.490766] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1193.498735] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1193.506702] Stack:
[ 1193.508951] ffffffff8b41b924 ffffffff8b41b930 0000000000000000 0000000000000000
[ 1193.517255] 0000000000000000 0000000000000003 5aae6c55fadda46a ffffffff8ba4ff40
[ 1193.525568] 0000000ea23820d2 ffffffff8aee0583 000000015dc7df2c 0000000000012670
[ 1193.533869] Call Trace:
[ 1193.536606] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1193.543026] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1193.549449] [<ffffffff8aee0583>] ? sync_rcu_exp_select_cpus+0x1f3/0x390
[ 1193.556937] [<ffffffff8aee1150>] ? rcu_stall_kick_kthreads.part.55+0xa0/0xa0
[ 1193.564911] [<ffffffff8aee0f0b>] ? wait_rcu_exp_gp+0x1b/0x30
[ 1193.571332] [<ffffffff8ae9460a>] ? process_one_work+0x18a/0x430
[ 1193.578045] [<ffffffff8ae948fd>] ? worker_thread+0x4d/0x490
[ 1193.584368] [<ffffffff8ae948b0>] ? process_one_work+0x430/0x430
[ 1193.591081] [<ffffffff8ae9a969>] ? kthread+0xd9/0xf0
[ 1193.596723] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1193.603147] [<ffffffff8ae9a890>] ? kthread_park+0x60/0x60
[ 1193.609277] [<ffffffff8b41b9b7>] ? ret_from_fork+0x57/0x70
[ 1193.615499] Code: 00 73 0c 9c 58 0f 1f 44 00 00 f6 c4 02 74 73 85 c9 75 47 48 c7 c6 40 98 01 00 65 48 03 35 8a e7 10 75 8b 46 18 a8 01 74 09 f3 90 <8
[ 1197.571166] NMI watchdog: BUG: soft lockup - CPU#69 stuck for 23s! [sshd:39668]
[ 1197.579331] Modules linked in: ebt_arp ebt_among ip6table_raw ip6table_mangle nf_conntrack_ipv6 nf_defrag_ipv6 iptable_nat nf_nat_ipv4 nf_nat xt_cona
[ 1197.711741] CPU: 69 PID: 39668 Comm: sshd Tainted: G W L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1197.722713] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.8.0 005/17/2018
[ 1197.731167] task: ffff9449256f0100 task.stack: ffffb0919b7d8000
[ 1197.737778] RIP: 0010:[<ffffffff8aefee20>] [<ffffffff8aefee20>] smp_call_function_many+0x1f0/0x250
[ 1197.747901] RSP: 0018:ffffb0919b7dbbe0 EFLAGS: 00000202
[ 1197.753832] RAX: 0000000000000003 RBX: 0000000000000200 RCX: 0000000000000027
[ 1197.761798] RDX: ffffd0913f8c3da0 RSI: 0000000000000200 RDI: ffff9495ff4998c8
[ 1197.769765] RBP: ffff9495ff4998c8 R08: ffffff8000000000 R09: ffffffffffffffff
[ 1197.777731] R10: 0000000000000008 R11: 0000000000000010 R12: ffff9495ff4998c0
[ 1197.785692] R13: ffffffff8ae696f0 R14: 0000000000000000 R15: 0000000000000001
[ 1197.793658] FS: 00007f4bb07818c0(0000) GS:ffff9495ff480000(0000) knlGS:0000000000000000
[ 1197.802691] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1197.809107] CR2: 00007ffd9ece5f0e CR3: 0000003847f9c000 CR4: 0000000000362670
[ 1197.817076] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1197.825043] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1197.833008] Stack:
[ 1197.835255] 0000000000019880 000000019b7dbc88 ffff945478341900 ffffffff8ae696f0
[ 1197.843558] 0000000000000000 ffffb0919b7dbcd8 ffffb0919b7dbce0 ffff9495ff4d6d08
[ 1197.851866] ffffffff8aeff0b8 ffff945478341900 ffffb0919b7dbc88 ffff9495ff4d6cd8
[ 1197.860174] Call Trace:
[ 1197.862914] [<ffffffff8ae696f0>] ? leave_mm+0xa0/0xa0
[ 1197.868658] [<ffffffff8aeff0b8>] ? on_each_cpu+0x28/0x60
[ 1197.874696] [<ffffffff8ae69e38>] ? flush_tlb_kernel_range+0x48/0x90
[ 1197.881795] [<ffffffff8afca516>] ? __purge_vmap_area_lazy+0x66/0x300
[ 1197.888992] [<ffffffff8afca764>] ? __purge_vmap_area_lazy+0x2b4/0x300
[ 1197.896286] [<ffffffff8afca8c4>] ? vm_unmap_aliases+0x114/0x140
[ 1197.903001] [<ffffffff8ae65313>] ? change_page_attr_set_clr+0xe3/0x4a0
[ 1197.910392] [<ffffffff8b32ab99>] ? bpf_convert_filter+0x9a9/0xa00
[ 1197.917302] [<ffffffff8ae6623d>] ? set_memory_ro+0x2d/0x40
[ 1197.923533] [<ffffffff8af60e35>] ? bpf_prog_select_runtime+0x25/0xd0
[ 1197.930732] [<ffffffff8b32ceae>] ? bpf_prepare_filter+0x38e/0x410
[ 1197.937642] [<ffffffff8afa5272>] ? kmemdup+0x32/0x40
[ 1197.943288] [<ffffffff8b32d08c>] ? bpf_prog_create_from_user+0xbc/0x110
[ 1197.950776] [<ffffffff8af2bfc0>] ? watchdog_nmi_disable+0x60/0x60
[ 1197.957682] [<ffffffff8af2c571>] ? do_seccomp+0x121/0x620
[ 1197.963811] [<ffffffff8ae902bc>] ? SyS_prctl+0x15c/0x490
[ 1197.969846] [<ffffffff8ae03b7d>] ? do_syscall_64+0x8d/0x100
[ 1197.976171] [<ffffffff8b41b80e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
[ 1197.983945] Code: 48 63 d2 e8 53 ca 24 00 3b 05 61 ac c1 00 89 c1 0f 8d 93 fe ff ff 48 98 49 8b 14 24 48 03 14 c5 00 f4 86 8b 8b 42 18 a8 01 74 09 <f
[ 1205.175590] NMI watchdog: BUG: soft lockup - CPU#20 stuck for 22s! [kworker/20:1:499]
[ 1205.184325] Modules linked in: ebt_arp ebt_among ip6table_raw ip6table_mangle nf_conntrack_ipv6 nf_defrag_ipv6 iptable_nat nf_nat_ipv4 nf_nat xt_cony
[ 1205.316598] CPU: 20 PID: 499 Comm: kworker/20:1 Tainted: G W L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1205.328150] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.8.0 005/17/2018
[ 1205.336610] Workqueue: events netstamp_clear
[ 1205.341390] task: ffff9455e55f4140 task.stack: ffffb09172f1c000
[ 1205.348000] RIP: 0010:[<ffffffff8aefee25>] [<ffffffff8aefee25>] smp_call_function_many+0x1f5/0x250
[ 1205.358121] RSP: 0018:ffffb09172f1fd28 EFLAGS: 00000202
[ 1205.364052] RAX: 0000000000000003 RBX: 0000000000000200 RCX: 0000000000000027
[ 1205.372011] RDX: ffffd0913f8c3780 RSI: 0000000000000200 RDI: ffff9455ff6998c8
[ 1205.379978] RBP: ffff9455ff6998c8 R08: ffffff8000000000 R09: ffffffffffefffff
[ 1205.387946] R10: 0000000000000008 R11: ffff9455de009140 R12: ffff9455ff6998c0
[ 1205.395912] R13: ffffffff8ae2d930 R14: 0000000000000000 R15: 0000000000000001
[ 1205.403602] NMI watchdog: BUG: soft lockup - CPU#48 stuck for 22s! [sshd:39696]
[ 1205.403649] Modules linked in: ebt_arp ebt_among ip6table_raw ip6table_mangle nf_conntrack_ipv6 nf_defrag_ipv6 iptable_nat nf_nat_ipv4 nf_nat xt_cons
[ 1205.403679] libiscsi_tcp libiscsi scsi_transport_iscsi nbd ipmi_devintf ipmi_msghandler br_netfilter bridge stp llc ip_tables x_tables autofs4 ext4
[ 1205.403682] CPU: 48 PID: 39696 Comm: sshd Tainted: G W L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1205.403683] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.8.0 005/17/2018
[ 1205.403684] task: ffff945399bf7000 task.stack: ffffb0919bd4c000
[ 1205.403690] RIP: 0010:[<ffffffff8aec5b2b>] [<ffffffff8aec5b2b>] native_queued_spin_lock_slowpath+0x5b/0x1a0
[ 1205.403691] RSP: 0018:ffffb0919bd4fc60 EFLAGS: 00000202
[ 1205.403692] RAX: 0000000000000101 RBX: 0000000000000001 RCX: 0000000000000000
[ 1205.403693] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffffff8bce8580
[ 1205.403693] RBP: ffff9495ff4d6d08 R08: ffffffffffffff00 R09: 00000000000000ff
[ 1205.403694] R10: ffffb09171dbd028 R11: 0000000000000010 R12: 0000000000000200
[ 1205.403695] R13: ffffb0919bd4fcd8 R14: ffffb0919bd4fce0 R15: 0000000000000000
[ 1205.403696] FS: 00007fb13029d8c0(0000) GS:ffff9455ffa00000(0000) knlGS:0000000000000000
[ 1205.403697] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1205.403698] CR2: 00007ffcc7254f0e CR3: 00000032c1da0000 CR4: 0000000000362670
[ 1205.403699] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1205.403699] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1205.403700] Stack:
[ 1205.403703] ffffffff8b41b74d ffffffff8afca5a1 ffffffff8afca97d 0000000000000246
[ 1205.403704] 0000000100000000 ffffffff8af8d256 ffffffffffffffff d4628bc0f20e6a68
[ 1205.403705] ffff9495ff4d6cd8 ffff9495ff4d6d08 0000000000000200 0000000000016d00
[ 1205.403706] Call Trace:
[ 1205.403711] [<ffffffff8b41b74d>] ? _raw_spin_lock+0x1d/0x20
[ 1205.403713] [<ffffffff8afca5a1>] ? __purge_vmap_area_lazy+0xf1/0x300
[ 1205.403714] [<ffffffff8afca97d>] ? alloc_vmap_area+0x8d/0x3d0
[ 1205.403719] [<ffffffff8af8d256>] ? __alloc_pages_nodemask+0xf6/0x260
[ 1205.403720] [<ffffffff8afca8c4>] ? vm_unmap_aliases+0x114/0x140
[ 1205.403724] [<ffffffff8ae65313>] ? change_page_attr_set_clr+0xe3/0x4a0
[ 1205.403726] [<ffffffff8b32ab99>] ? bpf_convert_filter+0x9a9/0xa00
[ 1205.403728] [<ffffffff8ae6623d>] ? set_memory_ro+0x2d/0x40
[ 1205.403734] [<ffffffff8af60e35>] ? bpf_prog_select_runtime+0x25/0xd0
[ 1205.403735] [<ffffffff8b32ceae>] ? bpf_prepare_filter+0x38e/0x410
[ 1205.403739] [<ffffffff8afa5272>] ? kmemdup+0x32/0x40
[ 1205.403740] [<ffffffff8b32d08c>] ? bpf_prog_create_from_user+0xbc/0x110
[ 1205.403743] [<ffffffff8af2bfc0>] ? watchdog_nmi_disable+0x60/0x60
[ 1205.403744] [<ffffffff8af2c571>] ? do_seccomp+0x121/0x620
[ 1205.403746] [<ffffffff8ae902bc>] ? SyS_prctl+0x15c/0x490
[ 1205.403750] [<ffffffff8ae03b7d>] ? do_syscall_64+0x8d/0x100
[ 1205.403751] [<ffffffff8b41b80e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
[ 1205.403770] Code: 30 f6 85 f6 75 42 f0 0f ba 2f 08 b8 00 01 00 00 0f 42 f0 8b 07 30 e4 09 c6 f7 c6 00 ff ff ff 75 1b 85 f6 74 0e 8b 07 84 c0 74 08 <f
[ 1205.832102] FS: 0000000000000000(0000) GS:ffff9455ff680000(0000) knlGS:0000000000000000
[ 1205.841136] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1205.847552] CR2: 000055f2752ac028 CR3: 0000007f61e66000 CR4: 0000000000362670
[ 1205.855520] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1205.863484] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1205.871448] Stack:
[ 1205.873694] 0000000000019880 0000000114814440 ffffffff8b3119cd ffffffff8ae2d930
[ 1205.881991] 0000000000000000 ffffffff8b3119ce 0000000000000000 ffffffff8bade1c8
[ 1205.890287] ffffffff8aeff0b8 ffffffff8b3119cd 0000000000000005 ffffb09172f1fdcb
[ 1205.898584] Call Trace:
[ 1205.901320] [<ffffffff8b3119cd>] ? netif_receive_skb_internal+0x1d/0xa0
[ 1205.908807] [<ffffffff8ae2d930>] ? arch_unregister_cpu+0x20/0x20
[ 1205.915616] [<ffffffff8b3119ce>] ? netif_receive_skb_internal+0x1e/0xa0
[ 1205.923104] [<ffffffff8aeff0b8>] ? on_each_cpu+0x28/0x60
[ 1205.929139] [<ffffffff8b3119cd>] ? netif_receive_skb_internal+0x1d/0xa0
[ 1205.936626] [<ffffffff8ae2e848>] ? text_poke_bp+0x68/0xe0
[ 1205.942757] [<ffffffff8b3119cd>] ? netif_receive_skb_internal+0x1d/0xa0
[ 1205.950243] [<ffffffff8ae2b64c>] ? arch_jump_label_transform+0x9c/0x120
[ 1205.957728] [<ffffffff8af80102>] ? __jump_label_update+0x72/0x80
[ 1205.964535] [<ffffffff8af803df>] ? static_key_slow_inc+0x8f/0xa0
[ 1205.971343] [<ffffffff8ae9460a>] ? process_one_work+0x18a/0x430
[ 1205.978054] [<ffffffff8ae948fd>] ? worker_thread+0x4d/0x490
[ 1205.984375] [<ffffffff8ae948b0>] ? process_one_work+0x430/0x430
[ 1205.991086] [<ffffffff8ae9a969>] ? kthread+0xd9/0xf0
[ 1205.996729] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1206.003150] [<ffffffff8ae9a890>] ? kthread_park+0x60/0x60
[ 1206.009277] [<ffffffff8b41b9b7>] ? ret_from_fork+0x57/0x70
[ 1206.015495] Code: ca 24 00 3b 05 61 ac c1 00 89 c1 0f 8d 93 fe ff ff 48 98 49 8b 14 24 48 03 14 c5 00 f4 86 8b 8b 42 18 a8 01 74 09 f3 90 8b 42 18 <a
[ 1209.295819] NMI watchdog: BUG: soft lockup - CPU#35 stuck for 23s! [CPU 0/KVM:8532]
[ 1209.304372] Modules linked in: ebt_arp ebt_among ip6table_raw ip6table_mangle nf_conntrack_ipv6 nf_defrag_ipv6 iptable_nat nf_nat_ipv4 nf_nat xt_cong
[ 1209.436755] CPU: 35 PID: 8532 Comm: CPU 0/KVM Tainted: G W L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1209.448117] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.8.0 005/17/2018
[ 1209.456570] task: ffff9493c1b9f080 task.stack: ffffb091aef38000
[ 1209.463181] RIP: 0010:[<ffffffff8aefeaa7>] [<ffffffff8aefeaa7>] smp_call_function_single+0xd7/0x130
[ 1209.473402] RSP: 0018:ffffb091aef3bab0 EFLAGS: 00000202
[ 1209.479343] RAX: 0000000000000000 RBX: 0000000000000043 RCX: 0000000000000000
[ 1209.487310] RDX: 0000000000000003 RSI: 00000000000000fb RDI: 0000000000000202
[ 1209.495269] RBP: ffffffffc065f620 R08: 0000010010d16781 R09: 0000000000003fe0
[ 1209.503227] R10: 0000000080604800 R11: 0000000000000000 R12: 0000000000000043
[ 1209.511186] R13: ffff9492a1b90540 R14: 0000000000000000 R15: 0000000000000023
[ 1209.519155] FS: 00007f6caae2e700(0000) GS:ffff9495ff040000(0000) knlGS:0000000000000000
[ 1209.528188] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1209.534597] CR2: 00007f1faffbb4f0 CR3: 0000007c21b8e000 CR4: 0000000000362670
[ 1209.542563] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1209.550531] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1209.558498] Stack:
[ 1209.560744] 000000070000001e 0000000100000024 0000000000000000 ffffffffc065f620
[ 1209.569048] ffff9492a1b94ad8 0000000000000003 bfd58d00d1c4bf99 0000000000000023
[ 1209.577346] ffffb091aef3bc00 ffffffffc065eabf ffff9455ffa18980 0000000000000016
[ 1209.585652] Call Trace:
[ 1209.588396] [<ffffffffc065f620>] ? update_debugctlmsr+0x20/0x20 [kvm_intel]
[ 1209.596285] [<ffffffffc065eabf>] ? vmx_vcpu_load+0x9f/0x350 [kvm_intel]
[ 1209.603778] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1209.610201] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1209.616623] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1209.623045] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1209.628016] INFO: task jbd2/sda1-8:1370 blocked for more than 120 seconds.
[ 1209.628018] Tainted: G W L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1209.628018] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1209.628021] jbd2/sda1-8 D 0 1370 2 0x00000000
[ 1209.628024] ffff9495e0347800 0000000000000000 ffff9455de0ea100 ffff9495ff058980
[ 1209.628026] ffff9495e581c000 ffffb0917325bb30 ffffffff8b416a59 ffff9455e5151050
[ 1209.628027] 00ffffffc0161029 ffff9495ff058980 ffff9455e04c07b0 ffff9455de0ea100
[ 1209.628028] Call Trace:
[ 1209.628037] [<ffffffff8b416a59>] ? __schedule+0x239/0x6f0
[ 1209.628039] [<ffffffff8b417710>] ? bit_wait+0x50/0x50
[ 1209.628040] [<ffffffff8b416f42>] ? schedule+0x32/0x80
[ 1209.628042] [<ffffffff8b41a2dd>] ? schedule_timeout+0x1dd/0x380
[ 1209.628048] [<ffffffff8b1091e5>] ? blk_peek_request+0x65/0x2b0
[ 1209.628052] [<ffffffff8ae2f240>] ? recalibrate_cpu_khz+0x10/0x10
[ 1209.628057] [<ffffffff8aef14fe>] ? ktime_get+0x3e/0xb0
[ 1209.628059] [<ffffffff8aef14fe>] ? ktime_get+0x3e/0xb0
[ 1209.628060] [<ffffffff8b417710>] ? bit_wait+0x50/0x50
[ 1209.628062] [<ffffffff8b4167bd>] ? io_schedule_timeout+0x9d/0x100
[ 1209.628065] [<ffffffff8aebd377>] ? prepare_to_wait+0x57/0x80
[ 1209.628066] [<ffffffff8b417727>] ? bit_wait_io+0x17/0x60
[ 1209.628067] [<ffffffff8b4172e5>] ? __wait_on_bit+0x55/0x80
[ 1209.628068] [<ffffffff8b417710>] ? bit_wait+0x50/0x50
[ 1209.628069] [<ffffffff8b41744e>] ? out_of_line_wait_on_bit+0x7e/0xa0
[ 1209.628071] [<ffffffff8aebd7e0>] ? wake_atomic_t_function+0x60/0x60
[ 1209.628080] [<ffffffffc0290e72>] ? jbd2_journal_commit_transaction+0xde2/0x17c0 [jbd2]
[ 1209.628084] [<ffffffffc0295c72>] ? kjournald2+0xc2/0x260 [jbd2]
[ 1209.628085] [<ffffffff8aebd740>] ? prepare_to_wait_event+0xf0/0xf0
[ 1209.628088] [<ffffffffc0295bb0>] ? commit_timeout+0x10/0x10 [jbd2]
[ 1209.628092] [<ffffffff8ae9a969>] ? kthread+0xd9/0xf0
[ 1209.628093] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1209.628095] [<ffffffff8ae9a890>] ? kthread_park+0x60/0x60
[ 1209.628096] [<ffffffff8b41b9b7>] ? ret_from_fork+0x57/0x70
[ 1209.628112] INFO: task rs:main Q:Reg:1706 blocked for more than 120 seconds.
[ 1209.628113] Tainted: G W L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1209.628113] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1209.628115] rs:main Q:Reg D 0 1706 1 0x00000000
[ 1209.628117] ffff9455e1868000 0000000000000000 ffff9455e0d6c040 ffff9495fec18980
[ 1209.628119] ffff9495e63c1040 ffffb09173263a20 ffffffff8b416a59 00000000000052d4
[ 1209.628120] 0000000000002775 ffff9495fec18980 0000000200000024 ffff9455e0d6c040
[ 1209.628120] Call Trace:
[ 1209.628122] [<ffffffff8b416a59>] ? __schedule+0x239/0x6f0
[ 1209.628123] [<ffffffff8b417710>] ? bit_wait+0x50/0x50
[ 1209.628124] [<ffffffff8b416f42>] ? schedule+0x32/0x80
[ 1209.628126] [<ffffffff8b41a2dd>] ? schedule_timeout+0x1dd/0x380
[ 1209.628127] [<ffffffff8aef14fe>] ? ktime_get+0x3e/0xb0
[ 1209.628128] [<ffffffff8b417710>] ? bit_wait+0x50/0x50
[ 1209.628130] [<ffffffff8b4167bd>] ? io_schedule_timeout+0x9d/0x100
[ 1209.628131] [<ffffffff8aebd377>] ? prepare_to_wait+0x57/0x80
[ 1209.628132] [<ffffffff8b417727>] ? bit_wait_io+0x17/0x60
[ 1209.628133] [<ffffffff8b4172e5>] ? __wait_on_bit+0x55/0x80
[ 1209.628135] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1209.628135] [<ffffffff8b417710>] ? bit_wait+0x50/0x50
[ 1209.628136] [<ffffffff8b41744e>] ? out_of_line_wait_on_bit+0x7e/0xa0
[ 1209.628138] [<ffffffff8aebd7e0>] ? wake_atomic_t_function+0x60/0x60
[ 1209.628141] [<ffffffffc028ebe1>] ? do_get_write_access+0x1f1/0x450 [jbd2]
[ 1209.628144] [<ffffffffc028ee8c>] ? jbd2_journal_get_write_access+0x4c/0x60 [jbd2]
[ 1209.628168] [<ffffffffc038dae6>] ? __ext4_journal_get_write_access+0x36/0x70 [ext4]
[ 1209.628175] [<ffffffffc035b5f0>] ? ext4_reserve_inode_write+0x70/0x90 [ext4]
[ 1209.628181] [<ffffffffc0360373>] ? ext4_dirty_inode+0x43/0x60 [ext4]
[ 1209.628187] [<ffffffffc035b65f>] ? ext4_mark_inode_dirty+0x4f/0x200 [ext4]
[ 1209.628192] [<ffffffffc0360373>] ? ext4_dirty_inode+0x43/0x60 [ext4]
[ 1209.628195] [<ffffffff8b03b0db>] ? __mark_inode_dirty+0x16b/0x360
[ 1209.628197] [<ffffffff8b028589>] ? generic_update_time+0x79/0xd0
[ 1209.628198] [<ffffffff8b028796>] ? current_time+0x36/0x70
[ 1209.628199] [<ffffffff8b02888f>] ? file_update_time+0xbf/0x110
[ 1209.628201] [<ffffffff8af84ef9>] ? __generic_file_write_iter+0x99/0x1b0
[ 1209.628207] [<ffffffffc0352200>] ? ext4_file_write_iter+0x90/0x380 [ext4]
[ 1209.628209] [<ffffffff8b00b500>] ? new_sync_write+0xe0/0x130
[ 1209.628211] [<ffffffff8b00bcf0>] ? vfs_write+0xb0/0x190
[ 1209.628213] [<ffffffff8b00d132>] ? SyS_write+0x52/0xc0
[ 1209.628215] [<ffffffff8ae03b7d>] ? do_syscall_64+0x8d/0x100
[ 1209.628216] [<ffffffff8b41b80e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
[ 1209.628280] INFO: task worker:40399 blocked for more than 120 seconds.
[ 1209.628280] Tainted: G W L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1209.628281] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1209.628282] worker D 0 40399 1 0x00000000
[ 1209.628284] ffff9455e360e800 0000000000000000 ffff9492631a5000 ffff9495ff218980
[ 1209.628285] ffff9495e5848040 ffffb091a4647c60 ffffffff8b416a59 ffff9495ff4d89e8
[ 1209.628287] 0000000000000001 ffff9495ff218980 0000000000000246 ffff9492631a5000
[ 1209.628287] Call Trace:
[ 1209.628289] [<ffffffff8b416a59>] ? __schedule+0x239/0x6f0
[ 1209.628290] [<ffffffff8b416f42>] ? schedule+0x32/0x80
[ 1209.628291] [<ffffffff8b419f09>] ? rwsem_down_write_failed+0x1f9/0x360
[ 1209.628293] [<ffffffff8ae2f8f5>] ? sched_clock+0x5/0x10
[ 1209.628295] [<ffffffff8aea4de4>] ? ttwu_do_wakeup+0x14/0xe0
[ 1209.628297] [<ffffffff8b143f33>] ? call_rwsem_down_write_failed+0x13/0x20
[ 1209.628298] [<ffffffff8b4191b9>] ? down_write+0x29/0x40
[ 1209.628350] [<ffffffffc0c7506d>] ? xfs_file_dio_aio_write+0xad/0x400 [xfs]
[ 1209.628353] [<ffffffff8aefd905>] ? do_futex+0x2c5/0xb60
[ 1209.628371] [<ffffffffc0c7574d>] ? xfs_file_write_iter+0x9d/0x160 [xfs]
[ 1209.628373] [<ffffffff8b00b500>] ? new_sync_write+0xe0/0x130
[ 1209.628374] [<ffffffff8b00bcf0>] ? vfs_write+0xb0/0x190
[ 1209.628376] [<ffffffff8b00d2e0>] ? SyS_pwrite64+0x90/0xb0
[ 1209.628378] [<ffffffff8ae03b7d>] ? do_syscall_64+0x8d/0x100
[ 1209.628379] [<ffffffff8b41b80e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
[ 1209.628380] INFO: task worker:40400 blocked for more than 120 seconds.
[ 1209.628381] Tainted: G W L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1209.628381] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1209.628383] worker D 0 40400 1 0x00000000
[ 1209.628384] ffff9455e360e800 0000000000000000 ffff949140061040 ffff9495ff318980
[ 1209.628386] ffff9495e585c140 ffffb09177edfa90 ffffffff8b416a59 0000000000000000
[ 1209.628387] 00ff9455e5151050 ffff9495ff318980 ffff9455e04c0210 ffff949140061040
[ 1209.628388] Call Trace:
[ 1209.628390] [<ffffffff8b416a59>] ? __schedule+0x239/0x6f0
[ 1209.628391] [<ffffffff8b416f42>] ? schedule+0x32/0x80
[ 1209.628392] [<ffffffff8b41a2dd>] ? schedule_timeout+0x1dd/0x380
[ 1209.628394] [<ffffffff8b104985>] ? queue_unplugged+0x25/0xa0
[ 1209.628396] [<ffffffff8ae2f240>] ? recalibrate_cpu_khz+0x10/0x10
[ 1209.628397] [<ffffffff8b4167bd>] ? io_schedule_timeout+0x9d/0x100
[ 1209.628400] [<ffffffff8b04beac>] ? do_blockdev_direct_IO+0x177c/0x3160
[ 1209.628419] [<ffffffffc0c696a0>] ? xfs_setfilesize+0x80/0x80 [xfs]
[ 1209.628436] [<ffffffffc0c751d0>] ? xfs_file_dio_aio_write+0x210/0x400 [xfs]
[ 1209.628469] [<ffffffffc0c7574d>] ? xfs_file_write_iter+0x9d/0x160 [xfs]
[ 1209.628471] [<ffffffff8b00b500>] ? new_sync_write+0xe0/0x130
[ 1209.628474] [<ffffffff8b00bcf0>] ? vfs_write+0xb0/0x190
[ 1209.628476] [<ffffffff8b00d2e0>] ? SyS_pwrite64+0x90/0xb0
[ 1209.628478] [<ffffffff8ae03b7d>] ? do_syscall_64+0x8d/0x100
[ 1209.628479] [<ffffffff8b41b80e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
[ 1209.628481] INFO: task worker:40402 blocked for more than 120 seconds.
[ 1209.628481] Tainted: G W L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1209.628482] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1209.628483] worker D 0 40402 1 0x00000000
[ 1209.628486] ffff9455e360e800 0000000000000000 ffff9490d47d20c0 ffff9495ff4d8980
[ 1209.628487] ffff9495e5885000 ffffb091782d7c60 ffffffff8b416a59 ffff9495ff1d89e8
[ 1209.628489] 0000000000000001 ffff9495ff4d8980 0000000000000246 ffff9490d47d20c0
[ 1209.628489] Call Trace:
[ 1209.628492] [<ffffffff8b416a59>] ? __schedule+0x239/0x6f0
[ 1209.628493] [<ffffffff8b416f42>] ? schedule+0x32/0x80
[ 1209.628495] [<ffffffff8b419f09>] ? rwsem_down_write_failed+0x1f9/0x360
[ 1209.628497] [<ffffffff8ae2f8f5>] ? sched_clock+0x5/0x10
[ 1209.628498] [<ffffffff8aea4de4>] ? ttwu_do_wakeup+0x14/0xe0
[ 1209.628500] [<ffffffff8b143f33>] ? call_rwsem_down_write_failed+0x13/0x20
[ 1209.628501] [<ffffffff8b4191b9>] ? down_write+0x29/0x40
[ 1209.628521] [<ffffffffc0c7506d>] ? xfs_file_dio_aio_write+0xad/0x400 [xfs]
[ 1209.628524] [<ffffffff8aefd905>] ? do_futex+0x2c5/0xb60
[ 1209.628526] [<ffffffff8b01d0c5>] ? do_filp_open+0xa5/0x100
[ 1209.628545] [<ffffffffc0c7574d>] ? xfs_file_write_iter+0x9d/0x160 [xfs]
[ 1209.628547] [<ffffffff8b00b500>] ? new_sync_write+0xe0/0x130
[ 1209.628549] [<ffffffff8b00bcf0>] ? vfs_write+0xb0/0x190
[ 1209.628551] [<ffffffff8b00d2e0>] ? SyS_pwrite64+0x90/0xb0
[ 1209.628553] [<ffffffff8ae03b7d>] ? do_syscall_64+0x8d/0x100
[ 1209.628555] [<ffffffff8b41b80e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
[ 1209.628559] INFO: task worker:38207 blocked for more than 120 seconds.
[ 1209.628560] Tainted: G W L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1209.628560] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1209.628561] worker D 0 38207 1 0x00000000
[ 1209.628563] ffff9495dbab2c00 0000000000000000 ffff948e3460f100 ffff9495ff2d8980
[ 1209.628565] ffff9495e5857100 ffffb09175b3f9f0 ffffffff8b416a59 0000000000000000
[ 1209.628567] 00ff9455e5151050 ffff9495ff2d8980 ffff9455e04c0210 ffff948e3460f100
[ 1209.628567] Call Trace:
[ 1209.628570] [<ffffffff8b416a59>] ? __schedule+0x239/0x6f0
[ 1209.628571] [<ffffffff8b416f42>] ? schedule+0x32/0x80
[ 1209.628572] [<ffffffff8b41a2dd>] ? schedule_timeout+0x1dd/0x380
[ 1209.628574] [<ffffffff8b104985>] ? queue_unplugged+0x25/0xa0
[ 1209.628576] [<ffffffff8ae2f240>] ? recalibrate_cpu_khz+0x10/0x10
[ 1209.628579] [<ffffffff8b4167bd>] ? io_schedule_timeout+0x9d/0x100
[ 1209.628580] [<ffffffff8b04beac>] ? do_blockdev_direct_IO+0x177c/0x3160
[ 1209.628603] [<ffffffffc0c696a0>] ? xfs_setfilesize+0x80/0x80 [xfs]
[ 1209.628622] [<ffffffffc0c751d0>] ? xfs_file_dio_aio_write+0x210/0x400 [xfs]
[ 1209.628642] [<ffffffffc0c7574d>] ? xfs_file_write_iter+0x9d/0x160 [xfs]
[ 1209.628645] [<ffffffff8b00a9db>] ? do_iter_readv_writev+0xbb/0x140
[ 1209.628648] [<ffffffff8b00bf6e>] ? do_readv_writev+0x19e/0x240
[ 1209.628677] [<ffffffffc0c756b0>] ? xfs_file_buffered_aio_write+0x2f0/0x2f0 [xfs]
[ 1209.628682] [<ffffffff8b059761>] ? eventfd_write+0x111/0x210
[ 1209.628685] [<ffffffff8b00c3dd>] ? do_pwritev+0xad/0xc0
[ 1209.628687] [<ffffffff8ae03b7d>] ? do_syscall_64+0x8d/0x100
[ 1209.628690] [<ffffffff8b41b80e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
[ 1209.628692] INFO: task worker:38209 blocked for more than 120 seconds.
[ 1209.628694] Tainted: G W L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1209.628694] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1209.628696] worker D 0 38209 1 0x00000000
[ 1209.628699] ffff9495dbab2c00 0000000000000000 ffff948818720000 ffff9495ff1d8980
[ 1209.628702] ffff9495e583b000 ffffb09175b6fc80 ffffffff8b416a59 ffff948e8d1a74c8
[ 1209.628704] 00ff9493dafdde80 ffff9495ff1d8980 ffff9455def88c00 ffff948818720000
[ 1209.628705] Call Trace:
[ 1209.628708] [<ffffffff8b416a59>] ? __schedule+0x239/0x6f0
[ 1209.628710] [<ffffffff8b416f42>] ? schedule+0x32/0x80
[ 1209.628712] [<ffffffff8b4198c0>] ? rwsem_down_read_failed+0xf0/0x150
[ 1209.628738] [<ffffffffc0c73f17>] ? xfs_file_dio_aio_read+0x157/0x2a0 [xfs]
[ 1209.628740] [<ffffffff8b143f04>] ? call_rwsem_down_read_failed+0x14/0x30
[ 1209.628741] [<ffffffff8b41917c>] ? down_read+0x1c/0x30
[ 1209.628764] [<ffffffffc0c8269e>] ? xfs_ilock+0xee/0x110 [xfs]
[ 1209.628783] [<ffffffffc0c73f17>] ? xfs_file_dio_aio_read+0x157/0x2a0 [xfs]
[ 1209.628785] [<ffffffff8b021625>] ? pollwake+0x75/0x90
[ 1209.628803] [<ffffffffc0c741ca>] ? xfs_file_read_iter+0xba/0xd0 [xfs]
[ 1209.628805] [<ffffffff8b00b39d>] ? new_sync_read+0xdd/0x130
[ 1209.628807] [<ffffffff8b00bba1>] ? vfs_read+0x91/0x130
[ 1209.628810] [<ffffffff8b00d230>] ? SyS_pread64+0x90/0xb0
[ 1209.628811] [<ffffffff8ae03b7d>] ? do_syscall_64+0x8d/0x100
[ 1209.628813] [<ffffffff8b41b80e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
[ 1209.628816] INFO: task worker:37284 blocked for more than 120 seconds.
[ 1209.628816] Tainted: G W L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1209.628817] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1209.628818] worker D 0 37284 1 0x00000000
[ 1209.628820] ffff9455dd8d9400 0000000000000000 ffff9487b5c29100 ffff9495ff4d8980
[ 1209.628822] ffff9495e5885000 ffffb0919544bbc0 ffffffff8b416a59 ffffffff8b41b924
[ 1209.628824] 00ffffff8b41b930 ffff9495ff4d8980 ffffffff8ae2568f ffff9487b5c29100
[ 1209.628824] Call Trace:
[ 1209.628827] [<ffffffff8b416a59>] ? __schedule+0x239/0x6f0
[ 1209.628828] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1209.628832] [<ffffffff8ae2568f>] ? __switch_to+0x1ef/0x670
[ 1209.628833] [<ffffffff8b416f42>] ? schedule+0x32/0x80
[ 1209.628835] [<ffffffff8b419f09>] ? rwsem_down_write_failed+0x1f9/0x360
[ 1209.628836] [<ffffffff8b143f33>] ? call_rwsem_down_write_failed+0x13/0x20
[ 1209.628838] [<ffffffff8b4191b9>] ? down_write+0x29/0x40
[ 1209.628857] [<ffffffffc0c7506d>] ? xfs_file_dio_aio_write+0xad/0x400 [xfs]
[ 1209.628859] [<ffffffff8aeeaee0>] ? __hrtimer_init+0xa0/0xa0
[ 1209.628877] [<ffffffffc0c7574d>] ? xfs_file_write_iter+0x9d/0x160 [xfs]
[ 1209.628880] [<ffffffff8b00a9db>] ? do_iter_readv_writev+0xbb/0x140
[ 1209.628882] [<ffffffff8b00bf6e>] ? do_readv_writev+0x19e/0x240
[ 1209.628900] [<ffffffffc0c756b0>] ? xfs_file_buffered_aio_write+0x2f0/0x2f0 [xfs]
[ 1209.628902] [<ffffffff8b00c3dd>] ? do_pwritev+0xad/0xc0
[ 1209.628904] [<ffffffff8ae03b7d>] ? do_syscall_64+0x8d/0x100
[ 1209.628906] [<ffffffff8b41b80e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
[ 1209.628907] INFO: task worker:38975 blocked for more than 120 seconds.
[ 1209.628908] Tainted: G W L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1209.628908] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1209.628910] worker D 0 38975 1 0x00000000
[ 1209.628912] ffff9455dd8d9400 0000000000000000 ffff9487604ec140 ffff9495ff4d8980
[ 1209.628914] ffff9495e5885000 ffffb0917fe433a0 ffffffff8b416a59 ffff9455de265980
[ 1209.628915] 0000000000000008 ffff9495ff4d8980 0000000000000001 ffff9487604ec140
[ 1209.628916] Call Trace:
[ 1209.628918] [<ffffffff8b416a59>] ? __schedule+0x239/0x6f0
[ 1209.628919] [<ffffffff8b416f42>] ? schedule+0x32/0x80
[ 1209.628921] [<ffffffff8b41a2dd>] ? schedule_timeout+0x1dd/0x380
[ 1209.628938] [<ffffffffc0c1e22b>] ? xfs_alloc_log_agf+0x7b/0x100 [xfs]
[ 1209.628939] [<ffffffff8b418e67>] ? __down+0x77/0xc0
[ 1209.628959] [<ffffffffc0c6f48b>] ? _xfs_buf_find+0x15b/0x360 [xfs]
[ 1209.628960] [<ffffffff8aec50bb>] ? down+0x3b/0x50
[ 1209.628980] [<ffffffffc0c6f283>] ? xfs_buf_lock+0x33/0xe0 [xfs]
[ 1209.628998] [<ffffffffc0c6f48b>] ? _xfs_buf_find+0x15b/0x360 [xfs]
[ 1209.629017] [<ffffffffc0c6f6b3>] ? xfs_buf_get_map+0x23/0x250 [xfs]
[ 1209.629036] [<ffffffffc0c702a9>] ? xfs_buf_read_map+0x29/0x170 [xfs]
[ 1209.629061] [<ffffffffc0ca3dea>] ? xfs_trans_read_buf_map+0xea/0x320 [xfs]
[ 1209.629078] [<ffffffffc0c38224>] ? xfs_btree_read_buf_block.constprop.34+0x74/0xc0 [xfs]
[ 1209.629095] [<ffffffffc0c382f5>] ? xfs_btree_lookup_get_block+0x85/0x180 [xfs]
[ 1209.629113] [<ffffffffc0c3e1cb>] ? xfs_btree_lookup+0x12b/0x770 [xfs]
[ 1209.629133] [<ffffffffc0c56d5d>] ? xfs_iext_get_ext+0x3d/0x90 [xfs]
[ 1209.629151] [<ffffffffc0c582f9>] ? xfs_iext_insert+0x79/0x100 [xfs]
[ 1209.629168] [<ffffffffc0c2b3ee>] ? xfs_bmap_add_extent_hole_real+0x15e/0xb10 [xfs]
[ 1209.629184] [<ffffffffc0c2b42f>] ? xfs_bmap_add_extent_hole_real+0x19f/0xb10 [xfs]
[ 1209.629201] [<ffffffffc0c33610>] ? xfs_bmapi_write+0x8e0/0xc80 [xfs]
[ 1209.629222] [<ffffffffc0c7e34c>] ? xfs_iomap_write_direct+0x1ec/0x400 [xfs]
[ 1209.629243] [<ffffffffc0c68140>] ? __xfs_get_blocks+0x470/0x740 [xfs]
[ 1209.629246] [<ffffffff8ae69301>] ? get_user_pages_fast+0x31/0x180
[ 1209.629247] [<ffffffff8b04b212>] ? do_blockdev_direct_IO+0xae2/0x3160
[ 1209.629268] [<ffffffffc0c696a0>] ? xfs_setfilesize+0x80/0x80 [xfs]
[ 1209.629288] [<ffffffffc0c751d0>] ? xfs_file_dio_aio_write+0x210/0x400 [xfs]
[ 1209.629306] [<ffffffffc0c7574d>] ? xfs_file_write_iter+0x9d/0x160 [xfs]
[ 1209.629309] [<ffffffff8b00a9db>] ? do_iter_readv_writev+0xbb/0x140
[ 1209.629311] [<ffffffff8b00bf6e>] ? do_readv_writev+0x19e/0x240
[ 1209.629329] [<ffffffffc0c756b0>] ? xfs_file_buffered_aio_write+0x2f0/0x2f0 [xfs]
[ 1209.629331] [<ffffffff8b059761>] ? eventfd_write+0x111/0x210
[ 1209.629334] [<ffffffff8b00c3dd>] ? do_pwritev+0xad/0xc0
[ 1209.629335] [<ffffffff8ae03b7d>] ? do_syscall_64+0x8d/0x100
[ 1209.629337] [<ffffffff8b41b80e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
[ 1209.629343] INFO: task worker:37033 blocked for more than 120 seconds.
[ 1209.629344] Tainted: G W L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1209.629344] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1209.629346] worker D 0 37033 1 0x00000000
[ 1209.629348] ffff9455c936dc00 0000000000000000 ffff94901fef1040 ffff9495ff2d8980
[ 1209.629350] ffff9495e5857100 ffffb091949d3a90 ffffffff8b416a59 0000000000000000
[ 1209.629351] 00ff9455e5151050 ffff9495ff2d8980 ffff9455e04c0210 ffff94901fef1040
[ 1209.629352] Call Trace:
[ 1209.629354] [<ffffffff8b416a59>] ? __schedule+0x239/0x6f0
[ 1209.629356] [<ffffffff8b416f42>] ? schedule+0x32/0x80
[ 1209.629357] [<ffffffff8b41a2dd>] ? schedule_timeout+0x1dd/0x380
[ 1209.629359] [<ffffffff8b104985>] ? queue_unplugged+0x25/0xa0
[ 1209.629361] [<ffffffff8ae2f240>] ? recalibrate_cpu_khz+0x10/0x10
[ 1209.629363] [<ffffffff8b4167bd>] ? io_schedule_timeout+0x9d/0x100
[ 1209.629365] [<ffffffff8b04beac>] ? do_blockdev_direct_IO+0x177c/0x3160
[ 1209.629386] [<ffffffffc0c696a0>] ? xfs_setfilesize+0x80/0x80 [xfs]
[ 1209.629405] [<ffffffffc0c751d0>] ? xfs_file_dio_aio_write+0x210/0x400 [xfs]
[ 1209.629424] [<ffffffffc0c7574d>] ? xfs_file_write_iter+0x9d/0x160 [xfs]
[ 1209.629426] [<ffffffff8b00b500>] ? new_sync_write+0xe0/0x130
[ 1209.629428] [<ffffffff8b00bcf0>] ? vfs_write+0xb0/0x190
[ 1209.629430] [<ffffffff8b00d2e0>] ? SyS_pwrite64+0x90/0xb0
[ 1209.629432] [<ffffffff8ae03b7d>] ? do_syscall_64+0x8d/0x100
[ 1209.629433] [<ffffffff8b41b80e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
[ 1211.558505] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1211.564927] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1211.571348] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1211.577770] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1211.584193] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1211.590616] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1211.597039] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1211.603460] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1211.609881] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1211.616302] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1211.622724] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1211.629147] [<ffffffff8b41b930>] ? __switch_to_asm+0x40/0x70
[ 1211.635567] [<ffffffff8b41b924>] ? __switch_to_asm+0x34/0x70
[ 1211.642024] [<ffffffffc0970bd6>] ? kvm_arch_vcpu_load+0x46/0x290 [kvm]
[ 1211.649419] [<ffffffff8aea1de7>] ? finish_task_switch+0x137/0x210
[ 1211.656319] [<ffffffff8b416a61>] ? __schedule+0x241/0x6f0
[ 1211.662445] [<ffffffffc065ded0>] ? vmx_set_supported_cpuid+0x20/0x20 [kvm_intel]
[ 1211.670809] [<ffffffffc065bbe0>] ? vmx_set_tss_addr+0x130/0x130 [kvm_intel]
[ 1211.678683] [<ffffffff8b416f42>] ? schedule+0x32/0x80
[ 1211.684457] [<ffffffffc095a45a>] ? kvm_vcpu_block+0x8a/0x2f0 [kvm]
[ 1211.691494] [<ffffffffc0976c8a>] ? kvm_arch_vcpu_ioctl_run+0x44a/0x16d0 [kvm]
[ 1211.699564] [<ffffffff8aea4d8e>] ? check_preempt_curr+0x4e/0x90
[ 1211.706308] [<ffffffffc0970bf1>] ? kvm_arch_vcpu_load+0x61/0x290 [kvm]
[ 1211.713731] [<ffffffffc095c665>] ? kvm_vcpu_ioctl+0x315/0x5e0 [kvm]
[ 1211.720830] [<ffffffff8aea5e00>] ? wake_up_q+0x70/0x70
[ 1211.726669] [<ffffffff8aebd17f>] ? __wake_up_common+0x4f/0x90
[ 1211.733189] [<ffffffff8b0203c2>] ? do_vfs_ioctl+0xa2/0x620
[ 1211.739417] [<ffffffff8b00bd84>] ? vfs_write+0x144/0x190
[ 1211.745451] [<ffffffff8b0209b4>] ? SyS_ioctl+0x74/0x80
[ 1211.751291] [<ffffffff8ae03b7d>] ? do_syscall_64+0x8d/0x100
[ 1211.757618] [<ffffffff8b41b80e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
[ 1211.765391] Code: 00 75 73 48 83 c4 38 5b 5d c3 48 8d 74 24 10 48 89 d1 89 df 48 89 ea e8 28 fe ff ff 8b 54 24 28 83 e2 01 74 0b f3 90 8b 54 24 28 <a
[ 1217.396262] INFO: rcu_sched detected stalls on CPUs/tasks:
[ 1217.402406] 39-...: (6 GPs behind) idle=5f1/140000000000000/0 softirq=35610/35612 fqs=24934
[ 1217.411924] (detected by 28, t=52521 jiffies, g=36760, c=36759, q=73516)
[ 1217.419523] Task dump for CPU 39:
[ 1217.423225] qemu-system-x86 R running task 0 9835 1 0x00000008
[ 1217.431123] ffff9495e5826080 ffff9495ff0d8980 ffff9455dedd1100 0000000000000000
[ 1217.439435] ffff9495e3744c00 ffffb091bd4339f0 ffffffff8b416a61 ffffffff8aeeb6f4
[ 1217.447730] 0000000000000040 ffff9495ff0d8980 00ff9455dedd18d8 ffff9455dedd1100
[ 1217.456030] Call Trace:
[ 1217.458770] [<ffffffff8b416a61>] ? __schedule+0x241/0x6f0
[ 1217.464901] [<ffffffff8aeeb6f4>] ? hrtimer_start_range_ns+0x194/0x360
[ 1217.472195] [<ffffffff8aeeb117>] ? hrtimer_try_to_cancel+0x27/0x110
[ 1217.479295] [<ffffffff8b41a795>] ? schedule_hrtimeout_range_clock+0xc5/0x1a0
[ 1217.487267] [<ffffffff8aeeaee0>] ? __hrtimer_init+0xa0/0xa0
[ 1217.493589] [<ffffffff8b41b542>] ? _raw_spin_lock_irqsave+0x32/0x40
[ 1217.500691] [<ffffffff8aebd474>] ? remove_wait_queue+0x14/0x30
[ 1217.507307] [<ffffffff8b02133d>] ? poll_freewait+0x3d/0xa0
[ 1217.513533] [<ffffffff8b02293d>] ? do_sys_poll+0x37d/0x560
[ 1217.519761] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1217.527442] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1217.535125] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1217.542807] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1217.550488] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1217.558171] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1217.565855] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1217.573538] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1217.581220] [<ffffffff8b0215b0>] ? poll_select_copy_remaining+0x150/0x150
[ 1217.588901] [<ffffffff8b022e28>] ? SyS_ppoll+0x168/0x190
[ 1217.594940] [<ffffffff8ae03b7d>] ? do_syscall_64+0x8d/0x100
[ 1217.601265] [<ffffffff8b41b80e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
[ 1225.572700] NMI watchdog: BUG: soft lockup - CPU#69 stuck for 22s! [sshd:39668]
[ 1225.580866] Modules linked in: ebt_arp ebt_among ip6table_raw ip6table_mangle nf_conntrack_ipv6 nf_defrag_ipv6 iptable_nat nf_nat_ipv4 nf_nat xt_con
[ 1225.713294] CPU: 69 PID: 39668 Comm: sshd Tainted: G W L 4.9.0-9-amd64 #1 Debian 4.9.168-1+deb9u5
[ 1225.724270] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.8.0 005/17/2018
[ 1225.732728] task: ffff9449256f0100 task.stack: ffffb0919b7d8000
[ 1225.739341] RIP: 0010:[<ffffffff8aefee25>] [<ffffffff8aefee25>] smp_call_function_many+0x1f5/0x250
[ 1225.749462] RSP: 0018:ffffb0919b7dbbe0 EFLAGS: 00000202
[ 1225.755387] RAX: 0000000000000003 RBX: 0000000000000200 RCX: 0000000000000027
[ 1225.763355] RDX: ffffd0913f8c3da0 RSI: 0000000000000200 RDI: ffff9495ff4998c8
[ 1225.771324] RBP: ffff9495ff4998c8 R08: ffffff8000000000 R09: ffffffffffffffff
[ 1225.779293] R10: 0000000000000008 R11: 0000000000000010 R12: ffff9495ff4998c0
[ 1225.787262] R13: ffffffff8ae696f0 R14: 0000000000000000 R15: 0000000000000001
[ 1225.795233] FS: 00007f4bb07818c0(0000) GS:ffff9495ff480000(0000) knlGS:0000000000000000
[ 1225.804270] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1225.810688] CR2: 00007ffd9ece5f0e CR3: 0000003847f9c000 CR4: 0000000000362670
[ 1225.818658] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1225.826627] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1225.834595] Stack:
[ 1225.836843] 0000000000019880 000000019b7dbc88 ffff945478341900 ffffffff8ae696f0
[ 1225.845143] 0000000000000000 ffffb0919b7dbcd8 ffffb0919b7dbce0 ffff9495ff4d6d08
[ 1225.853449] ffffffff8aeff0b8 ffff945478341900 ffffb0919b7dbc88 ffff9495ff4d6cd8
[ 1225.861752] Call Trace:
[ 1225.864482] [<ffffffff8ae696f0>] ? leave_mm+0xa0/0xa0
[ 1225.870228] [<ffffffff8aeff0b8>] ? on_each_cpu+0x28/0x60
[ 1225.876264] [<ffffffff8ae69e38>] ? flush_tlb_kernel_range+0x48/0x90
<etc, seemingly forever>