Page MenuHomePhabricator
Paste P5662

mw2256 kernel call trace
ActivePublic

Authored by ema on Jul 2 2017, 12:40 PM.
Startin[1030433.672868] NMI watchdog: BUG: soft lockup - CPU#14 stuck for 23s! [atop:21595]
[1030433.681216] Modules linked in: binfmt_misc 8021q garp mrp stp llc iptable_raw nf_conntrack_ipv4 nf_defrag_ipv4 iptable_filter ip_tables xt_CT ip6table_raw xt_tcpudp xt_pkttype nf_conntrack_ipv6 nf_defrag_ipv6 xt_conntrack ip6table_filter ip6_tables x_tables intel_rapl sb_edac edac_core x86_pkg_temp_thermal intel_powerclamp coretemp kvm mgag200 ttm drm_kms_helper irqbypass iTCO_wdt evdev pcspkr drm crct10dif_pclmul crc32_pclmul dcdbas iTCO_vendor_support ghash_clmulni_intel mxm_wmi i2c_algo_bit intel_cstate intel_rapl_perf mei_me mei shpchp lpc_ich mfd_core button ipmi_si wmi ipmi_devintf ipmi_msghandler nf_conntrack autofs4 ext4 crc16 jbd2 fscrypto mbcache raid1 md_mod sg sd_mod crc32c_intel ahci tg3 aesni_intel libahci aes_x86_64 ptp glue_helper lrw ehci_pci gf128mul ablk_helper ehci_hcd pps_core cryptd libata libphy usbcore scsi_mod usb_common
[1030433.765768] CPU: 14 PID: 21595 Comm: atop Tainted: G D L 4.9.0-0.bpo.3-amd64 #1 Debian 4.9.25-1~bpo8+3
[1030433.777413] Hardware name: Dell Inc. PowerEdge R430/0CN7X8, BIOS 2.3.4 11/08/2016
[1030433.785955] task: ffff969a59da7000 task.stack: ffffa6d946f90000
[1030433.792752] RIP: 0010:[<ffffffffb16c3fbf>] [<ffffffffb16c3fbf>] native_queued_spin_lock_slowpath+0x16f/0x190
[1030433.804019] RSP: 0018:ffffa6d946f93c88 EFLAGS: 00000202
[1030433.810139] RAX: 0000000000000101 RBX: ffff9692563a07b8 RCX: 0000000000000101
[1030433.818293] RDX: 0000000000000101 RSI: 0000000000000001 RDI: ffff9692569d1718
[1030433.826448] RBP: ffff9692569d1000 R08: 0000000000000001 R09: 0000000000000004
[1030433.834603] R10: ffffffffffffffff R11: ffff96925639eb78 R12: ffff9692569d1718
[1030433.842758] R13: ffffa6d946f93d80 R14: ffff969258297b60 R15: 00000000fffffff6
[1030433.850914] FS: 00007f74648c5700(0000) GS:ffff96925f9c0000(0000) knlGS:0000000000000000
[1030433.860135] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[1030433.866737] CR2: 00007fd80dc43ff8 CR3: 000000085b46b000 CR4: 00000000003406e0
[1030433.874891] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[1030433.883045] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[1030433.891201] Stack:
[1030433.893634] ffffffffb1c053cd ffffffffb1874e5a ffffa6d946f93df0 ffff96925639eb40
[1030433.902115] ffffa6d946f93d88 ffffffffb180e442 ffffa6d9004800cc ffffa6d946f93d7c
[1030433.910595] 0000000246f93f04 0000000029848ad4 ffff969256188b40 0000000000008000
[1030433.919076] Call Trace:
[1030433.921996] [<ffffffffb1c053cd>] ? _raw_spin_lock+0x1d/0x20
[1030433.928505] [<ffffffffb1874e5a>] ? pid_revalidate+0x4a/0xe0
[1030433.935012] [<ffffffffb180e442>] ? lookup_fast+0x2a2/0x300
[1030433.941424] [<ffffffffb1811d80>] ? path_openat+0x180/0x1510
[1030433.947932] [<ffffffffb181b88f>] ? dput+0x2f/0x240
[1030433.953567] [<ffffffffb180f00a>] ? walk_component+0xea/0x440
[1030433.960170] [<ffffffffb1814391>] ? do_filp_open+0x91/0x100
[1030433.966581] [<ffffffffb17fe81b>] ? __check_object_size+0x10b/0x1dc
[1030433.973766] [<ffffffffb1801e77>] ? do_sys_open+0x127/0x210
[1030433.980176] [<ffffffffb1c055fb>] ? system_call_fast_compare_end+0xc/0x9b
[1030433.987942] Code: c2 89 d0 66 31 c0 41 39 c0 74 e6 4d 85 c9 c6 07 01 74 2d 41 c7 41 08 01 00 00 00 e9 52 ff ff ff 83 fa 01 74 17 8b 07 84 c0 74 08 <f3> 90 8b 07 84 c0 75 f8 b8 01 00 00 00 66 89 07 c3 f3 c3 f3 90
[1030440.068717] INFO: rcu_sched detected stalls on CPUs/tasks:
[1030440.075045] 0-...: (1 GPs behind) idle=165/1/0 softirq=25367170/25367170 fqs=3290
[1030440.083785] 4-...: (0 ticks this GP) idle=ea7/140000000000000/0 softirq=6816005/6816005 fqs=3290
[1030440.093979] 12-...: (6 GPs behind) idle=32f/1/0 softirq=2929704/2929704 fqs=3290
[1030440.102621] (detected by 24, t=9836380 jiffies, g=18962974, c=18962973, q=17449)
[1030440.111177] Task dump for CPU 0:
[1030440.114970] swapper/0 R running task 0 0 0 0x00000000
[1030440.123049] 00000000000000f6 0000000000000003 ffff96925f8187c0 000000000000001f
[1030440.131538] 0000000000000000 ffff96925f815f18 0000000000000000 ffffffffffffff9d
[1030440.140026] ffffffffb1acb333 0000000000000010 0000000000000246 ffffffffb2203ed0
[1030440.148515] Call Trace:
[1030440.151438] [<ffffffffb1acb333>] ? cpuidle_enter_state+0x113/0x260
[1030440.158626] [<ffffffffb16bc05e>] ? cpu_startup_entry+0x17e/0x260
[1030440.165622] [<ffffffffb2349f84>] ? start_kernel+0x46d/0x48d
[1030440.172132] [<ffffffffb2349120>] ? early_idt_handler_array+0x120/0x120
[1030440.179709] [<ffffffffb23495b9>] ? x86_64_start_kernel+0x152/0x176
[1030440.186895] Task dump for CPU 4:
[1030440.190687] md1_raid1 R running task 0 548 2 0x00000008
[1030440.198766] ffffffffc0393f07 ffff9692569d1000 ffff96925c3f1080 0000000000000001
[1030440.207254] ffffa6d94793bdd0 ffff969258b7ec38 ffff9692515aba00 ffff969258b7ec00
[1030440.215742] ffff969258074000 ffff969200000004 0000000000000000 ffff969258b7ec00
[1030440.224228] Call Trace:
[1030440.227150] [<ffffffffc0393f07>] ? raid1d+0x7f7/0x1050 [raid1]
[1030440.233953] [<ffffffffb16e6290>] ? lock_timer_base+0x90/0x90
[1030440.240551] [<ffffffffb1c05542>] ? _raw_spin_lock_irqsave+0x32/0x40
[1030440.247837] [<ffffffffb16bbcd8>] ? complete+0x18/0x40
[1030440.253767] [<ffffffffb1674c80>] ? mm_release+0xb0/0x130
[1030440.259985] [<ffffffffb167bcab>] ? do_exit+0x14b/0xb50
[1030440.266010] [<ffffffffb1c06dd7>] ? rewind_stack_do_exit+0x17/0x20
[1030440.273101] Task dump for CPU 12:
[1030440.276991] swapper/12 R running task 0 0 1 0x00000008
[1030440.285067] 000000000024c6a2 0000000000000004 ffff96925f9987c0 000000000000001f
[1030440.293556] 0000000000000000 ffff96925f995f18 0000000000000000 ffffffffffffff10
[1030440.302045] ffffffffb1acb333 0000000000000010 0000000000000246 ffffa6d94645bea0
[1030440.310533] Call Trace:
[1030440.313455] [<ffffffffb1acb333>] ? cpuidle_enter_state+0x113/0x260
[1030440.320644] [<ffffffffb16bc05e>] ? cpu_startup_entry+0x17e/0x260
[1030440.327638] [<ffffffffb164843d>] ? start_secondary+0x14d/0x190
[1030440.334438] rcu_sched kthread starved for 9829751 jiffies! g18962974 c18962973 f0x2 RCU_GP_WAIT_FQS(3) ->state=0x0
[1030440.346183] rcu_sched R running task 0 8 2 0x00000000
[1030440.354259] ffff969258ee1400 0000000000000000 ffff96925bc00140 ffff96925c3df080
[1030440.362745] ffff96925f9587c0 ffffa6d94018fdb0 ffffffffb1c0089d ffffa6d94018fde0
[1030440.371234] ffffa6d94018fde0 000000005f950080 0000000000000246 ffff96925c3df080
[1030440.379721] Call Trace:
[1030440.382643] [<ffffffffb1c0089d>] ? __schedule+0x23d/0x6d0
[1030440.388959] [<ffffffffb1c00d62>] ? schedule+0x32/0x80
[1030440.394886] [<ffffffffb1c041ca>] ? schedule_timeout+0x17a/0x300
[1030440.401783] [<ffffffffb16e6290>] ? lock_timer_base+0x90/0x90
[1030440.408388] [<ffffffffb16bbc33>] ? prepare_to_swait+0x53/0x60
[1030440.415091] [<ffffffffb16e066b>] ? rcu_gp_kthread+0x3db/0x830
[1030440.421795] [<ffffffffb16bb34e>] ? __wake_up_common+0x4e/0x90
[1030440.428498] [<ffffffffb16e0290>] ? force_qs_rnp+0x180/0x180
[1030440.435007] [<ffffffffb1697520>] ? kthread+0xf0/0x110
[1030440.440935] [<ffffffffb162476b>] ? __switch_to+0x2bb/0x700
[1030440.447347] [<ffffffffb1697430>] ? kthread_park+0x60/0x60
[1030440.453661] [<ffffffffb1c05875>] ? ret_from_fork+0x25/0x30
[1030461.672203] NMI watchdog: BUG: soft lockup - CPU#14 stuck for 23s! [atop:21595]
[1030461.680551] Modules linked in: binfmt_misc 8021q garp mrp stp llc iptable_raw nf_conntrack_ipv4 nf_defrag_ipv4 iptable_filter ip_tables xt_CT ip6table_raw xt_tcpudp xt_pkttype nf_conntrack_ipv6 nf_defrag_ipv6 xt_conntrack ip6table_filter ip6_tables x_tables intel_rapl sb_edac edac_core x86_pkg_temp_thermal intel_powerclamp coretemp kvm mgag200 ttm drm_kms_helper irqbypass iTCO_wdt evdev pcspkr drm crct10dif_pclmul crc32_pclmul dcdbas iTCO_vendor_support ghash_clmulni_intel mxm_wmi i2c_algo_bit intel_cstate intel_rapl_perf mei_me mei shpchp lpc_ich mfd_core button ipmi_si wmi ipmi_devintf ipmi_msghandler nf_conntrack autofs4 ext4 crc16 jbd2 fscrypto mbcache raid1 md_mod sg sd_mod crc32c_intel ahci tg3 aesni_intel libahci aes_x86_64 ptp glue_helper lrw ehci_pci gf128mul ablk_helper ehci_hcd pps_core cryptd libata libphy usbcore scsi_mod usb_common
[1030461.765107] CPU: 14 PID: 21595 Comm: atop Tainted: G D L 4.9.0-0.bpo.3-amd64 #1 Debian 4.9.25-1~bpo8+3
[1030461.776752] Hardware name: Dell Inc. PowerEdge R430/0CN7X8, BIOS 2.3.4 11/08/2016
[1030461.785295] task: ffff969a59da7000 task.stack: ffffa6d946f90000
[1030461.792091] RIP: 0010:[<ffffffffb16c3fc1>] [<ffffffffb16c3fc1>] native_queued_spin_lock_slowpath+0x171/0x190
[1030461.803359] RSP: 0018:ffffa6d946f93c88 EFLAGS: 00000202
[1030461.809477] RAX: 0000000000000101 RBX: ffff9692563a07b8 RCX: 0000000000000101
[1030461.817631] RDX: 0000000000000101 RSI: 0000000000000001 RDI: ffff9692569d1718
[1030461.825785] RBP: ffff9692569d1000 R08: 0000000000000001 R09: 0000000000000004
[1030461.833940] R10: ffffffffffffffff R11: ffff96925639eb78 R12: ffff9692569d1718
[1030461.842095] R13: ffffa6d946f93d80 R14: ffff969258297b60 R15: 00000000fffffff6
[1030461.850251] FS: 00007f74648c5700(0000) GS:ffff96925f9c0000(0000) knlGS:0000000000000000
[1030461.859471] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[1030461.866076] CR2: 00007fd80dc43ff8 CR3: 000000085b46b000 CR4: 00000000003406e0
[1030461.874231] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[1030461.882385] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[1030461.890540] Stack:
[1030461.892973] ffffffffb1c053cd ffffffffb1874e5a ffffa6d946f93df0 ffff96925639eb40
[1030461.901454] ffffa6d946f93d88 ffffffffb180e442 ffffa6d9004800cc ffffa6d946f93d7c
[1030461.909937] 0000000246f93f04 0000000029848ad4 ffff969256188b40 0000000000008000
[1030461.918417] Call Trace:
[1030461.921338] [<ffffffffb1c053cd>] ? _raw_spin_lock+0x1d/0x20
[1030461.927845] [<ffffffffb1874e5a>] ? pid_revalidate+0x4a/0xe0
[1030461.934351] [<ffffffffb180e442>] ? lookup_fast+0x2a2/0x300
[1030461.940762] [<ffffffffb1811d80>] ? path_openat+0x180/0x1510
[1030461.947271] [<ffffffffb181b88f>] ? dput+0x2f/0x240
[1030461.952906] [<ffffffffb180f00a>] ? walk_component+0xea/0x440
[1030461.959509] [<ffffffffb1814391>] ? do_filp_open+0x91/0x100
[1030461.965920] [<ffffffffb17fe81b>] ? __check_object_size+0x10b/0x1dc
[1030461.973107] [<ffffffffb1801e77>] ? do_sys_open+0x127/0x210
[1030461.979517] [<ffffffffb1c055fb>] ? system_call_fast_compare_end+0xc/0x9b
[1030461.987284] Code: d0 66 31 c0 41 39 c0 74 e6 4d 85 c9 c6 07 01 74 2d 41 c7 41 08 01 00 00 00 e9 52 ff ff ff 83 fa 01 74 17 8b 07 84 c0 74 08 f3 90 <8b> 07 84 c0 75 f8 b8 01 00 00 00 66 89 07 c3 f3 c3 f3 90 4c 8b

Event Timeline

ema created this paste.Jul 2 2017, 12:40 PM