[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]

[dm-devel] Soft lockup during device discovery on 2.6.31-rc1



Hi,

I am seeing Soft lockup during device discovery on 2.6.31-rc1. I am having 256 Volumes with 2 paths to each controller and  DM multipath configured for these Volumes. As soon as device discovery starts I am seeing below traces in syslog.


Regards,
Vijay

syslog snippet.
------------------------
Jul  2 16:41:55 localhost kernel: Modules linked in: dm_round_robin scsi_dh_rdac ipv6 autofs4 hidp rfcomm l2cap bluetooth rfkill sunrpc dm_multipath scsi_dh video output sbs sbshc battery acpi_memhotplug ac parport_pc lp parport sr_mod cdrom joydev sg dcdbas serio_raw rtc_cmos rtc_core rtc_lib button qla2xxx lpfc scsi_transport_fc ata_piix libata bnx2 pcspkr dm_snapshot dm_zero dm_mirror dm_region_hash dm_log dm_mod shpchp megaraid_sas sd_mod scsi_mod ext3 jbd uhci_hcd ohci_hcd ehci_hcd [last unloaded: freq_table]
Jul  2 16:41:55 localhost kernel: Pid: 15631, comm: async/7 Tainted: G      D    2.6.31-rc1 #1 PowerEdge R710
Jul  2 16:41:55 localhost kernel: RIP: 0010:[<ffffffff812d303d>]  [<ffffffff812d303d>] lock_kernel+0x24/0x39
Jul  2 16:41:55 localhost kernel: RSP: 0018:ffff88009a9fdd98  EFLAGS: 00000283
Jul  2 16:41:55 localhost kernel: RAX: 000000000000403e RBX: ffff8800910fe400 RCX: ffff88001631d2b8
Jul  2 16:41:55 localhost kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff88001631d1c0
Jul  2 16:41:55 localhost kernel: RBP: ffffffff8100c2ce R08: 8000000000000000 R09: 0410085000000010
Jul  2 16:41:55 localhost kernel: R10: 00014a511e9cd9e0 R11: ffffffff8112299e R12: ffff88009a9fdd10
Jul  2 16:41:55 localhost kernel: R13: ffff88009a9fddd0 R14: 0000003000000020 R15: ffffffff811574d5
Jul  2 16:41:55 localhost kernel: FS:  0000000000000000(0000) GS:ffff88002804b000(0000) knlGS:0000000000000000
Jul  2 16:41:55 localhost kernel: CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
Jul  2 16:41:55 localhost kernel: CR2: 00007f3f77c60000 CR3: 00000000aa7fc000 CR4: 00000000000006f0
Jul  2 16:41:55 localhost kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jul  2 16:41:55 localhost kernel: DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Jul  2 16:41:55 localhost kernel: Call Trace:
Jul  2 16:41:55 localhost kernel:  [<ffffffff810d81c5>] ? __blkdev_get+0x1d/0x32a
Jul  2 16:41:55 localhost kernel:  [<ffffffff810d7d07>] ? bdget+0x105/0x10d
Jul  2 16:41:55 localhost kernel:  [<ffffffff810ff7ce>] ? register_disk+0xaf/0x10a
Jul  2 16:41:55 localhost kernel:  [<ffffffff8114e2ba>] ? add_disk+0xaa/0x105
Jul  2 16:41:55 localhost kernel:  [<ffffffffa008bba6>] ? sd_probe_async+0x120/0x1d9 [sd_mod]
Jul  2 16:41:55 localhost kernel:  [<ffffffff81054b70>] ? async_thread+0x0/0x1ea
Jul  2 16:41:55 localhost kernel:  [<ffffffff81054c70>] ? async_thread+0x100/0x1ea
Jul  2 16:41:55 localhost kernel:  [<ffffffff810353ff>] ? default_wake_function+0x0/0x9
Jul  2 16:41:55 localhost kernel:  [<ffffffff81050416>] ? kthread+0x84/0x8e
Jul  2 16:41:55 localhost kernel:  [<ffffffff8100c93a>] ? child_rip+0xa/0x20
Jul  2 16:41:55 localhost kernel:  [<ffffffffa005f82e>] ? scsi_request_fn+0x0/0x48e [scsi_mod]
Jul  2 16:41:55 localhost kernel:  [<ffffffff81050392>] ? kthread+0x0/0x8e
Jul  2 16:41:55 localhost kernel:  [<ffffffff8100c930>] ? child_rip+0x0/0x20
Jul  2 16:41:55 localhost kernel: BUG: soft lockup - CPU#1 stuck for 61s! [async/33:15657]
Jul  2 16:41:55 localhost kernel: Modules linked in: dm_round_robin scsi_dh_rdac ipv6 autofs4 hidp rfcomm l2cap bluetooth rfkill sunrpc dm_multipath scsi_dh video output sbs sbshc battery acpi_memhotplug ac parport_pc lp parport sr_mod cdrom joydev sg dcdbas serio_raw rtc_cmos rtc_core rtc_lib button qla2xxx lpfc scsi_transport_fc ata_piix libata bnx2 pcspkr dm_snapshot dm_zero dm_mirror dm_region_hash dm_log dm_mod shpchp megaraid_sas sd_mod scsi_mod ext3 jbd uhci_hcd ohci_hcd ehci_hcd [last unloaded: freq_table]
Jul  2 16:41:55 localhost kernel: CPU 1:
Jul  2 16:41:55 localhost kernel: Modules linked in: dm_round_robin scsi_dh_rdac ipv6 autofs4 hidp rfcomm l2cap bluetooth rfkill sunrpc dm_multipath scsi_dh video output sbs sbshc battery acpi_memhotplug ac parport_pc lp parport sr_mod cdrom joydev sg dcdbas serio_raw rtc_cmos rtc_core rtc_lib button qla2xxx lpfc scsi_transport_fc ata_piix libata bnx2 pcspkr dm_snapshot dm_zero dm_mirror dm_region_hash dm_log dm_mod shpchp megaraid_sas sd_mod scsi_mod ext3 jbd uhci_hcd ohci_hcd ehci_hcd [last unloaded: freq_table]
Jul  2 16:41:55 localhost kernel: Pid: 15657, comm: async/33 Tainted: G      D    2.6.31-rc1 #1 PowerEdge R710
Jul  2 16:41:55 localhost kernel: RIP: 0010:[<ffffffff8105cc16>]  [<ffffffff8105cc16>] smp_call_function_many+0x1a4/0x1b5
Jul  2 16:41:55 localhost kernel: RSP: 0018:ffff88000a227d10  EFLAGS: 00000202
Jul  2 16:41:55 localhost kernel: RAX: 00000000000000ff RBX: ffff8800280723a0 RCX: 0000000000000001
Jul  2 16:41:55 localhost kernel: RDX: ffff88001634d250 RSI: 00000000000000ff RDI: 00000000000000c0
Jul  2 16:41:55 localhost kernel: RBP: ffffffff8100c42e R08: 000000000000003f R09: ffffffff815e2358
Jul  2 16:41:55 localhost kernel: R10: 7fffffffffffffff R11: 0000000000000000 R12: ffff88001634d250
Jul  2 16:41:55 localhost kernel: R13: 0000000000000282 R14: ffff88001634d250 R15: 000000010000000e
Jul  2 16:41:55 localhost kernel: FS:  0000000000000000(0000) GS:ffff880028065000(0000) knlGS:0000000000000000
Jul  2 16:41:55 localhost kernel: CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
Jul  2 16:41:55 localhost kernel: CR2: 00007f3f77360d70 CR3: 00000000b8208000 CR4: 00000000000006e0
Jul  2 16:41:55 localhost kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jul  2 16:41:55 localhost kernel: DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Jul  2 16:41:55 localhost kernel: Call Trace:
Jul  2 16:41:55 localhost kernel:  [<ffffffff810d3283>] ? invalidate_bh_lru+0x0/0x41
Jul  2 16:41:55 localhost kernel:  [<ffffffff810d3283>] ? invalidate_bh_lru+0x0/0x41
Jul  2 16:41:55 localhost kernel:  [<ffffffff8105cc47>] ? smp_call_function+0x20/0x24
Jul  2 16:41:55 localhost kernel:  [<ffffffff81041906>] ? on_each_cpu+0x10/0x22
Jul  2 16:41:55 localhost kernel:  [<ffffffff810d76b3>] ? kill_bdev+0x1b/0x30
Jul  2 16:41:55 localhost kernel:  [<ffffffff810d8085>] ? __blkdev_put+0x54/0x151
Jul  2 16:41:55 localhost kernel:  [<ffffffff810ff7df>] ? register_disk+0xc0/0x10a
Jul  2 16:41:55 localhost kernel:  [<ffffffff8114e2ba>] ? add_disk+0xaa/0x105
Jul  2 16:41:55 localhost kernel:  [<ffffffffa008bba6>] ? sd_probe_async+0x120/0x1d9 [sd_mod]
Jul  2 16:41:55 localhost kernel:  [<ffffffff81054b70>] ? async_thread+0x0/0x1ea
Jul  2 16:41:55 localhost kernel:  [<ffffffff81054c70>] ? async_thread+0x100/0x1ea
Jul  2 16:41:55 localhost kernel:  [<ffffffff810353ff>] ? default_wake_function+0x0/0x9
Jul  2 16:41:55 localhost kernel:  [<ffffffff81050416>] ? kthread+0x84/0x8e
Jul  2 16:41:55 localhost kernel:  [<ffffffff8100c93a>] ? child_rip+0xa/0x20
Jul  2 16:41:55 localhost kernel:  [<ffffffffa005f82e>] ? scsi_request_fn+0x0/0x48e [scsi_mod]
Jul  2 16:41:55 localhost kernel:  [<ffffffff81050392>] ? kthread+0x0/0x8e
Jul  2 16:41:55 localhost kernel:  [<ffffffff8100c930>] ? child_rip+0x0/0x20
Jul  2 16:41:55 localhost kernel: BUG: soft lockup - CPU#2 stuck for 61s! [async/82:15713]
Jul  2 16:41:55 localhost kernel: Modules linked in: dm_round_robin scsi_dh_rdac ipv6 autofs4 hidp rfcomm l2cap bluetooth rfkill sunrpc dm_multipath scsi_dh video output sbs sbshc battery acpi_memhotplug ac parport_pc lp parport sr_mod cdrom joydev sg dcdbas serio_raw rtc_cmos rtc_core rtc_lib button qla2xxx lpfc scsi_transport_fc ata_piix libata bnx2 pcspkr dm_snapshot dm_zero dm_mirror dm_region_hash dm_log dm_mod shpchp megaraid_sas sd_mod scsi_mod ext3 jbd uhci_hcd ohci_hcd ehci_hcd [last unloaded: freq_table]
Jul  2 16:41:55 localhost kernel: CPU 2:
Jul  2 16:41:55 localhost kernel: Modules linked in: dm_round_robin scsi_dh_rdac ipv6 autofs4 hidp rfcomm l2cap bluetooth rfkill sunrpc dm_multipath scsi_dh video output sbs sbshc battery acpi_memhotplug ac parport_pc lp parport sr_mod cdrom joydev sg dcdbas serio_raw rtc_cmos rtc_core rtc_lib button qla2xxx lpfc scsi_transport_fc ata_piix libata


[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]