Kernel panic in ext3:dx_probe, help needed

[Ulf Zimmermann]

Ok, I finally got a complete message of this panic:

Unmounting pipe file systems:  
Unmounting file systems:  
Halting system...
md: stopping all md devices.
md: md0 switched to read-only mode.
cciss: stopping all cciss devices.
cciss: removing controller 0
Assertion failure in dx_probe() at fs/ext3/namei.c:381:
"dx_get_limit(entries) == dx_root_limit(dir, root->info.info_length)"
----------- [cut here ] --------- [please bite here ] ---------
Kernel BUG at namei:381
invalid operand: 0000 [1] SMP 
CPU 2 
Modules linked in: mptctl mptbase sg md5 ipv6 parport_pc lp parport
autofs4 i2c_dev i2c_core ocfs2(U) debugfs(U) ocfs2_dlmfs(U) ocfs2_dlm(U)
ocfs2_nodemanager(U) configfs(U) hangcheck_timer sunrpc dm_mirror
dm_round_robin dm_multipath dm_mod button battery ac joydev ehci_hcd
uhci_hcd hw_random e1000 bnx2(U) ext3 jbd qla2400(U) qla2xxx(U) ata_piix
libata cciss(U) sd_mod scsi_mod
Pid: 4272, comm: khelper Tainted: P      2.6.9-55.ELsmp
RIP: 0010:[<ffffffffa010a0f4>] <ffffffffa010a0f4>{:ext3:dx_probe+427}
RSP: 0018:00000104194738e8  EFLAGS: 00010212
RAX: 0000000000000081 RBX: 000001041e9cd800 RCX: 0000000000000246
RDX: 0000000000007c88 RSI: 0000000000000246 RDI: ffffffff803e4d80
RBP: 000001041e9cd818 R08: 00000000000927bf R09: 000001041e9cd800
R10: ffffffff803184a0 R11: 0000ffff803ffbe0 R12: 00000104194739d8
R13: 0000000000000000 R14: 000001041e58f4a8 R15: 000001041fae3c58
FS:  0000000000000000(0000) GS:ffffffff804ed800(0000)
knlGS:0000000000000000
CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
CR2: 00000000005b98c0 CR3: 000000042153e000 CR4: 00000000000006e0
Process khelper (pid: 4272, threadinfo 0000010419472000, task
000001041821f7f0)
Stack: 1355fd8200000041 00000104194739d4 00000104194739d8
fffffffffffffff4 
       000001041bc19628 000001041fae3c58 0000010421255448
0000010419473c68 
       000001041fae3c58 ffffffffa010a873 
Call Trace:<ffffffffa010a873>{:ext3:ext3_find_entry+293}
<ffffffffa010ad81>{:ext3:ext3_lookup+47} 
       <ffffffff80186665>{do_lookup+230}
<ffffffff80187301>{__link_path_walk+2579} 
       <ffffffff80187801>{link_path_walk+82}
<ffffffff8015ce9d>{generic_file_aio_read+48} 
       <ffffffff801a27c0>{load_script+0}
<ffffffff80187a4f>{path_lookup+452} 
       <ffffffff801a27c0>{load_script+0}
<ffffffff801832fa>{open_exec+30} 
       <ffffffff8015ce9d>{generic_file_aio_read+48}
<ffffffff801a27c0>{load_script+0} 
       <ffffffff801a2977>{load_script+439}
<ffffffff8017466d>{alloc_page_interleave+61} 
       <ffffffff801a2cda>{load_elf_binary+0}
<ffffffff8018448d>{search_binary_handler+210} 
       <ffffffff801847c2>{do_execve+398}
<ffffffff80147639>{__call_usermodehelper+0} 
       <ffffffff8010ee44>{sys_execve+52} <ffffffff80110fb5>{execve+101} 
       <ffffffff80147639>{__call_usermodehelper+0}
<ffffffff80147578>{____exec_usermodehelper+236} 
       <ffffffff801475b8>{____call_usermodehelper+44}
<ffffffff80110f47>{child_rip+8} 
       <ffffffff80147639>{__call_usermodehelper+0}
<ffffffff8014758c>{____call_usermodehelper+0} 
       <ffffffff80110f3f>{child_rip+0} 

Code: 0f 0b 5d 63 11 a0 ff ff ff ff 7d 01 0f b7 5d 02 85 db 74 08 
RIP <ffffffffa010a0f4>{:ext3:dx_probe+427} RSP <00000104194738e8>
 <0>Kernel panic - not syncing: Oops

This only happens when / (c0d0p6) has dir_index set with the latest HP
cciss driver (cpq_cciss-2.6.16-6.x86_64).

Regards, Ulf.

---------------------------------------------------------------------
ATC-Onlane Inc., T: 650-532-6382, F: 650-532-6441
4600 Bohannon Drive, Suite 100, Menlo Park, CA 94025
---------------------------------------------------------------------

> -----Original Message-----
> From: ext3-users-bounces at redhat.com
[mailto:ext3-users-bounces at redhat.com]
> On Behalf Of Ulf Zimmermann
> Sent: 07/14/2007 20:33
> To: Christian Kujau
> Cc: ext3-users at redhat.com
> Subject: RE: Kernel panic in ext3:dx_probe, help needed
> 
> > -----Original Message-----
> > From: "evil at g-house.de"@mail.g-house.de
> [mailto:"evil at g-house.de"@mail.g-
> > house.de] On Behalf Of Christian Kujau
> > Sent: Saturday, July 14, 2007 19:04
> > To: Ulf Zimmermann
> > Cc: ext3-users at redhat.com
> > Subject: RE: Kernel panic in ext3:dx_probe, help needed
> >
> > On Sat, 14 Jul 2007, Ulf Zimmermann wrote:
> > >>> believe before the cciss driver is getting unloaded. The last
> > >>> messages I am able to see are:
> > >>>
> > >>> md: stopping all md devices.
> > >>> md: md0 switched to read-only mode.
> >
> > I think these messages are the real cause of the ext3 errors.
> >
> > > Ok, found more information. EL4 sets dir_index for / (cciss/c0d0p6
> as we
> > > are installing it). The RedHat provided cciss driver (2.6.14-RH2)
> has no
> > > problem with that, the latest cciss driver from HP, 2.6.16-6,
does.
> > > Turning off dir_index for /, forcing fsck during reboot and
> everything
> > > is fine.
> >
> > A device driver should not care about filesystem features, IMHO.
> Either
> > there are problems with the cciss driver (syslog messages please) or
> the
> > ext3 fs is corrupted - in which case fsck should be run.
> 
> I can reproduce this on 8+ servers, 6 of them were just installed
> yesterday afternoon. Using "tune2fs -O ^dir_index /dev/cciss/c0d0p6"
> followed by a "touch /forcefsck && reboot" leads to no panics are
reboot
> time.
> 
> I have reported this to HP for now.
> 
> Ulf.
> 
> 
> _______________________________________________
> Ext3-users mailing list
> Ext3-users at redhat.com
> https://www.redhat.com/mailman/listinfo/ext3-users