[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]

Re: Re: kjournald stuck in DW< state



Here is the output from sysrq-w:

root dimitar:~$ echo w > /proc/sysrq-trigger
SysRq : Show Blocked State

                         free                        sibling
  task             PC    stack   pid father child younger older
kjournald     D C0284784     0   408      6 (L-TLB)
[<c0284240>] (schedule+0x0/0x64c) from [<c00f8724>] (journal_commit_transaction+0x16c/0x1568)
[<c00f85b8>] (journal_commit_transaction+0x0/0x1568) from [<c00fd99c>] (kjournald+0xbc/0x260)
[<c00fd8e0>] (kjournald+0x0/0x260) from [<c0070d9c>] (kthread+0xe8/0x128)
[<c0070cb4>] (kthread+0x0/0x128) from [<c005d980>] (do_exit+0x0/0x8c8)
 r7 = 00000000  r6 = 00000000  r5 = 00000000  r4 = 00000000
fautotest     D C0284784     0  1184    665 (NOTLB)
[<c0284240>] (schedule+0x0/0x64c) from [<c02852ec>] (io_schedule+0x34/0x58)
[<c02852b8>] (io_schedule+0x0/0x58) from [<c00c7f3c>] (sync_buffer+0x4c/0x54)
 r4 = C3E21BDC
[<c00c7ef0>] (sync_buffer+0x0/0x54) from [<c0285694>] (__wait_on_bit_lock+0x60/0x94)
[<c0285634>] (__wait_on_bit_lock+0x0/0x94) from [<c0285744>] (out_of_line_wait_on_bit_lock+0x7c/0x88)
 r8 = C3F8F400  r7 = 00000002  r6 = C00C7EF0  r5 = C0000070
 r4 = C3E21BF0
[<c02856c8>] (out_of_line_wait_on_bit_lock+0x0/0x88) from [<c00c8178>] (__lock_buffer+0x40/0x48)
[<c00c8138>] (__lock_buffer+0x0/0x48) from [<c00f6434>] (do_get_write_access+0x78/0x5a0)
[<c00f63bc>] (do_get_write_access+0x0/0x5a0) from [<c00f6988>] (journal_get_write_access+0x2c/0x40)
[<c00f695c>] (journal_get_write_access+0x0/0x40) from [<c00f3bf0>] (__ext3_journal_get_write_access+0x28/0x58)
 r5 = C3F8F400  r4 = D268C3B0
[<c00f3bc8>] (__ext3_journal_get_write_access+0x0/0x58) from [<c00e85bc>] (ext3_reserve_inode_write+0x44/0x80)
 r7 = C3452CB8  r6 = 00000000  r5 = D268C3B0  r4 = C3E21CF4
[<c00e8578>] (ext3_reserve_inode_write+0x0/0x80) from [<c00e861c>] (ext3_mark_inode_dirty+0x24/0x4c)
 r7 = C3E86600  r6 = C3E21CF4  r5 = D268C3B0  r4 = C3452CB8
[<c00e85f8>] (ext3_mark_inode_dirty+0x0/0x4c) from [<c00eb57c>] (ext3_dirty_inode+0x6c/0x84)
 r6 = C3452CB8  r5 = 00000000  r4 = D268C3B0
[<c00eb510>] (ext3_dirty_inode+0x0/0x84) from [<c00c36fc>] (__mark_inode_dirty+0x38/0x1a8)
 r6 = 0019F1B9  r5 = 00000001  r4 = C3452CB8
[<c00c36c4>] (__mark_inode_dirty+0x0/0x1a8) from [<c00b96e8>] (file_update_time+0x9c/0xc4)
 r8 = C3452CB8  r7 = 00000000  r6 = 0019F1B9  r5 = 00000000
 r4 = C3452CB8
[<c00b964c>] (file_update_time+0x0/0xc4) from [<c0082edc>] (__generic_file_aio_write_nolock+0x3f0/0x598)
 r5 = FFFFFFFF  r4 = C3E20000
[<c0082aec>] (__generic_file_aio_write_nolock+0x0/0x598) from [<c00830fc>] (generic_file_aio_write+0x78/0xf4)
[<c0083084>] (generic_file_aio_write+0x0/0xf4) from [<c00e69f0>] (ext3_file_write+0x28/0xa8)
[<c00e69c8>] (ext3_file_write+0x0/0xa8) from [<c00a303c>] (do_sync_write+0xb0/0x100)
 r7 = 00000122  r6 = C3E21F78  r5 = D3BB29E0  r4 = C3E21E98
[<c00a2f8c>] (do_sync_write+0x0/0x100) from [<c00a3948>] (vfs_write+0xb8/0x148)
 r6 = C3E21F78  r5 = 4001C000  r4 = D3BB29E0
[<c00a3890>] (vfs_write+0x0/0x148) from [<c00a3f24>] (sys_write+0x44/0x70)
 r7 = 00000000  r6 = 0019F1B9  r5 = FFFFFFF7  r4 = D3BB29E0
[<c00a3ee0>] (sys_write+0x0/0x70) from [<c0033ca0>] (ret_fast_syscall+0x0/0x2c)
 r7 = 00000004  r6 = 4001C000  r5 = 00000122  r4 = 0032EB68
FusionId      D C0284784     0  4653    665 (NOTLB)
[<c0284240>] (schedule+0x0/0x64c) from [<c02852ec>] (io_schedule+0x34/0x58)
[<c02852b8>] (io_schedule+0x0/0x58) from [<c0080c30>] (sync_page+0x50/0x5c)
 r4 = D23C1E34
[<c0080be0>] (sync_page+0x0/0x5c) from [<c02857b4>] (__wait_on_bit+0x64/0xac)
[<c0285750>] (__wait_on_bit+0x0/0xac) from [<c0080ee8>] (wait_on_page_bit+0x98/0xa8)
[<c0080e50>] (wait_on_page_bit+0x0/0xa8) from [<c0081c3c>] (wait_on_page_writeback_range+0x6c/0x134)
 r6 = D23C1E80  r5 = 00000001  r4 = C03DA2A0
[<c0081bd0>] (wait_on_page_writeback_range+0x0/0x134) from [<c0081d74>] (filemap_fdatawait+0x70/0x7c)
[<c0081d04>] (filemap_fdatawait+0x0/0x7c) from [<c00820d8>] (filemap_write_and_wait+0x38/0x48)
 r8 = 00000000  r7 = 00000001  r6 = D23C0000  r5 = C0406140
 r4 = 00000000
[<c00820a0>] (filemap_write_and_wait+0x0/0x48) from [<c00c7d60>] (sync_blockdev+0x24/0x30)
 r5 = C3E86640  r4 = C3E86600
[<c00c7d3c>] (sync_blockdev+0x0/0x30) from [<c00c35cc>] (__sync_inodes+0x90/0xf4)
[<c00c353c>] (__sync_inodes+0x0/0xf4) from [<c00c3654>] (sync_inodes+0x24/0x40)
 r8 = C0033E48  r7 = 00000024  r6 = 41E08264  r5 = 00000005
 r4 = 00000000
[<c00c3630>] (sync_inodes+0x0/0x40) from [<c00c61cc>] (do_sync+0x24/0x70)
 r4 = 00000001
[<c00c61a8>] (do_sync+0x0/0x70) from [<c00c622c>] (sys_sync+0x14/0x1c)
 r4 = 0037AAD8
[<c00c6218>] (sys_sync+0x0/0x1c) from [<c0033ca0>] (ret_fast_syscall+0x0/0x2c)
pdflush       D C0284784     0 32228      6 (L-TLB)
[<c0284240>] (schedule+0x0/0x64c) from [<c02852ec>] (io_schedule+0x34/0x58)
[<c02852b8>] (io_schedule+0x0/0x58) from [<c0130474>] (get_request_wait+0xc0/0x120)
 r4 = D2611C14
[<c01303b4>] (get_request_wait+0x0/0x120) from [<c01316b8>] (__make_request+0x430/0x614)
[<c0131288>] (__make_request+0x0/0x614) from [<c012f1a8>] (generic_make_request+0x180/0x198)
[<c012f028>] (generic_make_request+0x0/0x198) from [<c0131f3c>] (submit_bio+0x110/0x134)
 r8 = C04060A8  r7 = D2610038  r6 = 00000008  r5 = 00000001
 r4 = C034E3C0
[<c0131e2c>] (submit_bio+0x0/0x134) from [<c00c6f34>] (submit_bh+0x15c/0x18c)
[<c00c6dd8>] (submit_bh+0x0/0x18c) from [<c00c8bb4>] (__block_write_full_page+0x2cc/0x47c)
 r6 = C3F8F400  r5 = C03DA2A0  r4 = C3F8F400
[<c00c88e8>] (__block_write_full_page+0x0/0x47c) from [<c00c8ddc>] (block_write_full_page+0x78/0x130)
[<c00c8d64>] (block_write_full_page+0x0/0x130) from [<c00cca78>] (blkdev_writepage+0x18/0x20)
[<c00cca60>] (blkdev_writepage+0x0/0x20) from [<c0087248>] (generic_writepages+0x1dc/0x37c)
[<c008706c>] (generic_writepages+0x0/0x37c) from [<c008742c>] (do_writepages+0x44/0x64)
[<c00873e8>] (do_writepages+0x0/0x64) from [<c00c2e1c>] (__writeback_single_inode+0x1e0/0x3ac)
 r4 = 00000004
[<c00c2c3c>] (__writeback_single_inode+0x0/0x3ac) from [<c00c3394>] (sync_sb_inodes+0x1e4/0x2d0)
[<c00c31b0>] (sync_sb_inodes+0x0/0x2d0) from [<c00c3910>] (writeback_inodes+0xa4/0x120)
[<c00c386c>] (writeback_inodes+0x0/0x120) from [<c008791c>] (background_writeout+0xa0/0xdc)
 r7 = C032ABF0  r6 = 00000001  r5 = 00000001  r4 = D2610000
[<c008787c>] (background_writeout+0x0/0xdc) from [<c0088188>] (pdflush+0x16c/0x260)
 r5 = D2611F9C  r4 = D2610000
[<c008801c>] (pdflush+0x0/0x260) from [<c0070d9c>] (kthread+0xe8/0x128)
 r8 = 00000000  r7 = C008801C  r6 = C048FF24  r5 = D2610000
 r4 = 00000000
[<c0070cb4>] (kthread+0x0/0x128) from [<c005d980>] (do_exit+0x0/0x8c8)
 r7 = 00000000  r6 = 00000000  r5 = 00000000  r4 = 00000000
root dimitar:~$ ttyS1: 1 input overrun(s)




Apr 14, 2009 10:02:56 AM, sandeen redhat com wrote:
dkg_004 verizon net wrote:
> Ted,
>
> There are not OOPS messages.
> The kernel is provided by the CPU vendor. From what I know - the Ext3
> code has not been modified.
> At the moment I do not have list of modifications the vendor made, and
> not sure I will be able to get such list. I have the source code so
> probably I can compare with the stock kernel and see what has been changed.
>
> Upgrading the kernel to 2.6.29 will be difficult. Will it be possible to
> upgrade / patch the Ext3 code only? Will that work?

It'd be tough. I've been playing with arm vendor kernels lately
(probably the same codebase) and doing some filesystem backporting...
it's possible but not for the faint-hearted.

You did sysrq-t; if sysrq-w is supported in the kernel it will give you
only the tasks in blocked state, which may show a deadlock more clearly?

-Eric

> I will try with LOCKDEP and see what happens.
>
> Thanks a lot.
>
> Dimitar

[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]