[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]

Re: [Linux-cluster] GFS = filesystem consistency error



Hi there,
I would like to give an update to my ticket. That will maybe help people
who've got similar trouble :
I resolved my problem by doing:
- gfs_tool shrink /home (supposed to reclaim but did not)
- gfs_tool reclaim /home (still not enough )
unmount the /home on all my nodes
-gfs_fsck -y /dev/etherd/e0.0
-remount my /home 
VICTORY = i lost all the broken inode files
ADVICE= avoid 1 million file folder in the future

Cheers, Oly


On Wed, 2006-03-01 at 14:02 +1100, oly wrote:
> Hi there
>         I've got a 4nodes RHEL4 cluster with GFS version  6.1.0 (built
>         Jun  7
>         2005 12:46:04).
>         The shared disk is a NAS detected by aoe as /dev/etherd/e0.0.
>         ANd i have problem on few files on teh file system : if i tried
>         to
>         modify the inodes o this files (delete the file, or unlink the
>         inode)
>         the cluster nodes where i launch the command lost the GFS and
>         the GFS
>         modules stay busy and cannot be remove from the kernel. my nodes
>         is so
>         stuck and the only solution is only to hardware restart this
>         nodes.
>          All the GFS journal seems to work fine ...i can even get stat
>         of the
>         DEAD file.
>          Is GFS got problem to manipulate file in a 'more than 1 million
>         files'
>         folder ?
>          IS anyone got a solution to remove this dead files or delete
>         teh fodler
>         that content all these dead files ?
>          Is a gfs.fsck can resolv my problem ?
>          Is there any later version that fix this problem ?
>         
>         Thanks in advance.
>         PS = see below all the details
>          
>         The error i get when i try to unlink the file inode:
>         ===========ERROR============
>         GFS: fsid=entcluster:sataide.2: fatal: filesystem consistency
>         error
>         GFS: fsid=entcluster:sataide.2:   inode = 8516674/8516674
>         GFS: fsid=entcluster:sataide.2:   function = gfs_change_nlink
>         GFS: fsid=entcluster:sataide.2:   file
>         = /usr/src/build/574067-i686/BUILD/smp/src/gfs/inode.c, line =
>         843
>         GFS: fsid=entcluster:sataide.2:   time = 1141080134
>         GFS: fsid=entcluster:sataide.2: about to withdraw from the
>         cluster
>         GFS: fsid=entcluster:sataide.2: waiting for outstanding I/O
>         GFS: fsid=entcluster:sataide.2: telling LM to withdraw
>         lock_dlm: withdraw abandoned memory
>         GFS: fsid=entcluster:sataide.2: withdrawn
>           mh_magic = 0x01161970
>           mh_type = 4
>           mh_generation = 68
>           mh_format = 400
>           mh_incarn = 6
>           no_formal_ino = 8516674
>           no_addr = 8516674
>           di_mode = 0664
>           di_uid = 500
>           di_gid = 500
>           di_nlink = 0
>           di_size = 0
>           di_blocks = 1
>           di_atime = 1141042636
>           di_mtime = 1140001370
>           di_ctime = 1140001370
>           di_major = 0
>           di_minor = 0
>           di_rgrp = 8513987
>           di_goal_rgrp = 8513987
>           di_goal_dblk = 2682
>           di_goal_mblk = 2682
>           di_flags = 0x00000004
>           di_payload_format = 0
>           di_type = 1
>           di_height = 0
>           di_incarn = 0
>           di_pad = 0
>           di_depth = 0
>           di_entries = 0
>           no_formal_ino = 0
>           no_addr = 0
>           di_eattr = 0
>           di_reserved =
>         00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
>         00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
>         00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
>         00 00 00 00 00 00 00 00
>         ========END OF ERROR==========
>         
>         My cman status:
>         ==========STATUS============
>         Protocol version: 5.0.1
>         Config version: 4
>         Cluster name: entcluster
>         Cluster ID: 42548
>         Cluster Member: Yes
>         Membership state: Cluster-Member
>         Nodes: 4
>         Expected_votes: 1
>         Total_votes: 4
>         Quorum: 3
>         Active subsystems: 5
>         Node name: XXX.domainX.tld
>         Node addresses: x.x.x.x
>         ========END CMAN=========
>         
>         My gfs_tool df :
>         ============DF=========
>         /home:
>           SB lock proto = "lock_dlm"
>           SB lock table = "entcluster:sataide"
>           SB ondisk format = 1309
>           SB multihost format = 1401
>           Block size = 4096
>           Journals = 4
>           Resource Groups = 274
>           Mounted lock proto = "lock_dlm"
>           Mounted lock table = "entcluster:sataide"
>           Mounted host data = ""
>           Journal number = 0
>           Lock module flags =
>           Local flocks = FALSE
>           Local caching = FALSE
>           Oopses OK = FALSE
>         
>           Type           Total          Used           Free
>         use%
>         
>         ------------------------------------------------------------------------
>           inodes         100642         100642         0
>         100%
>           metadata       3842538        8527           3834011        0%
>           data           13999476       2760327        11239149
>         20%
>         =============END DF =========
>         Version of my modules :
>         ========modules========
>         CMAN 2.6.9-36.0 (built May 31 2005 12:15:02) installed
>         DLM 2.6.9-34.0 (built Jun  2 2005 15:17:56) installed
>         Lock_Harness 2.6.9-35.5 (built Jun  7 2005 12:42:30) installed
>         GFS 2.6.9-35.5 (built Jun  7 2005 12:42:49) installed
>         aoe: aoe_init: AoE v2.6-11 initialised.
>         Lock_DLM (built Jun  7 2005 12:42:32) installed
>         ========end modules========
>         
>         
>         
>         -- 
>         Aurelien Lemaire (oly)
>         http://www.squiz.net
>         Sydney | Canberra | London
>         92 Jarrett St Leichhardt, Sydney, NSW 2040
>         T:+61 2 9568 6866 
>         F:+61 2 9568 6733    
> 
> --
> Linux-cluster mailing list
> Linux-cluster redhat com
> https://www.redhat.com/mailman/listinfo/linux-cluster


[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]