[Linux-cluster] Writing problems on a filesystem mounted from my NFS cluster

[Randy Brown]

I am using Centos 5 Cluster suite for an NFS cluster.  I am able to 
mount the filesystems exported by the cluster to other machines in our 
network.  The problem arises when I try to copy or move files to this 
file system as a non-root user.
Here is the result of trying to copy a file:

[clifford_rbrown]$cp top_snapshot_lx10 top_snapshot_lx10.orig
cp: cannot create top_snapshot_lx10.orig: Permission denied

Moving a file:
[clifford_rbrown]$mv users users.2
----------   1 rbrown     users            0 Dec 27 08:31 users.2
-rw-r--r--   1 root       sys            379 Apr 11  2007 users

The umask for this user is 022.  I believe I have the export configured 
correctly.  Here is the relevant entry from the /etc/exports file:
/fs/shared clifford(rw,no_root_squash)

permissions on the mount point are good:
drwxr-xr-x   7 root       sys             96 Dec 11 09:45 /mnt
drwxr-xr-x   9 root       root          3864 Dec 27 12:52 /mnt/shared
drwxr-xr-x  143 root       root          2048 Oct 23 07:07 /mnt/shared/home
drwxrwxr-x  65 rbrown     users         2048 Dec 27 09:48 
/mnt/shared/home/rbrown

The permissions on the cluster node for that filesystem look good:
[root at nfs1-cluster log]# ls -ld /fs /fs/shared
drwxr-xr-x 18 root root 1024 Dec 26 12:24 /fs
drwxr-xr-x  9 root root 3864 Dec 27 16:02 /fs/shared

Maybe my configuration of the exports is wrong?

Thanks in advance for any help or suggestions.

Randy

cluster.conf:
<?xml version="1.0"?>
<cluster alias="ohd_cluster" config_version="140" name="ohd_cluster">
        <fence_daemon post_fail_delay="0" post_join_delay="60"/>
        <clusternodes>
                <clusternode name="nfs1-cluster.nws.noaa.gov" nodeid="1" 
votes="1">
                        <fence>
                                <method name="1">
                                        <device name="nfspower" port="8" 
switch="1"/>
                                </method>
                        </fence>
                </clusternode>
                <clusternode name="nfs2-cluster.nws.noaa.gov" nodeid="2" 
votes="1">
                        <fence>
                                <method name="1">
                                        <device name="nfspower" port="7" 
switch="1"/>
                                </method>
                        </fence>
                </clusternode>
        </clusternodes>
        <cman expected_votes="1" two_node="1"/>
        <rm>
                <failoverdomains>
                        <failoverdomain name="nfs-failover" ordered="0" 
restricted="1">
                                <failoverdomainnode 
name="nfs1-cluster.nws.noaa.gov" priority="1"/>
                                <failoverdomainnode 
name="nfs2-cluster.nws.noaa.gov" priority="1"/>
                        </failoverdomain>
                </failoverdomains>
                <resources>
                        <ip address="140.90.91.244" monitor_link="1"/>
                        <clusterfs 
device="/dev/VolGroupFS/LogVol-shared" force_unmount="0" fsid="30647" 
fstype="gfs" mountpoint="/fs/shared" name="fs-shared" options="acl"/>
                        <nfsexport name="fs-shared-exp"/>
                        <nfsclient name="fs-shared-client" 
options="no_root_squash,rw" path="/fs/shared" target="140.90.91.0/24"/>
                        <clusterfs 
device="/dev/VolGroupTemp/LogVol-rfcdata" force_unmount="0" fsid="54233" 
fstype="gfs" mountpoint="/rfcdata" name="rfcdata" options="acl"/>
                        <nfsexport name="rfcdata-exp"/>
                        <nfsclient name="rfcdata-client" 
options="no_root_squash,rw" path="/rfcdata" target="140.90.91.0/24"/>
                        <ip address="140.90.91.245" monitor_link="1"/>
                        <clusterfs 
device="/dev/VolGroupFS/LogVol-brianj" force_unmount="0" fsid="39025" 
fstype="gfs" mountpoint="/fs/rfcdata" name="fs-rfcdata" options="acl"/>
                        <nfsexport name="fs-rfcdata-exp"/>
                        <nfsclient name="fs-rfcdata-client" 
options="no_root_squash,rw" path="/fs/rfcdata" target="140.90.91.0/24"/>
                </resources>
                <service autostart="1" domain="nfs-failover" name="nfs">
                        <clusterfs ref="fs-shared">
                                <nfsexport ref="fs-shared-exp">
                                        <nfsclient ref="fs-shared-client"/>
                                </nfsexport>
                        </clusterfs>
                        <ip ref="140.90.91.244"/>
                        <clusterfs ref="rfcdata">
                                <nfsexport ref="rfcdata-exp">
                                        <nfsclient ref="rfcdata-client"/>
                                </nfsexport>
                                <ip ref="140.90.91.245"/>
                        </clusterfs>
                        <clusterfs ref="fs-rfcdata">
                                <nfsexport ref="fs-rfcdata-exp">
                                        <nfsclient ref="fs-rfcdata-client"/>
                                </nfsexport>
                                <ip ref="140.90.91.244"/>
                        </clusterfs>
                </service>
        </rm>
        <fencedevices>
                <fencedevice agent="fence_apc" ipaddr="192.168.42.30" 
login="rbrown" name="nfspower" passwd="removed"/>
        </fencedevices>
</cluster>

-------------- next part --------------
A non-text attachment was scrubbed...
Name: randy_brown.vcf
Type: text/x-vcard
Size: 313 bytes
Desc: not available
URL: <http://listman.redhat.com/archives/linux-cluster/attachments/20071231/081f1253/attachment.vcf>