[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]

[Cluster-devel] Re: [NFS] [PATCH 2/5] NLM failover - per fs grace period

There were few replies emails that didn't arrive at nfs list last week but got archived in:

* why switching to fsid

* cluster script failover sequence)

To help people understand the patch logic, the following is a sample failover flow:

Assume we have server_A and server_B. Server_A is a multi-home NFS server with two ip address and where:

shell> cat /etc/exports
/mnt/ext3/exports    *(fsid=1234,sync,rw)
/mnt/gfs1/exports    *(fsid=1236,sync,rw)

It is expected ext3 filesystem served by and gfs served by If we ever want to move ext3 over to server_B, the sequence would be:

On server_A:
1. Tear down
2. Un-export ext3 exports
3. echo 1234 > /proc/fs/nfsd/nlm_unlock
4. Umount ext3

On sever_B:
1. Mount ext3 fs
2. echo 1234 > /proc/fs/nfsd/nlm_set_igrace
3. Export ext3 exports
4. Bring up
5. Sending restricted reclaim notifications via

Step 5 is implemented based on the ha-callout program as described in "man rpc.statd". What our cluster suite (user mode script) will do (if this patch set gets accepted) is to bring up rpc.statd on both servers with ha-callout program. On server_A, the ha-callout program constructs two sm directories (sm- and sm- that can be accessed by both servers. This is normally done by placing the directories on the filesystem that will get moved over. The original /var/lib/nfs/statd/sm stays in its default place in case of server_A ends up with a real reboot (or crash). When server_B takes over, it sends out an one-time notice to all the clients that has entries in sm- directory.

Note that the code of ha-callout program (will be done by our cluster suite) actually can be integrated into statd within nfs-utils package. However, I would like to keep the changes made into mainline nfs code as miminum as possible at this moment.

-- Wendy

[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]