Re: [rhelv5-list] Near Real-Time RSYNC with NFS

[Brian Long <brilong cisco com>]

I wonder if incron would help.  You could use inotify events on your
filesystem to trigger an rsync of specific files which were recently
created or written.

http://www.howtoforge.com/triggering-commands-on-file-or-directory-changes-with-incron

/Brian/


On 7/1/11 11:47 AM, Musayev, Ilya wrote:
> Thanks Tony, i will put Unison on my "try out list" :).
> 
> Really curious how it will perform in comparison to rsync.
> 
> Regards
> ilya
> ________________________________________
> From: rhelv5-list-bounces redhat com [rhelv5-list-bounces redhat com] On Behalf Of Procaccini, Tony J. [tjp techma com]
> Sent: Friday, July 01, 2011 11:26 AM
> To: 'rhelv5-list redhat com'
> Subject: Re: [rhelv5-list] Near Real-Time RSYNC with NFS
> 
> Try Unison via epel, it reads archive/changelog files for modifications, works over nfs/ssh and use rsync algorithm if you want.
> 
> Tony
> 
> On Fri, Jul 1, 2011 at 10:33 AM, Musayev, Ilya <imusayev webmd net> wrote:
> 
>>  Its been a while since I posted here J****
>>
>> ** **
>>
>> I have an interesting problem where I need to rsync an nfs mount to another
>> server in a different datacenter continuously with least time lapse
>> possible. Needless to say, NFS server is an appliance that currently has
>> issues with replication and I have no root access (i.e. EMC Cellera). The
>> share contains 20 million files ? so you can imagine rsync will take a bit
>> of time to analyze and build a file list ? it took 8 hours previously + 24
>> hours on actual sync.****
>>
>> ** **
>>
>> My goal is to speed up the transfers going forward on changed files. Setup
>> is as follows:****
>>
>> ** **
>>
>> Source: host1:/nfs_mount****
>>
>> Destination: host2:/nfs_mount****
>>
>> ** **
>>
>> Possible solutions I?ve seen thus far was rsync and inotify. Rsync is
>> tricky thing when you have 20m files and analyzing all files that have
>> changed via cron, is not what I think is ideal solution. Inotify ? I have
>> not yet tried, but it sounds like it only supports local file systems
>> (ext3+), though I do see some posts that it may support nfs v4 mounts. ***
>> *
>>
>> ** **
>>
>> What would you recommend to keep the 2 shares in sync with least time lapse
>> (open source realm)? Has anyone had success with inotify on nfs share?****
>>
>> ** **
>>
>> Looking forward to your comments,****
>>
>> ** **
>>
>> Thanks****
>>
>> -ilya****
>>
>> ** **
>>
>> _______________________________________________
>> rhelv5-list mailing list
>> rhelv5-list redhat com
>> https://www.redhat.com/mailman/listinfo/rhelv5-list
>>
>>
> 
> _______________________________________________
> rhelv5-list mailing list
> rhelv5-list redhat com
> https://www.redhat.com/mailman/listinfo/rhelv5-list
> 
> 
> 
> _______________________________________________
> rhelv5-list mailing list
> rhelv5-list redhat com
> https://www.redhat.com/mailman/listinfo/rhelv5-list


-- 
       Brian Long                             |       |
       Corporate Security Programs Org    . | | | . | | | .
                                              '       '
                                              C I S C O