[linux-lvm] Data deduplication in LVM?

[Les Mikesell]

Roy Sigurd Karlsbakk wrote:
>
>> Roy Sigurd Karlsbakk wrote:
>>> Hi all
>>> I've been reading up a little about data deduplication, and have been 
>>> in search for an OSS filesystem with dedup without much luck. While 
>>> testing snapshots and so on in LVM, I started wondering if dedup 
>>> would be better off in LVM than in the filesystem. Would it be 
>>> possible/efficient to add dedup to the LVM layer, or perhaps a layer 
>>> above LVM? This could make dedup work for all or most of filesystems. 
>>> Make a hash table with 4k (or whatever) blocks, make virtual blocks 
>>> pointing to the physical blocks and run a remapping/deduping job at 
>>> night. If written to, copy-on-write could be used to increase speed.
>>> Is this nonsense, or might it be an idea?
>>
>> This is "supposed" to be coming in the next OpenSolaris/ZFS release 
>> (per the roadmap with the just-released 2009.06 version).
> 
> 
> What about Linux/LVM? Or did I misunderstand you?

I thought the question was about OSS...  I wouldn't hold my breath 
waiting for a Linux/LVM version - and for that matter I'll believe the 
ZFS release when I see it, but at least it is being planned and could be 
less than a year away.

-- 
   Les Mikesell
    lesmikesell at gmail.com