ZFS/compression/performance

[David Brodbeck]

On Wed, Oct 12, 2011 at 5:02 AM, Johannes Totz <jtotz at imperial.ac.uk> wrote:

> I just did a simple write test yesterday:
>
> 1) 6 MB/sec for gzip, 1.36x ratio
> 2) 34 MB/sec for lzjb, 1.23x ratio
>
> I'll stick with lzjb. It's good enough to get rid of most of the
> redundancy and speed is acceptable.
>

That's what we use on our text-heavy filesystems on our OpenSolaris server.
 (We work with large text corpora, so we have hundreds of gigabytes of pure
text.)  My benchmarks showed the performance hit for reads is nonexistent
when viewed over NFS, and the performance hit for writes is relatively
small...plus we don't write to that filesystem much.  We see about 1.5x
compression overall, with a little over 2x on some datasets that are
particularly compressible.

-- 
David Brodbeck
System Administrator, Linguistics
University of Washington