packages compressed with xz

[Ion-Mihai Tetcu]

On Fri, 03 Dec 2010 23:07:51 +0200
Volodymyr Kostyrko <c.kworr at gmail.com> wrote:

> 30.11.2010 04:40, Julien Laffaye wrote:
> > You can specify limits during compression, so the question is
> > should we do that so that hosts with N MB of RAM can decompress
> > packages?  Do we retain the compression ratio over bzip2 if we
> > limit compression memory to 512 MB so that decompression would be
> > possible with, say, 128 MB?
> >
> > According to xz(1), in its default mode (-6), xz uses ~100MiB for
> > compression and ~10MiB for decompression.
> > That seems to be acceptable.
> 
> You possibly miss something about compression/decompression.
> 
> The designated memory size is not directly affected only by
> compression mode. When decompressing you will need memory for:
> 
> 1. Data history.
> 2. Dictionary.
> 3. Some indexes.
> 
> And those ones are all empty at start. So say, if you are compressing 
> something really huge trying to use 4G of memory you end using that
> much memory between 2G - 3G of source data. And we will need 512MB to 
> decompress that hunk of data.
> 
> Are the packages _that_ large?
 [ .. ]

The biggest package that can be produced by a port it's a bit over 10G.

-- 
IOnut - Un^d^dregistered ;) FreeBSD "user"
  "Intellectual Property" is   nowhere near as valuable   as "Intellect"
FreeBSD committer -> itetcu at FreeBSD.org, PGP Key ID 057E9F8B493A297B
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 196 bytes
Desc: not available
Url : http://lists.freebsd.org/pipermail/freebsd-ports/attachments/20101205/73389242/signature.pgp