slow tar performance on fbsd5
Tulio Guimarães da Silva
tuliogs at pgt.mpt.gov.br
Wed Aug 24 18:31:45 GMT 2005
I must be working too much... I can´t see where I took the DDS-thing
from... O_o Sorry, now I see it´s a disk-only operation. >X(
Anyway, you could try the dd thing; something like
# dd if=mysql-m.tgz | tar -zxvf -
and see if it makes any diference.
There was a relatively new thread in April/May dealing with poor
read/write results on 5.x branch.. the primary "target" was RAID, but
maybe there´s a bunch of possible tuneups that may be applied to IDE and
SCSI disks. Have you tried´em?
Sorry again for the blatant misunderstanding.
Tulio G. Silva
Tulio Guimarães da Silva wrote:
> Hi,
> I´ve got the same kind of problem, not only with DDS-[234] tapes, but
> also with "all-powerful-with-bells-and-whistles" AIT-3 units, with
> controllers ranging from Adaptec stock 2940 to PCI-X Ultra-320...
> almost same results.
> The problems seems to lie in tar itself; I read there´s something to
> do with block sizes, but using -b with larger values got me not much
> more than corrupt or incomplete data. :( The only way I got to have
> decent transfer rates AND reliability was to filter *archiving*
> through dd, including block sizes. For example, to archive:
>
> # tar -zcpf - /usr/local | dd of=/dev/sa0 bs=64k
>
> and to restore:
> # tar -b 128 -zxvf /dev/sa0
>
> The above is particullarly true for remote transfers; if you´re using
> tar over rsh/rmt (-f host:/path), you´ll surely prefer simple
> "rsh/tar" with output redirection. ;)
> Note that block sizes in tar count as 512-byte ones, while in dd they
> can be specified as Kilobytes or even megabytes. Besides speed,
> there´s a sensible boost on storage space when using dd-block-sized
> transfers. The apparent reason for that is tar actually uses -b 20
> (10kb) blocks, while 10GB+ tapes usually expect larger sizes.
> For AIT-3, I didn´t notice any real good improvement past 128kb block
> sizes; I didn´t experiment enough with DDS-4 because our test tape
> drive got a heart attack and quit... BTW, it returned 2 weeks ago and
> I didn´t give it any attention; it may be a little depressed by now,
> so I guess I´ll return it to test beds. :) Anyway, I wouldn´t try
> anything lower than 32kb blocks on it.
> I can´t remember if I did any test pointing to /dev/null, as mr.
> Hartland suggested, nor from /dev/zero or /dev/random... it´s worth a
> try.
> I´ll post new results as soon as I get´em (if any). ;)
> Have luck,
>
> Tulio G. da Silva
>
> Steven Hartland wrote:
>
>> Might be silly but do u get similar results if u:
>> 1. expand to a memory backed disk
>> 2. expand to /dev/null
>>
>> Steve
>> ----- Original Message ----- From: "JG" <jarek at adeon.lublin.pl>
>>
>>> I had to unpack a lot of tar archives and I occasional noticed terrible
>>> bad performance on freebsd5.
>>
>>
>------------------------------------------------------------------------
>
>_______________________________________________
>freebsd-performance at freebsd.org mailing list
>http://lists.freebsd.org/mailman/listinfo/freebsd-performance
>To unsubscribe, send any mail to "freebsd-performance-unsubscribe at freebsd.org"
>
More information about the freebsd-performance
mailing list