slow tar performance on fbsd5

Tulio Guimarães da Silva tuliogs at pgt.mpt.gov.br
Wed Aug 24 17:58:50 GMT 2005


Hi,
  I´ve got the same kind of problem, not only with DDS-[234] tapes, but 
also with "all-powerful-with-bells-and-whistles" AIT-3 units, with 
controllers ranging from Adaptec stock 2940 to PCI-X Ultra-320... almost 
same results.
  The problems seems to lie in tar itself; I read there´s something to 
do with block sizes, but using -b with larger values got me not much 
more than corrupt or incomplete data. :( The only way I got to have 
decent transfer rates AND reliability was to filter *archiving* through 
dd, including block sizes. For example, to archive:

  # tar -zcpf - /usr/local | dd of=/dev/sa0 bs=64k

and to restore:
  # tar -b 128 -zxvf /dev/sa0

  The above is particullarly true for remote transfers; if you´re using 
tar over rsh/rmt (-f host:/path), you´ll surely prefer simple "rsh/tar" 
with output redirection. ;)
  Note that block sizes in tar count as 512-byte ones, while in dd they 
can be specified as Kilobytes or even megabytes. Besides speed, there´s 
a sensible boost on storage space when using dd-block-sized transfers. 
The apparent reason for that is tar actually uses -b 20 (10kb) blocks, 
while 10GB+ tapes usually expect larger sizes.
  For AIT-3, I didn´t notice any real good improvement past 128kb block 
sizes; I didn´t experiment enough with DDS-4 because our test tape drive 
got a heart attack and quit... BTW, it returned 2 weeks ago and I didn´t 
give it any attention; it may be a little depressed by now, so I guess 
I´ll return it to test beds. :) Anyway, I wouldn´t try anything lower 
than 32kb blocks on it.
  I can´t remember if I did any test pointing to /dev/null, as mr. 
Hartland suggested, nor from /dev/zero or /dev/random... it´s worth a try.
  I´ll post new results as soon as I get´em (if any). ;)
  Have luck,

Tulio G. da Silva

Steven Hartland wrote:

> Might be silly but do u get similar results if u:
> 1. expand to a memory backed disk
> 2. expand to /dev/null
>
>    Steve
> ----- Original Message ----- From: "JG" <jarek at adeon.lublin.pl>
>
>> I had to unpack a lot of tar archives and I occasional noticed terrible
>> bad performance on freebsd5.
>


More information about the freebsd-performance mailing list