SLOW rsync from bit0.us-west

John Marshall john.marshall at riverwillow.com.au
Sat Jan 12 05:21:48 UTC 2013


I have been updating the gnats collection on our mirror via rsync since
the CVSup updates stopped but noticed this morning that the updates
appeared to be stalled. I killed off jobs that appeared to be stuck
downloading incremental file list (after about 20 minutes) but then
thought to run rsync manually with -vvv. What I saw then was short
bursts of messages like 'recv_file_name(bin/nnnn)' interspersed with
15-20 seconds of nothing. tcpdump showed just a handful of packets every
15 seconds or so. The update eventually finished after more than 2 hours.

I ran the rsync again after about 10 minutes with only a single -v and
included --stats in the command line. This time it took only 1 hour to
update 9 files and produced the following output.

ozsrv03# rsync -avz --stats bit0.us-west.freebsd.org::FreeBSD-bit/gnats/
/freebsd/current/gnats/gnats
This is bit0.us-west.FreeBSD.org.

receiving incremental file list
bin/
bin/175214
docs/
docs/175224
gnats-adm/
gnats-adm/current
gnats-adm/index
gnats-adm/locks/
kern/
kern/151564
kern/152250
kern/153361
ports/175221
ports/175222

Number of files: 174424
Number of files transferred: 9
Total file size: 1738253321 bytes
Total transferred file size: 33819340 bytes
Literal data: 70300 bytes
Matched data: 33749040 bytes
File list size: 1967813
File list generation time: 0.075 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 41303
Total bytes received: 1989084

sent 41303 bytes  received 1989084 bytes  612.76 bytes/sec
total size is 1738253321  speedup is 856.12

The network isn't any worse than usual. We have a 100Mbps connection and
latency across the Pacific Ocean from Australia is normal (~170ms RTT).

ozsrv03# ping -qc 3 bit0.us-west.FreeBSD.org.
PING bit0.ysv.FreeBSD.org (8.8.178.111): 56 data bytes

--- bit0.ysv.FreeBSD.org ping statistics ---
3 packets transmitted, 3 packets received, 0.0% packet loss
round-trip min/avg/max/stddev = 168.805/168.922/169.023/0.090 ms

Is it just me?

-- 
John Marshall

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 196 bytes
Desc: OpenPGP digital signature
URL: <http://lists.freebsd.org/pipermail/freebsd-hubs/attachments/20130112/9134299f/attachment.sig>


More information about the freebsd-hubs mailing list