Stale mirrors and rsync

[Glen Barber]

Hi,

We (admins) have changed the way we monitor the mirror states to keep
track of staleness.  We still continue to use the TIMESTAMP files, but
since not all mirrors have a copy of all FTP data, it became tricky to
determine which TIMESTAMP file makes sense to keep track of.  Since all
mirrors have the releases/ directory, please make sure the
releases/TIMESTAMP file is readable.  We are using fetch(1) to grab the
file and compare the update time against the current time to determine
how many days a mirror is out of sync, but some mirrors do not have
a readable releases/TIMESTAMP file, so otherwise makes it impossible to
keep track of things.

Related, at present, there are 15 mirrors that are out of sync by
a significant number of days.  The list is below, for those that are
unaware that their respective mirror is out of sync.

Several weeks ago, it was pointed out that one of the mirrors was not
updating, and upon investigation it was determined that the mirror had
run out of space.

When syncing with ftp-master, please be sure to use the '-H' flag with
rsync.  This ensures that symlinks are copied as symlinks, and avoids
fetching multiple copies of the same file.  This appears to be happening
quite often, and not only is inefficient use of bandwidth for all
involved, but also significantly increases the overall sync time.

Currently, the total size of the entire pub/FreeBSD/ directory is:
 % du -hs .
 1.1T    .

Thank you, as always, for your continued support of FreeBSD.

Stale mirror list:

    ftp.kr.FreeBSD.org:  56 days stale 
    ftp.nz.FreeBSD.org:  12 days stale 
    ftp.ru.FreeBSD.org:  82 days stale 
    ftp.si.FreeBSD.org:  48 days stale 
    ftp.za.FreeBSD.org:  11 days stale 
    ftp1.FreeBSD.org:    48 days stale 
    ftp11.FreeBSD.org:   48 days stale 
    ftp2.FreeBSD.org:    48 days stale 
    ftp3.ca.FreeBSD.org: 17 days stale 
    ftp4.br.FreeBSD.org: 298 days stale 
    ftp4.ru.FreeBSD.org: 34 days stale 
    ftp6.de.FreeBSD.org: 1384 days stale 
    ftp6.us.FreeBSD.org: 48 days stale 
    ftp8.us.FreeBSD.org: 48 days stale 
    moss.cse.buffalo.edu 48 days stale 

Glen
On behalf of:	admins

-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 834 bytes
Desc: not available
URL: <http://lists.freebsd.org/pipermail/freebsd-hubs/attachments/20140331/a8856bbd/attachment.sig>