It's time to turn off your cvsup mirrors.

Peter Wemm peter at wemm.org
Mon Sep 29 07:10:00 UTC 2014


It is time to turn off the remaining cvsup mirrors.

For the record, here's the timeline overview of how we got here:

Beginning of FreeBSD: cvs based. Used "sup(1)" to replicate, or CTM for batch 
processing though email.  The CVS repository was CLOSED and *private* to 
committers-only.  Non-committers could essentially only get src with releases.

1995-ish: John Polstra wrote cvsup to efficiently distribute the CVS tree.  This 
provided incentive for the FreeBSD project to clean up our tainted CVS 
repository and open it to the world.  CVSup essentially replaced CTM. (*1)

1995-1996: Extensive fan-out based cvsup distribution mechanism created by 
volunteers.

1996: rsync invented, cvsup grew rsync capabilities for repairs.  (Had rsync 
existed a few years earlier, cvsup might never have existed)

[Good times and many bikesheds later..]

2008: src tree switched from cvs to svn. Since then, doc, www ports have also 
switched.  A temporary transition aide was written to export the svn tree into 
cvs, both as a fallback and to leverage the cvsup mirror network.

2008-2012: svn to cvs exporters ran, but were fragile.  They required frequent 
repairs. They were written in python to a deprecated svn api.  Considerable 
fear in updating the back-end svn servers resulted.

2012: (August) svn to cvs exporters began deprecation cycle including an EOL 
(end of 9.0, 8.3 and 7.4 support). https://wiki.freebsd.org/CvsIsDeprecated

2012: (September) security incident tainted exported cvs tree with no effective 
means to audit.  Since they had been announced as deprecated, we decided that 
a top-of-branch review would have to do.  The machine that ran the exporters 
was compromised.

2012: (October) a quick and dirty replacement svn to cvs exporter was hacked 
together.  It no longer maintained 1:1 equivalence with svn.

2013: (Feb 28th) ports ceases being exported from svn to cvs entirely at EOL 
of 7.4. (ports had an explicit separate EOL schedule for this)

2014: (Feb 4th) An undiscovered maintenance error caused cvsup to completely 
stop being updated (some key files were owned by root, preventing updates by 
the normal non-privileged mirror user)

2014: (April 30) 8.3 EOL reached (the final milestone for cvsup EOL)

2014: (May 24) mirror switch from cvsup to native rsync announced.
    https://lists.freebsd.org/pipermail/freebsd-hubs/2014-May/002737.html

2014: (May 26) Problem from feb 4th discovered.  On realizing that nobody had 
even noticed that cvsup was broken, the decision was made to shut down the 
exporter and cease entirely on May 31st.
    https://lists.freebsd.org/pipermail/freebsd-hubs/2014-May/002739.html

2014: (May 31) shutdown deadline reached.  Contents were purged and archived 
on ftp.freebsd.org in /pub/FreeBSD/development/CVS-archive

2014: since then: server has been handing out an empty repository.

A quick glance at the last 23 hours of logs shows the same mirrors are still 
reliably connecting to cvsup-master as before, mirroring nothing but that 
README file.

  70 root at p32195-ipadfx41marunouchi.tokyo.ocn.ne.jp <kuriyama at freebsd.org>
  24 root at radiogaga2.corbina.net <cvsup at corbina.net>
  24 root at backups.absolight.net <mat at FreeBSD.org>
  23 root at raines.cse.buffalo.edu <root at cvsup5.FreeBSD.org>
  23 root at office.oberon.net <cvsup at cvsup8.de.FreeBSD.org>
  23 root at ncvsup.twc.weather.com <mperrin at weather.com>
  23 root at moss.cse.buffalo.edu <cvsup at cvsup-spare.FreeBSD.org>
  23 root at mirror.dk.freebsd.org <fj at batmule.dk>
  23 root at logan.cse.buffalo.edu <cvsupin at cvsup18.FreeBSD.org>
  23 root at jbell.maths.tcd.ie <dwmalone at freebsd.org>
  23 root at freebsd.twaren.net <tjs at cvsup3.tw.freebsd.org>
  23 root at cvsup.ludd.ltu.se <adm at ludd.luth.se>
  23 root at coupland.heanet.ie <cvsup at cvsup2.ie.FreeBSD.org>
  23 root at akane.desync.com <cvsup at desync.com>
  12 root at regency.nsu.ru <fjoe at iclub.nsu.ru>
   3 root at daniel.thekeelecentre.com <cvsup at thekeelecentre.com>
   1 root at gate.rabson.org <dfr at freebsd.org>
   1 root at florida.sarang.net <holywar at mail.holywar.net>

I will be attempting to contact people.  If you have better contacts for these 
people than I have above, please forward this notice accordingly.

If you are a hostmaster for a CC.freebsd.org zone, please use your contact 
information for your surviving cvsupN.CC.freebsd.org and reach out to them and 
forward this notice.  You should be aiming to have the dns names removed. 

I am removing the cvsup-master dns name today and begin the process of 
archiving and recycling the servers.

It had an outstanding run.  Goodbye old friend, Long live CVSup!

Footnotes:
*1: CTM is still running.  How ironic!
-- 
Peter Wemm - peter at wemm.org; peter at FreeBSD.org; peter at yahoo-inc.com; KI6FJV
UTF-8: for when a ' or ... just won\342\200\231t do\342\200\246
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 473 bytes
Desc: This is a digitally signed message part.
URL: <http://lists.freebsd.org/pipermail/freebsd-hubs/attachments/20140929/6cb1efd3/attachment.sig>


More information about the freebsd-hubs mailing list