comments on newfs raw disk ? Safe ? (7 terabyte array)

Oliver Fromme olli at lurza.secnetix.de
Fri Feb 9 17:01:53 UTC 2007


Arone Silimantia wrote:
 > Big 3ware sata raid with 16 disks.  First two disks are a mirror to 
 > boot off of.  I installed the system with sysinstall and created all the 
 > partitions on the boot mirror, etc., and just didn't even touch the 
 > 14-disk array that was also created.
 > [...]
 > newfs -m 0 /dev/da1

You didn't mention the size of the FS, but I guess it's at
least 4 TB, probably more.

You'll probably want to reduce the inode density (i.e.
increase the bytes-per-inode ratio).  With the default
value, an fsck will be a royal pain, no matter whether you
use background fsck (with snapshots) or not.  It might even
not work at all if you don't have a huge amount of RAM.

If you increase the ratio to 64 K, it will lower the fsck
time and RAM requirement by an order of magnitude, while
there are still about 15 million inodes available per TB.
If possible, increase the ratio (-i option) further.  It
depends on the expected average file size and the maximum
number of files that you intend to store on the FS, of
course.

Depending on your application, it might also make sense to
_carefully_ (!) adjust the fragment and block sizes of the
FS (-f and -b options to newfs).  However, note that non-
standard values are not widely used and might expose bugs,
especially on large file systems.  If you change them, you
should at least perform some extensive stress testing.

Another thing that should be mentioned is the fact that
"-m 0" will result in two things:  First, it will make the
FS slower, especially when its getting full, then it will
be _much_ slower.  Second, it increases fragmentation.

I recommend you don't use the -m option at leave it at the
default.  Yes, that means that a whole lot of GB will not
be available to users (non-root), but for that price you'll
get a fast file system.  Also note that you can change
that option at a later date with tunefs(8), so if you
decide that you _really_ need that extra space, and speed
is not an issue at all, then you can change the -m value
any time.

Just my two cents.

Oh by the way, I also agree with Eric that you should have
a look at gjournal.  It pratically removes the fsck issues.
At the moment it's only in -current, but I think Pawel
provided a port for 6.x.

Best regards
   Oliver

-- 
Oliver Fromme, secnetix GmbH & Co. KG, Marktplatz 29, 85567 Grafing b. M.
Handelsregister: Registergericht Muenchen, HRA 74606, USt-Id: DE204219783
Any opinions expressed in this message are personal to the author and may
not necessarily reflect the opinions of secnetix GmbH & Co KG in any way.
FreeBSD-Dienstleistungen, -Produkte und mehr:  http://www.secnetix.de/bsd

One Unix to rule them all, One Resolver to find them,
One IP to bring them all and in the zone to bind them.


More information about the freebsd-fs mailing list