Panic in ffs_valloc (Was: Unexpected SU+J inconsistency AGAIN -- please, don't shift topic to ZFS!)

[Lev Serebryakov]

Hello, Lev.
You wrote 28 февраля 2013 г., 14:13:23:

LS>>>  My server runs 9.1-STABLE and have 8Tb UFS2 SU+J FS.
LS>>>  It crashed a several minutes ago (I don't know reason yet) and fsck
LS>>> says "Unexpected SU+J inconsistency" (Inode mode/directory tyme
LS>>> mismatch) and requested full check (which will take more than hour on
LS>>> such FS).
LS>>  Full fsck found "INTERNAL ERROR: DUPS WITH SOFTUPDATES" and keeps running...
LS>   full fsck reconnected about 1000 files, which was written in time of
LS>  crash.
LS>   Really, sever crashed when SVN mirror seed was been unpacking on
LS>  this FS, so there was massive file creation at this time.
  Ok,  I've checked memory, and now I have booted system with crashlog
  (!)

Here it is (please note, that panic() was called by ffs_valloc):

#0  doadump (textdump=<value optimized out>) at pcpu.h:229
229     pcpu.h: No such file or directory.
        in pcpu.h
(kgdb) #0  doadump (textdump=<value optimized out>) at pcpu.h:229
#1  0xffffffff80431494 in kern_reboot (howto=260)
    at /usr/src/sys/kern/kern_shutdown.c:448
#2  0xffffffff80431997 in panic (fmt=0x1 <Address 0x1 out of bounds>)
    at /usr/src/sys/kern/kern_shutdown.c:636
#3  0xffffffff80573d8c in ffs_valloc (pvp=0xfffffe0024d68000, mode=33204,
    cred=0xfffffe0023d52700, vpp=0xffffff81c35586b8)
    at /usr/src/sys/ufs/ffs/ffs_alloc.c:995
#4  0xffffffff805aa126 in ufs_makeinode (mode=33204, dvp=0xfffffe0024d68000,
    vpp=0xffffff81c3558a10, cnp=0xffffff81c3558a38)
    at /usr/src/sys/ufs/ufs/ufs_vnops.c:2614
#5  0xffffffff80634391 in VOP_CREATE_APV (vop=<value optimized out>,
    a=0xffffff81c3558920) at vnode_if.c:252
#6  0xffffffff804d389a in vn_open_cred (ndp=0xffffff81c35589d0,
    flagp=0xffffff81c35589cc, cmode=<value optimized out>,
    vn_open_flags=<value optimized out>, cred=0xfffffe0023d52700,
    fp=0xfffffe00ae9cf370) at vnode_if.h:109
#7  0xffffffff804cc0d9 in kern_openat (td=0xfffffe012d095000, fd=-100,
    path=0x801c951e0 <Address 0x801c951e0 out of bounds>,
    pathseg=UIO_USERSPACE, flags=2562, mode=<value optimized out>)
    at /usr/src/sys/kern/vfs_syscalls.c:1132
#8  0xffffffff805f1400 in amd64_syscall (td=0xfffffe012d095000, traced=0)
    at subr_syscall.c:135
#9  0xffffffff805dbfc7 in Xfast_syscall ()
    at /usr/src/sys/amd64/amd64/exception.S:387
#10 0x000000080177ce5c in ?? ()
Previous frame inner to this frame (corrupt stack?)
(kgdb)

  Full textdump: http://lev.serebryakov.spb.ru/crashes/core-ffs-crash.txt.1

  Please note, that FS was loaded by torrent client (40Mbit/s outbound
  traffic) and unpacking of svnmirror-base-r238500.tar.xz from this FS
  to itself. So, it was really high multistream load.

  I'll try to reproduce this on SINGLE disk, without geom_radi5 :)

-- 
// Black Lion AKA Lev Serebryakov <lev at FreeBSD.org>