kern/134011

[Thomas Backman]

On May 27, 2009, at 09:31 AM, Kip Macy wrote:

>>
>> I ran into this crash (I think*) yesterday too, albeit in a (amd64)  
>> VM with
>> 768MB RAM.
>> However, I had set arc_min="30M" and arc_max="100M" so I expected  
>> it to
>> work, but
>> it crashed within 10-15 minutes of make -j4 buildworld. I changed  
>> the values
>> to 5 and 30M,
>> and so far (~30 minutes) no crash. The sources were from late May  
>> 21st,
>> currently building
>> rev. 192805 (since 192808 broke the build, at least on the  
>> tinderbox).
>>
>> * "I think" because I went to check on it it the middle of the  
>> night, saw a
>> page fault in kernel mode
>> or whatever, and figured "damnit... well, I'll suspend the VM, turn  
>> the
>> laptop off and check in the morning".
>> I hit shutdown instead, so no backtrace or anything. D'oh!
>>
>
>
> Can you try not setting the ARC?
> I haven't had any problems on my comparably sized VMs.
>
> -Kip

OK, I tried it, since it crashed even with my low ARC settings. With  
*no* ARC settings, I get this:

cc -O2 -pipe -I. -DIN_GCC -DHAVE_CONFIG_H -DPREFIX=\"/usr\" -I/usr/obj/ 
usr/src/gnu/usr.bin/cc/cc_tools/../cc_tools -I/usr/src/gnu/usr.bin/cc/ 
cc_tools/../cc_tools -I/usr/src/gnu/usr.bin/cc/cc_tools/../../../../ 
contrib/gcc -I/usr/src/gnu/usr.bin/cc/cc_tools/../../../../contrib/gcc/ 
config -I/usr/src/gnu/usr.bin/cc/cc_tools/../../../../contrib/gcclibs/ 
include -I/usr/src/gnu/usr.bin/cc/cc_tools/../../../../contrib/gcclibs/ 
libcpp/include -I/usr/src/gnu/usr.bin/cc/cc_tools/../../../../contrib/ 
gcclibs/libdecnumber -g -DGENERATOR_FILE -DHAVE_CONFIG_H   -I/usr/obj/ 
usr/src/tmp/legacy/usr/include -c /usr/src/gnu/usr.bin/cc/ 
cc_tools/../../../../contrib/gcc/genattr.c
cc -O2 -pipe -I. -DIN_GCC -DHAVE_CONFIG_H -DPREFIX=\"/usr\" -I/usr/obj/ 
usr/src/gnu/usr.bin/cc/cc_tools/../cc_tools -I/usr/src/gnu/usr.bin/cc/ 
cc_tools/../cc_tools -I/usr/src/gnu/usr.bin/cc/cc_tools/../../../../ 
contrib/gcc -I/usr/src/gnu/usr.bin/cc/cc_tools/../../../../contrib/gcc/ 
config -I/usr/src/gnu/usr.bin/cc/cc_tools/../../../../contrib/gcclibs/ 
include -I/usr/src/gnu/usr.bin/cc/cc_tools/../../../../contrib/gcclibs/ 
libcpp/include -I/usr/src/gnu/usr.bin/cc/cc_tools/../../../../contrib/ 
gcclibs/libdecnumber -g -DGENERATOR_FILE -DHAVE_CONFIG_H   -I/usr/obj/ 
usr/src/tmp/legacy/usr/include -c /usr/src/gnu/usr.bin/cc/ 
cc_tools/../../../../contrib/gcc/genautomata.c
*** drop to debugger here ***

---------------

# while :; do date; vmstat -m | grep -E 'Type|solaris'; sysctl  
kstat.zfs.misc.arcstats.size; sleep 10; done

[...]

Wed May 27 11:33:43 CEST 2009
          Type InUse MemUse HighUse Requests  Size(s)
       solaris 44183 109686K       -  9175781   
16,32,64,128,256,512,1024,2048,4096
kstat.zfs.misc.arcstats.size: 159089184
Wed May 27 11:33:53 CEST 2009
          Type InUse MemUse HighUse Requests  Size(s)
       solaris 37633 108437K       -  9536555   
16,32,64,128,256,512,1024,2048,4096
kstat.zfs.misc.arcstats.size: 158529024
Wed May 27 11:34:03 CEST 2009
          Type InUse MemUse HighUse Requests  Size(s)
       solaris 42848 109370K       -  9849348   
16,32,64,128,256,512,1024,2048,4096
kstat.zfs.misc.arcstats.size: 159689152
Wed May 27 11:34:13 CEST 2009
          Type InUse MemUse HighUse Requests  Size(s)
       solaris 39751 108868K       - 10195297   
16,32,64,128,256,512,1024,2048,4096
kstat.zfs.misc.arcstats.size: 162581952
*** drop to debugger here ***

Panic screenshots (I still couldn't get it to dump properly - 640MB  
RAM, 768MB swap, but it complains about the swap being too small):
Panic: http://imgur.com/chKEx.png
Backtrace: http://imgur.com/iXUFF.png

It runs buildworld for about 2-5 minutes before this happens.