jumbo frames + geom_mirror = no net
rozhuk.im at gmail.com
rozhuk.im at gmail.com
Tue Feb 8 20:50:58 UTC 2011
Hi!
I have 8.2 + latest updates, em + gigabit net, few HDDs in mirror.
Samba for share HDDs to win hosts.
(E5300, G33 + ICH9R, 2GB, PCI-E intel desktop GB adapter)
ifconfig_em0="inet 172.16.0.254 netmask 255.255.255.0 mtu 9000"
Then I start copy files to mirror (trough net or using cp from others HDD on
host)
after some time host stop respond to net, no errors messages in logs.
(top show free mem < 10mb just before it happen)
(It started after first mirror was created)
And don’t respond until reboot or: ifconfig em0 mtu 1500 (from console)
Vmstat show my failures for mbuf_jumbo_9k:
mbuf_jumbo_9k: 9216, 6400, 0, 0, 36202768,
8472897
but no failures for simple 1,5k mbuf's :/
vmstat -z
ITEM SIZE LIMIT USED FREE REQUESTS
FAILURES
UMA Kegs: 128, 0, 97, 23, 97,
0
UMA Zones: 888, 0, 97, 3, 97,
0
UMA Slabs: 284, 0, 1068, 514, 90680,
0
UMA RCntSlabs: 544, 0, 2649, 529, 13469257,
0
UMA Hash: 128, 0, 1, 29, 4,
0
16 Bucket: 76, 0, 12, 88, 122,
0
32 Bucket: 140, 0, 16, 96, 308,
0
64 Bucket: 268, 0, 43, 69, 561,
13
128 Bucket: 524, 0, 323, 6, 599692,
5140
VM OBJECT: 136, 0, 19972, 36317, 1260502,
0
MAP: 136, 0, 7, 22, 7,
0
KMAP ENTRY: 72, 57505, 2188, 2423, 4613615,
0
MAP ENTRY: 72, 0, 2418, 762, 4043456,
0
DP fakepg: 72, 0, 0, 0, 0,
0
SG fakepg: 72, 0, 0, 0, 0,
0
mt_zone: 2056, 0, 175, 237, 175,
0
16: 16, 0, 4239, 836, 16310509,
0
32: 32, 0, 2514, 1780, 124403442,
0
64: 64, 0, 5044, 3334, 402804800,
0
128: 128, 0, 792, 1428, 7002330,
0
256: 256, 0, 592, 593, 1093975,
0
512: 512, 0, 165, 1035, 671161,
0
1024: 1024, 0, 55, 181, 882578,
0
2048: 2048, 0, 150, 250, 73957,
0
4096: 4096, 0, 132, 243, 734964,
0
Files: 56, 0, 5737, 628, 8850040,
0
TURNSTILE: 72, 0, 416, 64, 451,
0
umtx pi: 52, 0, 0, 0, 0,
0
PROC: 680, 0, 81, 171, 38814,
0
THREAD: 720, 0, 277, 138, 11326,
0
SLEEPQUEUE: 44, 0, 416, 115, 451,
0
VMSPACE: 228, 0, 57, 164, 31952,
0
cpuset: 40, 0, 2, 182, 2,
0
mbuf_packet: 256, 0, 4100, 609, 76165127,
0
mbuf: 256, 0, 175, 1206, 398211372,
0
mbuf_cluster: 2048, 65536, 4845, 453, 30848491,
0
mbuf_jumbo_page: 4096, 12800, 0, 0, 0,
0
mbuf_jumbo_9k: 9216, 6400, 0, 0, 36202768,
8472897
mbuf_jumbo_16k: 16384, 3200, 0, 0, 0,
0
mbuf_ext_refcnt: 4, 0, 4, 402, 25681942,
0
ttyoutq: 256, 0, 64, 41, 136,
0
g_bio: 140, 0, 0, 1568, 205564803,
0
ttyinq: 152, 0, 120, 62, 255,
0
ata_request: 208, 0, 0, 304, 67886293,
0
ata_composite: 180, 0, 0, 0, 0,
0
VNODE: 268, 0, 19632, 27674, 5052284,
0
VNODEPOLL: 60, 0, 16, 173, 21,
0
S VFS Cache: 72, 0, 12259, 51977, 1280216,
0
L VFS Cache: 292, 0, 2976, 729, 70042,
0
NAMEI: 1024, 0, 0, 260, 153323563,
0
DIRHASH: 1024, 0, 57, 343, 57340,
0
AIO: 120, 0, 3, 93, 19,
0
AIOP: 16, 0, 4, 402, 44,
0
AIOCB: 292, 0, 0, 390, 6897050,
0
AIOL: 64, 0, 0, 0, 0,
0
AIOLIO: 168, 0, 0, 0, 0,
0
pipe: 392, 0, 50, 170, 25245,
0
ksiginfo: 80, 0, 244, 332, 509687,
0
itimer: 220, 0, 1, 53, 15,
0
KNOTE: 72, 0, 1901, 643, 153128799,
0
socket: 412, 204804, 1936, 755, 4049131,
0
ipq: 32, 2147, 0, 0, 0,
0
udp_inpcb: 220, 204804, 18, 306, 105359,
0
udpcb: 8, 204827, 18, 388, 105359,
0
tcp_inpcb: 220, 204804, 1991, 943, 3034192,
0
tcpcb: 632, 204804, 1859, 829, 3034192,
0
tcptw: 52, 40968, 132, 588, 863691,
0
syncache: 112, 102410, 2, 383, 756808,
0
hostcache: 76, 15400, 577, 5623, 202354,
0
tcpreass: 20, 4225, 4, 503, 16547113,
0
sackhole: 20, 0, 2, 505, 816717,
0
ripcb: 220, 204804, 1, 35, 2,
0
unpcb: 172, 204815, 44, 324, 909334,
0
rtentry: 108, 0, 6, 102, 51,
0
selfd: 28, 0, 472, 417, 44350642,
0
SWAPMETA: 276, 121576, 0, 0, 0,
0
Mountpoints: 644, 0, 17, 19, 18,
0
FFS inode: 116, 0, 19560, 35385, 1771335,
0
FFS1 dinode: 128, 0, 0, 0, 0,
0
FFS2 dinode: 256, 0, 19560, 24255, 1771327,
0
md1: 512, 0, 121, 15, 121,
0
pfsrctrpl: 124, 10013, 0, 62, 6,
0
pfrulepl: 828, 0, 145, 347, 8368,
0
pfstatepl: 284, 16394, 5564, 1842, 4902363,
0
pfaltqpl: 224, 0, 0, 0, 0,
0
pfpooladdrpl: 68, 0, 26, 198, 1148,
0
pfrktable: 1240, 1002, 14, 46, 1086,
0
pfrkentry: 156, 200000, 46, 229, 4271,
0
pfrkentry2: 156, 0, 0, 0, 0,
0
pffrent: 16, 5075, 0, 406, 38707,
0
pffrag: 48, 0, 0, 312, 19255,
0
pffrcache: 48, 10062, 0, 0, 0,
0
pffrcent: 12, 50141, 0, 0, 0,
0
pfstatescrub: 28, 0, 56, 706, 99700,
0
pfiaddrpl: 100, 0, 73, 239, 2428,
0
pfospfen: 108, 0, 696, 240, 54288,
0
pfosfp: 28, 0, 407, 228, 31746,
0
NetGraph items: 36, 4130, 0, 354, 311914,
0
NetGraph data items: 36, 531, 0, 295, 217845511,
0
vmstat -m
Type InUse MemUse HighUse Requests Size(s)
session 38 3K - 8031 64
pgrp 44 3K - 8459 64
cred 218 21K - 6348824 64,128
uidinfo 8 2K - 645160 64,1024
plimit 19 5K - 68613 256
CAM SIM 10 2K - 10 128
sysctltmp 0 0K - 7474 16,32,64,128,2048
sysctloid 2712 83K - 2853 16,32,64
sysctl 0 0K - 2461365 16,32,64
callout 1 256K - 1
umtx 415 26K - 450 64
p1003.1b 1 1K - 1 16
CAM periph 14 2K - 30 16,32,128
bus-sc 52 47K - 1208
16,32,64,128,256,512,1024,2048,4096
bus 575 31K - 3448 16,32,64,128,1024
devstat 20 41K - 20 16,4096
eventhandler 75 4K - 75 32,64,128
CAM XPT 95 37K - 13819 16,32,64,1024,2048
kobj 84 168K - 176 2048
Per-cpu 1 1K - 1 16
isadev 10 1K - 10 64
gprof 1 90840K - 3
rman 162 10K - 572 16,32,64
entropy 1024 64K - 1024 64
sbuf 0 0K - 100620
16,32,64,128,256,512,1024,2048,4096
DEVFS1 90 23K - 134 256
DEVFS3 121 16K - 165 128,256
taskqueue 15 1K - 15 16,64
Unitno 12 1K - 22352 16,64
iov 0 0K - 20753624 16,64,128,256
select 232 15K - 232 64
ioctlops 0 0K - 1154325
16,32,64,128,256,512,1024,2048,4096
tty 23 12K - 30 512,1024
pts 6 1K - 11 128
accf 5 1K - 21 16,32
mbuf_tag 5 1K - 377663504 32,64
shmfd 1 4K - 1 4096
cdev 7 1K - 7 128
pcb 1344 152K - 2390492 16,32,512,1024
soname 29 3K - 9094379 16,32,128
acl 0 0K - 26680 4096
biobuf 1 2K - 4552 2048
vfscache 1 512K - 1
cl_savebuf 0 0K - 162042 32,64
vfs_hash 1 256K - 1
vnodes 4 1K - 4 32,128
vnodemarker 0 0K - 346290 512
mount 240 8K - 332 16,32,64,128,256
BPF 11 74K - 63 16,64,128,256,1024,4096
ether_multi 11 1K - 76 16,32,64
ifaddr 29 8K - 116 16,32,256,2048
ifnet 5 5K - 30 64,1024
clone 1 4K - 1 4096
arpcom 1 1K - 1 16
lltable 34 5K - 7502 128,256
DEVFS 7 1K - 8 16,64
sigio 3 1K - 5 32
filedesc 129 132K - 42677
16,32,64,128,256,512,1024,2048,4096
kenv 106 8K - 123 16,32,64,128,4096
kqueue 18 32K - 103730 32,128,256,1024,2048
DEVFSP 2 1K - 8 32
proc-args 51 3K - 45155 16,32,64,128,256
routetbl 54 10K - 44783 16,32,64,128,256
igmp 4 1K - 29 128
ipid 2 24K - 2
in_multi 4 1K - 36 128
hostcache 1 512K - 1
syncache 1 144K - 1
savedino 0 0K - 93850 256
newdirblk 0 0K - 112 32
dirrem 1 1K - 839105 32
mkdir 0 0K - 9352 32
diradd 2 1K - 165136 64
freefile 1 1K - 775184 32
freeblks 1 1K - 784281 256
freefrag 0 0K - 392940 32
allocindir 345 22K - 59161846 64
indirdep 3 1K - 87473 32
allocdirect 2 1K - 1367113 128
bmsafemap 5 1K - 109568 64
newblk 1 1K - 60528960 64,256
inodedep 6 257K - 881018 128
pagedep 4 65K - 27393 64
ufs_dirhash 114 57K - 46296 16,32,64,128,256,512
ufs_mount 24 422K - 27 256,2048,4096
UMAHash 3 5K - 8 256,512,1024,2048,4096
ithread 65 6K - 65 16,64,128
GEOM 260 37K - 4447 16,32,64,128,256,512,1024,4096
vm_pgdata 1 64K - 1
linker 196 611K - 538 16,32,64,128,256,1024,2048,4096
atkbddev 1 1K - 1 32
cpuctl 1 1K - 1 16
lockf 56 4K - 1001219 32,64
io_apic 1 1K - 1 1024
memdesc 1 4K - 1 4096
temp 31 592K - 2837830
16,32,64,128,256,512,1024,2048,4096
devbuf 1201 5184K - 1244
16,32,64,128,256,512,1024,2048,4096
module 142 9K - 142 64,128
LED 1 1K - 1 64
mtx_pool 2 8K - 2 4096
CAM dev queue 10 2K - 10 128
CAM queue 42 1K - 124 16
subproc 338 400K - 39116 256,4096
proc 2 8K - 2 4096
msi 3 1K - 3 64
nexusdev 4 1K - 4 16
mirror_data 6 2K - 288108 16,32,128,512
acpidev 83 3K - 83 32
acpica 2504 132K - 78527 16,32,64,128,256,512,1024
acpitask 1 1K - 1 1024
acpisem 15 2K - 15 64,128
apmdev 1 1K - 1 64
pci_link 16 2K - 16 64,128
md_sectors 3 12K - 3 4096
md_disk 5 5K - 5 16,2048
nullfs_node 13 1K - 3281277 16
nullfs_hash 1 1K - 1 64
nullfs_mount 8 1K - 8 16
netgraph_msg 0 0K - 99588 64,128,256,512,1024
netgraph_node 22 3K - 345 128
netgraph_hook 38 5K - 900 128
netgraph 8 9K - 142 32,64,256
netgraph_sock 7 1K - 101 64
netgraph_path 0 0K - 50601 16,32
netgraph_mppc 2 2K - 37 1024
netgraph_iface 2 1K - 27 64
netgraph_ppp 2 16K - 27
netgraph_pppoe 2 9K - 15 64,512
netgraph_l2tp 2 2K - 48 64,1024
netgraph_ksock 1 1K - 22 64
--
Rozhuk Ivan
More information about the freebsd-net
mailing list