panic ixgbevf / SMP under high network load

[Rémi Pauchet]

Hi

I'm testing network performance of FreeBSD using vmware esxi 5.1 with SR-IOV

I'm using  FreeBSD 8.3 kernel GENERIC, 4 cpus, ixgbevf driver with an Intel 82599EB dual 10 Gbps network interface

After a few seconds of udp ipv4 load (5Gbps x2, frame size 700), I have the following panic :


(kgdb) bt
#0  doadump () at pcpu.h:224
#1  0xffffffff8060ab90 in boot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:441
#2  0xffffffff8060b031 in panic (fmt=Variable "fmt" is not available.
) at /usr/src/sys/kern/kern_shutdown.c:614
#3  0xffffffff80900b80 in trap_fatal (frame=0xc, eva=Variable "eva" is not available.
) at /usr/src/sys/amd64/amd64/trap.c:825
#4  0xffffffff80900ed1 in trap_pfault (frame=0xffffff800016a620, usermode=0) at /usr/src/sys/amd64/amd64/trap.c:741
#5  0xffffffff8090138f in trap (frame=0xffffff800016a620) at /usr/src/sys/amd64/amd64/trap.c:478
#6  0xffffffff808e88e4 in calltrap () at /usr/src/sys/amd64/amd64/exception.S:228
#7  0xffffffff80667ef7 in m_copym (m=0x0, off0=1500, len=1480, wait=1) at /usr/src/sys/kern/uipc_mbuf.c:542
#8  0xffffffff8071c8c2 in ip_fragment (ip=0xffffff0001a3700e, m_frag=0xffffff800016a838, mtu=Variable "mtu" is not available.
) at /usr/src/sys/netinet/ip_output.c:819
#9  0xffffffff8071d93a in ip_output (m=0xffffff00019fd900, opt=Variable "opt" is not available.
) at /usr/src/sys/netinet/ip_output.c:650
#10 0xffffffff8071a13a in ip_forward (m=0xffffff00019fd900, srcrt=Variable "srcrt" is not available.
) at /usr/src/sys/netinet/ip_input.c:1521
#11 0xffffffff8071b77c in ip_input (m=0xffffff00019fd900) at /usr/src/sys/netinet/ip_input.c:729
#12 0xffffffff806c652e in netisr_dispatch_src (proto=1, source=Variable "source" is not available.
) at /usr/src/sys/net/netisr.c:859
#13 0xffffffff806bc5cd in ether_demux (ifp=0xffffff000168e800, m=0xffffff00019fd900) at /usr/src/sys/net/if_ethersubr.c:896
#14 0xffffffff806bc9d7 in ether_input (ifp=0xffffff000168e800, m=0xffffff00019fd900) at /usr/src/sys/net/if_ethersubr.c:755
#15 0xffffffff803ee03e in ixv_rxeof (que=0xffffff0001643880, count=117) at /usr/src/sys/dev/ixgbe/ixv.c:3256
#16 0xffffffff803ef50b in ixv_handle_que (context=Variable "context" is not available.
) at /usr/src/sys/dev/ixgbe/ixv.c:983
#17 0xffffffff806496d5 in taskqueue_run_locked (queue=0xffffff0001698200) at /usr/src/sys/kern/subr_taskqueue.c:250
#18 0xffffffff8064986e in taskqueue_thread_loop (arg=Variable "arg" is not available.
) at /usr/src/sys/kern/subr_taskqueue.c:387
#19 0xffffffff805dfc9f in fork_exit (callout=0xffffffff80649820 <taskqueue_thread_loop>, arg=0xffffff00016438d8, frame=0xffffff800016ac50) at /usr/src/sys/kern/kern_fork.c:876
#20 0xffffffff808e8e2e in fork_trampoline () at /usr/src/sys/amd64/amd64/exception.S:602


I have no issue with only one cpu (but low network performance)

Please find the dmesg in attachment

Regards,
Rémi Pauchet

-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: dmesg.txt
URL: <http://lists.freebsd.org/pipermail/freebsd-net/attachments/20121025/b4b8d8f6/attachment.txt>