9.1-RC3 IGB dropping connections.

[Barney Cordoba]

--- On Tue, 11/27/12, Zaphod Beeblebrox <zbeeble at gmail.com> wrote:

> From: Zaphod Beeblebrox <zbeeble at gmail.com>
> Subject: Re: 9.1-RC3 IGB dropping connections.
> To: "Mike Tancsa" <mike at sentex.net>
> Cc: "FreeBSD Hackers" <freebsd-hackers at freebsd.org>, "FreeBSD Stable" <freebsd-stable at freebsd.org>, "FreeBSD Net" <freebsd-net at freebsd.org>
> Date: Tuesday, November 27, 2012, 10:26 PM
> On Tue, Nov 27, 2012 at 9:25 PM, Mike
> Tancsa <mike at sentex.net>
> wrote:
> 
> > Are you using pf ? Also, did you confirm it is the igb
> nic and not
> > something more general ? e.g. if you put in a different
> nic, does the
> > problem go away ?
> 
> No pf, the motherboard em-driver NIC does not have this
> problem.
> 
> In reply to another message,
> 
> igb1 at pci0:3:0:1:        class=0x020000
> card=0x34f28086 chip=0x10c98086
> rev=0x01 hdr=0x00
>     vendor     = 'Intel
> Corporation'
>     device     = '82576
> Gigabit Network Connection'
>     class      = network
>     subclass   = ethernet
> 
> Here is /var/log/messages.  The IPv6 chatter is
> something that
> everything on the network has problems with --- duplicate
> IPv6
> addresses that are not duplicate.
> 
> Nov 26 12:53:49 ccsw1 newsyslog[1419]: logfile first
> created
> Nov 26 12:53:49 ccsw1 syslogd: kernel boot file is
> /boot/kernel/kernel
> Nov 26 12:53:49 ccsw1 kernel: Copyright (c) 1992-2012 The
> FreeBSD Project.
> Nov 26 12:53:49 ccsw1 kernel: Copyright (c) 1979, 1980,
> 1983, 1986,
> 1988, 1989, 1991, 1992, 1993, 1994
> Nov 26 12:53:49 ccsw1 kernel: The Regents of the University
> of
> California. All rights reserved.
> Nov 26 12:53:49 ccsw1 kernel: FreeBSD is a registered
> trademark of The
> FreeBSD Foundation.
> Nov 26 12:53:49 ccsw1 kernel: FreeBSD 9.1-RC3 #0 r242324:
> Tue Oct 30
> 00:58:57 UTC 2012
> Nov 26 12:53:49 ccsw1 kernel:
> root at farrell.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC
> amd64
> Nov 26 12:53:49 ccsw1 kernel: CPU: Intel(R) Xeon(R) CPU
> X3440  @ 2.53GHz (2533.35-MHz K8-class CPU)
> Nov 26 12:53:49 ccsw1 kernel: Origin = "GenuineIntel" 
> Id = 0x106e5
> Family = 6  Model = 1e  Stepping = 5
> Nov 26 12:53:49 ccsw1 kernel:
> Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
> Nov 26 12:53:49 ccsw1 kernel:
> Features2=0x98e3fd<SSE3,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,POPCNT>
> Nov 26 12:53:49 ccsw1 kernel: AMD
> Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
> Nov 26 12:53:49 ccsw1 kernel: AMD Features2=0x1<LAHF>
> Nov 26 12:53:49 ccsw1 kernel: TSC: P-state invariant,
> performance statistics
> Nov 26 12:53:49 ccsw1 kernel: real memory  =
> 17179869184 (16384 MB)
> Nov 26 12:53:49 ccsw1 kernel: avail memory = 16458309632
> (15695 MB)
> Nov 26 12:53:49 ccsw1 kernel: Event timer "LAPIC" quality
> 400
> Nov 26 12:53:49 ccsw1 kernel: ACPI APIC Table:
> <INTEL  S3420GPR>
> Nov 26 12:53:49 ccsw1 kernel: FreeBSD/SMP: Multiprocessor
> System
> Detected: 8 CPUs
> Nov 26 12:53:49 ccsw1 kernel: FreeBSD/SMP: 1 package(s) x 4
> core(s) x
> 2 SMT threads
> Nov 26 12:53:49 ccsw1 kernel: cpu0 (BSP): APIC ID:  0
> Nov 26 12:53:49 ccsw1 kernel: cpu1 (AP): APIC ID:  1
> Nov 26 12:53:49 ccsw1 kernel: cpu2 (AP): APIC ID:  2
> Nov 26 12:53:49 ccsw1 kernel: cpu3 (AP): APIC ID:  3
> Nov 26 12:53:49 ccsw1 kernel: cpu4 (AP): APIC ID:  4
> Nov 26 12:53:49 ccsw1 kernel: cpu5 (AP): APIC ID:  5
> Nov 26 12:53:49 ccsw1 kernel: cpu6 (AP): APIC ID:  6
> Nov 26 12:53:49 ccsw1 kernel: cpu7 (AP): APIC ID:  7
> Nov 26 12:53:49 ccsw1 kernel: ioapic0 <Version 2.0>
> irqs 0-23 on motherboard
> Nov 26 12:53:49 ccsw1 kernel: lapic0: Forcing LINT1 to edge
> trigger
> Nov 26 12:53:49 ccsw1 kernel: kbd1 at kbdmux0
> Nov 26 12:53:49 ccsw1 kernel: acpi0: <INTEL S3420GPR>
> on motherboard
> Nov 26 12:53:49 ccsw1 kernel: acpi0: Power Button (fixed)
> Nov 26 12:53:49 ccsw1 kernel: cpu0: <ACPI CPU> on
> acpi0
> Nov 26 12:53:49 ccsw1 kernel: cpu1: <ACPI CPU> on
> acpi0
> Nov 26 12:53:49 ccsw1 kernel: cpu2: <ACPI CPU> on
> acpi0
> Nov 26 12:53:49 ccsw1 kernel: cpu3: <ACPI CPU> on
> acpi0
> Nov 26 12:53:49 ccsw1 kernel: cpu4: <ACPI CPU> on
> acpi0
> Nov 26 12:53:49 ccsw1 kernel: cpu5: <ACPI CPU> on
> acpi0
> Nov 26 12:53:49 ccsw1 kernel: cpu6: <ACPI CPU> on
> acpi0
> Nov 26 12:53:49 ccsw1 kernel: cpu7: <ACPI CPU> on
> acpi0
> Nov 26 12:53:49 ccsw1 kernel: atrtc0: <AT realtime
> clock> port
> 0x70-0x71,0x74-0x77 irq 8 on acpi0
> Nov 26 12:53:49 ccsw1 kernel: Event timer "RTC" frequency
> 32768 Hz quality 0
> Nov 26 12:53:49 ccsw1 kernel: attimer0: <AT timer>
> port
> 0x40-0x43,0x50-0x53 irq 0 on acpi0
> Nov 26 12:53:49 ccsw1 kernel: Timecounter "i8254" frequency
> 1193182 Hz quality 0
> Nov 26 12:53:49 ccsw1 kernel: Event timer "i8254" frequency
> 1193182 Hz
> quality 100
> Nov 26 12:53:49 ccsw1 kernel: hpet0: <High Precision
> Event Timer>
> iomem 0xfed00000-0xfed003ff on acpi0
> Nov 26 12:53:49 ccsw1 kernel: Timecounter "HPET" frequency
> 14318180 Hz
> quality 950
> Nov 26 12:53:49 ccsw1 kernel: Event timer "HPET" frequency
> 14318180 Hz
> quality 550
> Nov 26 12:53:49 ccsw1 kernel: Timecounter "ACPI-fast"
> frequency
> 3579545 Hz quality 900
> Nov 26 12:53:49 ccsw1 kernel: acpi_timer0: <24-bit timer
> at
> 3.579545MHz> port 0x408-0x40b on acpi0
> Nov 26 12:53:49 ccsw1 kernel: pcib0: <ACPI Host-PCI
> bridge> port
> 0xcf8-0xcff on acpi0
> Nov 26 12:53:49 ccsw1 kernel: pci0: <ACPI PCI bus> on
> pcib0
> Nov 26 12:53:49 ccsw1 kernel: pcib1: <ACPI PCI-PCI
> bridge> irq 16 at
> device 3.0 on pci0
> Nov 26 12:53:49 ccsw1 kernel: pci1: <ACPI PCI bus> on
> pcib1
> Nov 26 12:53:49 ccsw1 kernel: pcib2: <ACPI PCI-PCI
> bridge> at device 0.0 on pci1
> Nov 26 12:53:49 ccsw1 kernel: pci2: <ACPI PCI bus> on
> pcib2
> Nov 26 12:53:49 ccsw1 kernel: pcib3: <ACPI PCI-PCI
> bridge> at device 2.0 on pci2
> Nov 26 12:53:49 ccsw1 kernel: pci3: <ACPI PCI bus> on
> pcib3
> Nov 26 12:53:49 ccsw1 kernel: igb0: <Intel(R) PRO/1000
> Network
> Connection version - 2.3.4> port 0x3020-0x303f mem
> 0xb1b20000-0xb1b3ffff,0xb1bc4000-0xb1bc7fff irq 19 at device
> 0.0 on
> pci3
> Nov 26 12:53:49 ccsw1 kernel: igb0: Using MSIX interrupts
> with 9 vectors
> Nov 26 12:53:49 ccsw1 kernel: igb0: Ethernet address:
> 00:1e:67:3a:d5:40
> Nov 26 12:53:49 ccsw1 kernel: igb0: Bound queue 0 to cpu 0
> Nov 26 12:53:49 ccsw1 kernel: igb0: Bound queue 1 to cpu 1
> Nov 26 12:53:49 ccsw1 kernel: igb0: Bound queue 2 to cpu 2
> Nov 26 12:53:49 ccsw1 kernel: igb0: Bound queue 3 to cpu 3
> Nov 26 12:53:49 ccsw1 kernel: igb0: Bound queue 4 to cpu 4
> Nov 26 12:53:49 ccsw1 kernel: igb0: Bound queue 5 to cpu 5
> Nov 26 12:53:49 ccsw1 kernel: igb0: Bound queue 6 to cpu 6
> Nov 26 12:53:49 ccsw1 kernel: igb0: Bound queue 7 to cpu 7
> Nov 26 12:53:49 ccsw1 kernel: igb1: <Intel(R) PRO/1000
> Network
> Connection version - 2.3.4> port 0x3000-0x301f mem
> 0xb1b00000-0xb1b1ffff,0xb1bc0000-0xb1bc3fff irq 18 at device
> 0.1 on
> pci3
> Nov 26 12:53:49 ccsw1 kernel: igb1: Using MSIX interrupts
> with 9 vectors
> Nov 26 12:53:49 ccsw1 kernel: igb1: Ethernet address:
> 00:1e:67:3a:d5:41
> Nov 26 12:53:49 ccsw1 kernel: igb1: Bound queue 0 to cpu 0
> Nov 26 12:53:49 ccsw1 kernel: igb1: Bound queue 1 to cpu 1
> Nov 26 12:53:49 ccsw1 kernel: igb1: Bound queue 2 to cpu 2
> Nov 26 12:53:49 ccsw1 kernel: igb1: Bound queue 3 to cpu 3
> Nov 26 12:53:49 ccsw1 kernel: igb1: Bound queue 4 to cpu 4
> Nov 26 12:53:49 ccsw1 kernel: igb1: Bound queue 5 to cpu 5
> Nov 26 12:53:49 ccsw1 kernel: igb1: Bound queue 6 to cpu 6
> Nov 26 12:53:49 ccsw1 kernel: igb1: Bound queue 7 to cpu 7
> Nov 26 12:53:49 ccsw1 kernel: pcib4: <ACPI PCI-PCI
> bridge> at device 3.0 on pci2
> Nov 26 12:53:49 ccsw1 kernel: pci6: <ACPI PCI bus> on
> pcib4
> Nov 26 12:53:49 ccsw1 kernel: igb2: <Intel(R) PRO/1000
> Network
> Connection version - 2.3.4> port 0x2020-0x203f mem
> 0xb1a20000-0xb1a3ffff,0xb1ac4000-0xb1ac7fff irq 16 at device
> 0.0 on
> pci6
> Nov 26 12:53:49 ccsw1 kernel: igb2: Using MSIX interrupts
> with 9 vectors
> Nov 26 12:53:49 ccsw1 kernel: igb2: Ethernet address:
> 00:1e:67:3a:d5:42
> Nov 26 12:53:49 ccsw1 kernel: igb2: Bound queue 0 to cpu 0
> Nov 26 12:53:49 ccsw1 kernel: igb2: Bound queue 1 to cpu 1
> Nov 26 12:53:49 ccsw1 kernel: igb2: Bound queue 2 to cpu 2
> Nov 26 12:53:49 ccsw1 kernel: igb2: Bound queue 3 to cpu 3
> Nov 26 12:53:49 ccsw1 kernel: igb2: Bound queue 4 to cpu 4
> Nov 26 12:53:49 ccsw1 kernel: igb2: Bound queue 5 to cpu 5
> Nov 26 12:53:49 ccsw1 kernel: igb2: Bound queue 6 to cpu 6
> Nov 26 12:53:49 ccsw1 kernel: igb2: Bound queue 7 to cpu 7
> Nov 26 12:53:49 ccsw1 kernel: igb3: <Intel(R) PRO/1000
> Network
> Connection version - 2.3.4> port 0x2000-0x201f mem
> 0xb1a00000-0xb1a1ffff,0xb1ac0000-0xb1ac3fff irq 19 at device
> 0.1 on
> pci6
> Nov 26 12:53:49 ccsw1 kernel: igb3: Using MSIX interrupts
> with 9 vectors
> Nov 26 12:53:49 ccsw1 kernel: igb3: Ethernet address:
> 00:1e:67:3a:d5:43
> Nov 26 12:53:49 ccsw1 kernel: igb3: Bound queue 0 to cpu 0
> Nov 26 12:53:49 ccsw1 kernel: igb3: Bound queue 1 to cpu 1
> Nov 26 12:53:49 ccsw1 kernel: igb3: Bound queue 2 to cpu 2
> Nov 26 12:53:49 ccsw1 kernel: igb3: Bound queue 3 to cpu 3
> Nov 26 12:53:49 ccsw1 kernel: igb3: Bound queue 4 to cpu 4
> Nov 26 12:53:49 ccsw1 kernel: igb3: Bound queue 5 to cpu 5
> Nov 26 12:53:49 ccsw1 kernel: igb3: Bound queue 6 to cpu 6
> Nov 26 12:53:49 ccsw1 kernel: igb3: Bound queue 7 to cpu 7
> Nov 26 12:53:49 ccsw1 kernel: pcib5: <ACPI PCI-PCI
> bridge> at device 4.0 on pci2
> Nov 26 12:53:49 ccsw1 kernel: pci9: <ACPI PCI bus> on
> pcib5
> Nov 26 12:53:49 ccsw1 kernel: pcib6: <ACPI PCI-PCI
> bridge> at device 5.0 on pci2
> Nov 26 12:53:49 ccsw1 kernel: pci10: <ACPI PCI bus> on
> pcib6
> Nov 26 12:53:49 ccsw1 kernel: pci0: <base peripheral>
> at device 8.0
> (no driver attached)
> Nov 26 12:53:49 ccsw1 kernel: pci0: <base peripheral>
> at device 8.1
> (no driver attached)
> Nov 26 12:53:49 ccsw1 kernel: pci0: <base peripheral>
> at device 8.2
> (no driver attached)
> Nov 26 12:53:49 ccsw1 kernel: pci0: <base peripheral>
> at device 8.3 (no driver a
> ttached)
> Nov 26 12:53:49 ccsw1 kernel: pci0: <base peripheral>
> at device 16.0
> (no driver attached)
> Nov 26 12:53:49 ccsw1 kernel: pci0: <base peripheral>
> at device 16.1
> (no driver attached)
> Nov 26 12:53:49 ccsw1 kernel: ehci0: <Intel PCH USB 2.0
> controller
> USB-B> mem 0xb1c02000-0xb1c023ff irq 21 at device 26.0 on
> pci0
> Nov 26 12:53:49 ccsw1 kernel: usbus0: EHCI version 1.0
> Nov 26 12:53:49 ccsw1 kernel: usbus0 on ehci0
> Nov 26 12:53:49 ccsw1 kernel: pcib7: <ACPI PCI-PCI
> bridge> irq 16 at
> device 28.0 on pci0
> Nov 26 12:53:49 ccsw1 kernel: pci11: <ACPI PCI bus> on
> pcib7
> Nov 26 12:53:49 ccsw1 kernel: pcib8: <ACPI PCI-PCI
> bridge> irq 16 at
> device 28.4 on pci0
> Nov 26 12:53:49 ccsw1 kernel: pci12: <ACPI PCI bus> on
> pcib8
> Nov 26 12:53:49 ccsw1 kernel: em0: <Intel(R) PRO/1000
> Network
> Connection 7.3.2> port 0x1000-0x101f mem
> 0xb1900000-0xb191ffff,0xb1920000-0xb1923fff irq 16 at device
> 0.0 on
> pci12
> Nov 26 12:53:49 ccsw1 kernel: em0: Using MSIX interrupts
> with 3 vectors
> Nov 26 12:53:49 ccsw1 kernel: em0: Ethernet address:
> 00:1e:67:3a:d5:44
> Nov 26 12:53:49 ccsw1 kernel: pcib9: <ACPI PCI-PCI
> bridge> irq 18 at
> device 28.6 on pci0
> Nov 26 12:53:49 ccsw1 kernel: pci13: <ACPI PCI bus> on
> pcib9
> Nov 26 12:53:49 ccsw1 kernel: vgapci0: <VGA-compatible
> display> mem
> 0xb0000000-0xb0ffffff,0xb1800000-0xb1803fff,0xb1000000-0xb17fffff
> irq
> 17 at device 0.0 on pci13
> Nov 26 12:53:49 ccsw1 kernel: ehci1: <Intel PCH USB 2.0
> controller
> USB-A> mem 0xb1c01000-0xb1c013ff irq 23 at device 29.0 on
> pci0
> Nov 26 12:53:49 ccsw1 kernel: usbus1: EHCI version 1.0
> Nov 26 12:53:49 ccsw1 kernel: usbus1 on ehci1
> Nov 26 12:53:49 ccsw1 kernel: pcib10: <ACPI PCI-PCI
> bridge> at device
> 30.0 on pci0
> Nov 26 12:53:49 ccsw1 kernel: pci14: <ACPI PCI bus> on
> pcib10
> Nov 26 12:53:49 ccsw1 kernel: isab0: <PCI-ISA bridge>
> at device 31.0 on pci0
> Nov 26 12:53:49 ccsw1 kernel: isa0: <ISA bus> on
> isab0
> Nov 26 12:53:49 ccsw1 kernel: ahci0: <Intel 5 Series/3400
> Series AHCI
> SATA controller> port
> 0x4048-0x404f,0x4054-0x4057,0x4040-0x4047,0x4050-0x4053,0x4020-0x403f
> mem 0xb1c00000-0xb1c007ff irq 18 at device 31.2 on pci0
> Nov 26 12:53:49 ccsw1 kernel: ahci0: AHCI v1.30 with 6 3Gbps
> ports,
> Port Multiplier not supported
> Nov 26 12:53:49 ccsw1 kernel: ahcich0: <AHCI channel>
> at channel 0 on ahci0
> Nov 26 12:53:49 ccsw1 kernel: ahcich1: <AHCI channel>
> at channel 1 on ahci0
> Nov 26 12:53:49 ccsw1 kernel: ahcich2: <AHCI channel>
> at channel 2 on ahci0
> Nov 26 12:53:49 ccsw1 kernel: ahcich3: <AHCI channel>
> at channel 3 on ahci0
> Nov 26 12:53:49 ccsw1 kernel: ahcich4: <AHCI channel>
> at channel 4 on ahci0
> Nov 26 12:53:49 ccsw1 kernel: ahcich5: <AHCI channel>
> at channel 5 on ahci0
> Nov 26 12:53:49 ccsw1 kernel: pci0: <serial bus,
> SMBus> at device 31.3
> (no driver attached)
> Nov 26 12:53:49 ccsw1 kernel: acpi_button0: <Sleep
> Button> on acpi0
> Nov 26 12:53:49 ccsw1 kernel: uart0: <16550 or
> compatible> port
> 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
> Nov 26 12:53:49 ccsw1 kernel: uart1: <16550 or
> compatible> port
> 0x2f8-0x2ff irq 3 on acpi0
> Nov 26 12:53:49 ccsw1 kernel: orm0: <ISA Option ROM>
> at iomem
> 0xc0000-0xc7fff on isa0
> Nov 26 12:53:49 ccsw1 kernel: sc0: <System console> at
> flags 0x100 on isa0
> Nov 26 12:53:49 ccsw1 kernel: sc0: VGA <16 virtual
> consoles, flags=0x300>
> Nov 26 12:53:49 ccsw1 kernel: vga0: <Generic ISA VGA>
> at port
> 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
> Nov 26 12:53:49 ccsw1 kernel: ppc0: cannot reserve I/O port
> range
> Nov 26 12:53:49 ccsw1 kernel: ctl: CAM Target Layer loaded
> Nov 26 12:53:49 ccsw1 kernel: est0: <Enhanced SpeedStep
> Frequency
> Control> on cpu0
> Nov 26 12:53:49 ccsw1 kernel: p4tcc0: <CPU Frequency
> Thermal Control> on cpu0
> Nov 26 12:53:49 ccsw1 kernel: est1: <Enhanced SpeedStep
> Frequency
> Control> on cpu1
> Nov 26 12:53:49 ccsw1 kernel: p4tcc1: <CPU Frequency
> Thermal Control> on cpu1
> Nov 26 12:53:49 ccsw1 kernel: est2: <Enhanced SpeedStep
> Frequency
> Control> on cpu2
> Nov 26 12:53:49 ccsw1 kernel: p4tcc2: <CPU Frequency
> Thermal Control> on cpu2
> Nov 26 12:53:49 ccsw1 kernel: est3: <Enhanced SpeedStep
> Frequency
> Control> on cpu3
> Nov 26 12:53:49 ccsw1 kernel: p4tcc3: <CPU Frequency
> Thermal Control> on cpu3
> Nov 26 12:53:49 ccsw1 kernel: est4: <Enhanced SpeedStep
> Frequency
> Control> on cpu4
> Nov 26 12:53:49 ccsw1 kernel: p4tcc4: <CPU Frequency
> Thermal Control> on cpu4
> Nov 26 12:53:49 ccsw1 kernel: est5: <Enhanced SpeedStep
> Frequency
> Control> on cpu5
> Nov 26 12:53:49 ccsw1 kernel: p4tcc5: <CPU Frequency
> Thermal Control> on cpu5
> Nov 26 12:53:49 ccsw1 kernel: est6: <Enhanced SpeedStep
> Frequency
> Control> on cpu6
> Nov 26 12:53:49 ccsw1 kernel: p4tcc6: <CPU Frequency
> Thermal Control> on cpu6
> Nov 26 12:53:49 ccsw1 kernel: est7: <Enhanced SpeedStep
> Frequency
> Control> on cpu7
> Nov 26 12:53:49 ccsw1 kernel: p4tcc7: <CPU Frequency
> Thermal Control> on cpu7
> Nov 26 12:53:49 ccsw1 kernel: ZFS filesystem version 5
> Nov 26 12:53:49 ccsw1 kernel: ZFS storage pool version 28
> Nov 26 12:53:49 ccsw1 kernel: Timecounters tick every 1.000
> msec
> Nov 26 12:53:49 ccsw1 kernel: usbus0: 480Mbps High Speed USB
> v2.0
> Nov 26 12:53:49 ccsw1 kernel: usbus1: 480Mbps High Speed USB
> v2.0
> Nov 26 12:53:49 ccsw1 kernel: ugen0.1: <Intel> at
> usbus0
> Nov 26 12:53:49 ccsw1 kernel: uhub0: <Intel EHCI root
> HUB, class 9/0,
> rev 2.00/1.00, addr 1> on usbus0
> Nov 26 12:53:49 ccsw1 kernel: ugen1.1: <Intel> at
> usbus1
> Nov 26 12:53:49 ccsw1 kernel: uhub1: <Intel EHCI root
> HUB, class 9/0,
> rev 2.00/1.00, addr 1> on usbus1
> Nov 26 12:53:49 ccsw1 kernel: uhub0: 2 ports with 2
> removable, self powered
> Nov 26 12:53:49 ccsw1 kernel: uhub1: 2 ports with 2
> removable, self powered
> Nov 26 12:53:49 ccsw1 kernel: ugen0.2: <vendor 0x8087>
> at usbus0
> Nov 26 12:53:49 ccsw1 kernel: uhub2: <vendor 0x8087
> product 0x0020,
> class 9/0, rev 2.00/0.00, addr 2> on usbus0
> Nov 26 12:53:49 ccsw1 kernel: ugen1.2: <vendor 0x8087>
> at usbus1
> Nov 26 12:53:49 ccsw1 kernel: uhub3: <vendor 0x8087
> product 0x0020,
> class 9/0, rev 2.00/0.00, addr 2> on usbus1
> Nov 26 12:53:49 ccsw1 kernel: uhub2: 6 ports with 6
> removable, self powered
> Nov 26 12:53:49 ccsw1 kernel: uhub3: 8 ports with 8
> removable, self powered
> Nov 26 12:53:49 ccsw1 kernel: ugen0.3: <BTC> at
> usbus0
> Nov 26 12:53:49 ccsw1 kernel: ukbd0: <BTC USB Multimedia
> Keyboard,
> class 0/0, rev 1.10/1.23, addr 3> on usbus0
> Nov 26 12:53:49 ccsw1 kernel: kbd0 at ukbd0
> Nov 26 12:53:49 ccsw1 kernel: uhid0: <12032003> on
> usbus0
> Nov 26 12:53:49 ccsw1 kernel: ugen1.3: <American
> Megatrends Inc.> at usbus1
> Nov 26 12:53:49 ccsw1 kernel: ukbd1: <Keyboard
> Interface> on usbus1
> Nov 26 12:53:49 ccsw1 kernel: kbd2 at ukbd1
> Nov 26 12:53:49 ccsw1 kernel: ums0: <Mouse Interface>
> on usbus1
> Nov 26 12:53:49 ccsw1 kernel: ums0: 3 buttons and [Z]
> coordinates ID=0
> Nov 26 12:53:49 ccsw1 kernel: ada0 at ahcich0 bus 0 scbus0
> target 0 lun 0
> Nov 26 12:53:49 ccsw1 kernel: ada0: <ST2000DM001-9YN164
> CC4B> ATA-8
> SATA 3.x device
> Nov 26 12:53:49 ccsw1 kernel: ada0: 300.000MB/s transfers
> (SATA 2.x,
> UDMA6, PIO 8192bytes)
> Nov 26 12:53:49 ccsw1 kernel: ada0: Command Queueing
> enabled
> Nov 26 12:53:49 ccsw1 kernel: ada0: 1907729MB (3907029168
> 512 byte
> sectors: 16H 63S/T 16383C)
> Nov 26 12:53:49 ccsw1 kernel: ada0: Previously was known as
> ad4
> Nov 26 12:53:49 ccsw1 kernel: ada1 at ahcich1 bus 0 scbus1
> target 0 lun 0
> Nov 26 12:53:49 ccsw1 kernel: ada1: <ST2000DM001-9YN164
> CC4B> ATA-8
> SATA 3.x device
> Nov 26 12:53:49 ccsw1 kernel: ada1: 300.000MB/s transfers
> (SATA 2.x,
> UDMA6, PIO 8192bytes)
> Nov 26 12:53:49 ccsw1 kernel: ada1: Command Queueing
> enabled
> Nov 26 12:53:49 ccsw1 kernel: ada1: 1907729MB (3907029168
> 512 byte
> sectors: 16H 63S/T 16383C)
> Nov 26 12:53:49 ccsw1 kernel: ada1: Previously was known as
> ad6
> Nov 26 12:53:49 ccsw1 kernel: lapic1: Forcing LINT1 to edge
> trigger
> Nov 26 12:53:49 ccsw1 kernel: SMP: AP CPU #1 Launched!
> Nov 26 12:53:49 ccsw1 kernel: lapic2: Forcing LINT1 to edge
> trigger
> Nov 26 12:53:49 ccsw1 kernel: SMP: AP CPU #2 Launched!
> Nov 26 12:53:49 ccsw1 kernel: lapic7: Forcing LINT1 to edge
> trigger
> Nov 26 12:53:49 ccsw1 kernel: SMP: AP CPU #7 Launched!
> Nov 26 12:53:49 ccsw1 kernel: lapic5: Forcing LINT1 to edge
> trigger
> Nov 26 12:53:49 ccsw1 kernel: SMP: AP CPU #5 Launched!
> Nov 26 12:53:49 ccsw1 kernel: lapic6: Forcing LINT1 to edge
> trigger
> Nov 26 12:53:49 ccsw1 kernel: SMP: AP CPU #6 Launched!
> Nov 26 12:53:49 ccsw1 kernel: lapic3: Forcing LINT1 to edge
> trigger
> Nov 26 12:53:49 ccsw1 kernel: SMP: AP CPU #3 Launched!
> Nov 26 12:53:49 ccsw1 kernel: lapic4: Forcing LINT1 to edge
> trigger
> Nov 26 12:53:49 ccsw1 kernel: SMP: AP CPU #4 Launched!
> Nov 26 12:53:49 ccsw1 kernel: Timecounter "TSC-low"
> frequency 9895914
> Hz quality 1000
> Nov 26 12:58:01 ccsw1 kernel: Trying to mount root from
> zfs:pool/r1 []...
> Nov 26 12:58:01 ccsw1 root: /etc/rc: WARNING: Dump device
> does not
> exist.  Savecore not run.
> Nov 26 12:58:01 ccsw1 ntpd[1511]: ntpd 4.2.4p5-a (1)
> Nov 26 12:58:01 ccsw1 ntpd[1512]: bind() fd 22, family
> AF_INET6, port
> 123, scope 2, addr fe80::21e:67ff:fe3a:d541, mcast=0
> flags=0x11 fails:
> Can't assign requested address
> Nov 26 12:58:01 ccsw1 ntpd[1512]: unable to create socket on
> igb1 (2)
> for fe80::21e:67ff:fe3a:d541#123
> Nov 26 12:58:12 ccsw1 ntpd[1512]: bind() fd 27, family
> AF_INET6, port
> 123, scope 2, addr fe80::21e:67ff:fe3a:d541, mcast=0
> flags=0x11 fails:
> Can't assign requested address
> Nov 26 12:58:12 ccsw1 ntpd[1512]: unable to create socket on
> igb1 (7)
> for fe80::21e:67ff:fe3a:d541#123
> Nov 26 12:58:18 ccsw1 ntpd[1512]: time reset +0.261195 s
> Nov 26 12:58:23 ccsw1 sshd[1575]: error: PAM: authentication
> error for
> root from 192.168.221.84
> Nov 26 13:03:12 ccsw1 ntpd[1512]: bind() fd 27, family
> AF_INET6, port
> 123, scope 2, addr fe80::21e:67ff:fe3a:d541, mcast=0
> flags=0x11 fails:
> Can't assign requested address
> 

I'm curious as to what logic there is to have 32 queues for a 4 core
CPU? And does it make sense to bind queues randomly without regard for
whether its a physical or a logical core?

CPU binding doesn't make a lot of sense if its done randomly. And it 
seems like you just have a lot of queues for the heck of having a lot
of queues without any understanding of the point of the feature, which
is to increase capacity of overloaded systems; not to suck up all of the
cpu processing power for the entire system.

At minimum, you certainly have to tune the driver to fit your system. 
Blindly accepting the defaults, which are likely chosen for a 1 NIC
system, is going to be more wrong the more your system deviates from
that assumption.

BC