[Bug 239704] Regression in IXGBE(4) on 12.0-RELEASE

Wed Aug 7 21:45:00 UTC 2019

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=239704

            Bug ID: 239704
           Summary: Regression in IXGBE(4) on 12.0-RELEASE
           Product: Base System
           Version: 12.0-RELEASE
          Hardware: amd64
                OS: Any
            Status: New
          Severity: Affects Only Me
          Priority: ---
         Component: kern
          Assignee: bugs at FreeBSD.org
          Reporter: gcr at tharned.org

On multiple servers running 12.0-RELEASE, the ixgbe(4) driver enables only one
of eight queues on Intel 10Gb NICs. When booting the same hardware to
11.3-RELEASE, the driver configures all eight queues as expected.

dmidecode:
---
System Information
        Manufacturer: HPE
        Product Name: ProLiant DL380 Gen10
        Version: Not Specified
        Serial Number: XXXXXXXXXX
        UUID: 37383638-3330-4d32-3239-313130303757
        Wake-up Type: Power Switch
        SKU Number: 868703-B21
        Family: ProLiant
Handle 0x00BF, DMI type 203, 34 bytes
OEM-specific Type
        Header and Data:
                CB 22 BF 00 AF 00 FE FF 86 80 FB 10 3C 10 D3 17
                02 00 FE FF 00 00 05 0A 01 01 FF FF 01 02 03 04
                FE FF
        Strings:
                PciRoot(0x1)/Pci(0x0,0x0)/Pci(0x0,0x0)
                NIC.Slot.1.1
                HPE Ethernet 10Gb 2-port 560SFP+ Adapter - NIC
                Slot 1
---

dmesg on 12.0-RELEASE:
---
ix0: <Intel(R) PRO/10GbE PCI-Express Network Driver> port 0x4020-0x403f mem
0xe2900000-0xe29fffff,0xe2a04000-0xe2a07fff at device 0.0 numa-domain 0 on pci4
ix0: using 2048 tx descriptors and 2048 rx descriptors
ix0: msix_init qsets capped at 16
ix0: Unable to map MSIX table 
ix0: Using an MSI interrupt
ix0: allocated for 1 queues
ix0: allocated for 1 rx queues
ix0: Ethernet address: 48:df:37:62:be:38
ix0: PCI Express Bus: Speed 5.0GT/s Width x8
ix0: netmap queues/slots: TX 1/2048, RX 1/2048
---

dmesg on 11.3-RELEASE:
---
ix0: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 3.2.12-k> port
0x4020-0x403f mem 0xe2900000-0xe29fffff,0xe2a04000-0xe2a07fff at device 0.0
numa-domain 0 on pci4
ix0: Using MSI-X interrupts with 9 vectors
ix0: Ethernet address: 48:df:37:62:be:38
ix0: PCI Express Bus: Speed 5.0GT/s Width x8
ix0: netmap queues/slots: TX 8/2048, RX 8/2048
---

pciconf -lvct on 12.0-RELEASE:
---
ix0 at pci0:17:0:0:        class=0x020000 card=0x17d3103c chip=0x10fb8086 rev=0x01
hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82599ES 10-Gigabit SFI/SFP+ Network Connection'
    class      = network
    subclass   = ethernet
    cap 01[40] = powerspec 3  supports D0 D3  current D0
    cap 05[50] = MSI supports 1 message, 64 bit, vector masks enabled with 1
message
    cap 11[70] = MSI-X supports 64 messages
                 Table in map 0x1c[0x0], PBA in map 0x1c[0x2000]
    cap 10[a0] = PCI-Express 2 endpoint max data 256(512) FLR RO NS
                 link x8(x8) speed 5.0(5.0) ASPM disabled(L0s)
    cap 03[e0] = VPD
    ecap 0001[100] = AER 1 0 fatal 0 non-fatal 1 corrected
    ecap 0003[140] = Serial 1 48df37ffff62be38
    ecap 000e[150] = ARI 1
    ecap 0010[160] = SR-IOV 1 IOV disabled, Memory Space disabled, ARI enabled
                     0 VFs configured out of 64 supported
                     First VF RID Offset 0x0080, VF RID Stride 0x0002
                     VF Device ID 0x10ed
                     Page Sizes: 4096 (enabled), 8192, 65536, 262144, 1048576,
4194304
  PCI-e errors = Correctable Error Detected
                 Unsupported Request Detected
     Corrected = Advisory Non-Fatal Error
---

pciconf -lvct on 11.3-RELEASE:
---
ix0 at pci0:17:0:0:        class=0x020000 card=0x17d3103c chip=0x10fb8086 rev=0x01
hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82599ES 10-Gigabit SFI/SFP+ Network Connection'
    class      = network
    subclass   = ethernet
    cap 01[40] = powerspec 3  supports D0 D3  current D0
    cap 05[50] = MSI supports 1 message, 64 bit, vector masks
    cap 11[70] = MSI-X supports 64 messages, enabled
                 Table in map 0x1c[0x0], PBA in map 0x1c[0x2000]
    cap 10[a0] = PCI-Express 2 endpoint max data 256(512) FLR RO NS
                 link x8(x8) speed 5.0(5.0) ASPM disabled(L0s)
    cap 03[e0] = VPD
    ecap 0001[100] = AER 1 0 fatal 0 non-fatal 1 corrected
    ecap 0003[140] = Serial 1 48df37ffff62be38
    ecap 000e[150] = ARI 1
    ecap 0010[160] = SR-IOV 1 IOV disabled, Memory Space disabled, ARI enabled
                     0 VFs configured out of 64 supported
                     First VF RID Offset 0x0080, VF RID Stride 0x0002
                     VF Device ID 0x10ed
                     Page Sizes: 4096 (enabled), 8192, 65536, 262144, 1048576,
4194304
  PCI-e errors = Correctable Error Detected
                 Unsupported Request Detected
     Corrected = Advisory Non-Fatal Error
---

sysctl hw.ix on 12.0-RELEASE:
---
hw.ix.enable_rss: 1
hw.ix.enable_fdir: 0
hw.ix.unsupported_sfp: 0
hw.ix.enable_msix: 1
hw.ix.advertise_speed: 0
hw.ix.flow_control: 3
hw.ix.max_interrupt_rate: 31250
---

sysctl hw.ix on 11.3-RELEASE:
---
hw.ix.enable_rss: 1
hw.ix.enable_legacy_tx: 0
hw.ix.enable_fdir: 0
hw.ix.unsupported_sfp: 0
hw.ix.rxd: 2048
hw.ix.txd: 2048
hw.ix.num_queues: 8
hw.ix.enable_msix: 1
hw.ix.advertise_speed: 0
hw.ix.flow_control: 0
hw.ix.tx_process_limit: -1
hw.ix.rx_process_limit: -1
hw.ix.max_interrupt_rate: 31250
hw.ix.enable_aim: 1
---

Also see
<https://lists.freebsd.org/pipermail/freebsd-stable/2019-August/091415.html>. I
will be happy to provide more information or assist in debugging.

-- 
You are receiving this mail because:
You are the assignee for the bug.