[cxgb] Chelsio T304 quad gig pcie adapter TSO disabled

Bill Desjardins bill at ethernext.com
Mon Oct 11 05:22:52 UTC 2010


Hi All,

I have a couple Chelsio T304 quad gigabit nics that are going into
iscsi servers. I got these for the TOE capabilities, but I found in
the cxgb driver code that it is explicitly disabled for > 2 port nics
(line 1036 : /usr/src/sys/dev/cxgb/cxgb_main.c) . The current cxgb
driver is based on the chelsio 7.8.0 firmware (11/25/09), but chelsio
is up to 7.11.0 (07/20/10). I had updated the firmware using cxgbtool
to 7.11, but received complaints from the driver to 'upgrade' to
7.8.0, which I did.

my question is, is if the cxgb driver is being worked on to update to
latest chelsio firmware and/or fix TSO for the quad port cards? I
don't have the programming skill's to assist with that side of things,
but I can easily provide a remote spare machine with a serial console
for development and testing if its helpful.

Some info:

uname
-----------------------
FreeBSD sas.ethernap.net 8.1-STABLE FreeBSD 8.1-STABLE #1: Sun Oct 10
05:29:41 EDT 2010     sas at sas:/usr/obj/usr/src/sys/GENERIC  amd64

kernel boot (2 adapters)
-----------------------
cxgbc0: <Chelsio T304, 4 ports> mem
0xc8201000-0xc8201fff,0xc8800000-0xc8ffffff,0xc8200000-0xc8200fff irq
11 at device 0.0 on pci2
cxgbc0: Insufficient clusters and/or jumbo buffers.
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^????
cxgbc0: using MSI-X interrupts (9 vectors)
cxgb0: <Port 0 10/100/1000BASE-T> on cxgbc0
cxgb0: Ethernet address: 00:07:43:05:83:16
cxgb1: <Port 1 10/100/1000BASE-T> on cxgbc0
cxgb1: Ethernet address: 00:07:43:05:83:17
cxgb2: <Port 2 10/100/1000BASE-T> on cxgbc0
cxgb2: Ethernet address: 00:07:43:05:83:18
cxgb3: <Port 3 10/100/1000BASE-T> on cxgbc0
cxgb3: Ethernet address: 00:07:43:05:83:19
cxgbc0: Firmware Version 7.8.0

cxgbc1: <Chelsio T304, 4 ports> mem
0xc9101000-0xc9101fff,0xc9800000-0xc9ffffff,0xc9100000-0xc9100fff irq
11 at device 0.0 on pci8
cxgbc1: Insufficient clusters and/or jumbo buffers.
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^????
cxgbc1: using MSI-X interrupts (9 vectors)
cxgb4: <Port 0 10/100/1000BASE-T> on cxgbc1
cxgb4: Ethernet address: 00:07:43:05:a3:7d
cxgb5: <Port 1 10/100/1000BASE-T> on cxgbc1
cxgb5: Ethernet address: 00:07:43:05:a3:7e
cxgb6: <Port 2 10/100/1000BASE-T> on cxgbc1
cxgb6: Ethernet address: 00:07:43:05:a3:7f
cxgb7: <Port 3 10/100/1000BASE-T> on cxgbc1
cxgb7: Ethernet address: 00:07:43:05:a3:80
cxgbc1: Firmware Version 7.8.0

lspci -vvv
------------------------------------------
02:00.0 Ethernet controller: Chelsio Communications Inc T304 1GbE Quad
Port Adapter
        Subsystem: Chelsio Communications Inc Device 0001
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop-
ParErr+ Stepping- SERR+ FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort-
<TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 64 bytes
        Interrupt: pin A routed to IRQ 11
        Region 0: Memory at c8201000 (64-bit, non-prefetchable)
        Region 2: Memory at c8800000 (64-bit, non-prefetchable)
        Region 4: Memory at c8200000 (64-bit, non-prefetchable)
        Capabilities: [40] Power Management version 3
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA
PME(D0+,D1-,D2-,D3hot+,D3cold-)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [48] MSI: Enable- Count=1/32 Maskable- 64bit+
                Address: 0000000000000000  Data: 0000
        Capabilities: [58] Express (v2) Endpoint, MSI 00
                DevCap: MaxPayload 4096 bytes, PhantFunc 0, Latency
L0s <64ns, L1 <1us
                        ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
                DevCtl: Report errors: Correctable- Non-Fatal- Fatal-
Unsupported-
                        RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
                        MaxPayload 128 bytes, MaxReadReq 4096 bytes
                DevSta: CorrErr+ UncorrErr- FatalErr- UnsuppReq+
AuxPwr- TransPend-
                LnkCap: Port #0, Speed 2.5GT/s, Width x4, ASPM L0s L1,
Latency L0 unlimited, L1 unlimited
                        ClockPM- Surprise- LLActRep- BwNot-
                LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 2.5GT/s, Width x4, TrErr- Train-
SlotClk+ DLActive- BWMgmt- ABWMgmt-
                DevCap2: Completion Timeout: Range ABC, TimeoutDis-
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
                LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance-
SpeedDis-, Selectable De-emphasis: -6dB
                         Transmit Margin: Normal Operating Range,
EnterModifiedCompliance- ComplianceSOS-
                         Compliance De-emphasis: -6dB
                LnkSta2: Current De-emphasis Level: -6dB
        Capabilities: [94] Vital Product Data
                Not readable
        Capabilities: [9c] MSI-X: Enable+ Count=32 Masked-
                Vector table: BAR=4 offset=00000000
                PBA: BAR=4 offset=00000800

08:00.0 Ethernet controller: Chelsio Communications Inc T304 1GbE Quad
Port Adapter
        Subsystem: Chelsio Communications Inc Device 0001
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop-
ParErr+ Stepping- SERR+ FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort-
<TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 64 bytes
        Interrupt: pin A routed to IRQ 11
        Region 0: Memory at c9101000 (64-bit, non-prefetchable)
        Region 2: Memory at c9800000 (64-bit, non-prefetchable)
        Region 4: Memory at c9100000 (64-bit, non-prefetchable)
        Capabilities: [40] Power Management version 3
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA
PME(D0+,D1-,D2-,D3hot+,D3cold-)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [48] MSI: Enable- Count=1/32 Maskable- 64bit+
                Address: 0000000000000000  Data: 0000
        Capabilities: [58] Express (v2) Endpoint, MSI 00
                DevCap: MaxPayload 4096 bytes, PhantFunc 0, Latency
L0s <64ns, L1 <1us
                        ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
                DevCtl: Report errors: Correctable- Non-Fatal- Fatal-
Unsupported-
                        RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
                        MaxPayload 128 bytes, MaxReadReq 4096 bytes
                DevSta: CorrErr+ UncorrErr- FatalErr- UnsuppReq+
AuxPwr- TransPend-
                LnkCap: Port #0, Speed 2.5GT/s, Width x4, ASPM L0s L1,
Latency L0 unlimited, L1 unlimited
                        ClockPM- Surprise- LLActRep- BwNot-
                LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 2.5GT/s, Width x4, TrErr- Train-
SlotClk+ DLActive- BWMgmt- ABWMgmt-
                DevCap2: Completion Timeout: Range ABC, TimeoutDis-
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
                LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance-
SpeedDis-, Selectable De-emphasis: -6dB
                         Transmit Margin: Normal Operating Range,
EnterModifiedCompliance- ComplianceSOS-
                         Compliance De-emphasis: -6dB
                LnkSta2: Current De-emphasis Level: -6dB
        Capabilities: [94] Vital Product Data
                Not readable
        Capabilities: [9c] MSI-X: Enable+ Count=32 Masked-
                Vector table: BAR=4 offset=00000000
                PBA: BAR=4 offset=00000800


If you need more info, please let me know what you need and how I can
assist with this.

Thank you,

Bill


More information about the freebsd-net mailing list