[cxgb] Chelsio T304 quad gig pcie adapter TSO disabled

[Navdeep Parhar]

On Mon, Oct 11, 2010 at 12:56:55AM -0400, Bill Desjardins wrote:
> Hi All,
> 
> I have a couple Chelsio T304 quad gigabit nics that are going into
> iscsi servers. I got these for the TOE capabilities, but I found in
> the cxgb driver code that it is explicitly disabled for > 2 port nics
> (line 1036 : /usr/src/sys/dev/cxgb/cxgb_main.c) . The current cxgb
> driver is based on the chelsio 7.8.0 firmware (11/25/09), but chelsio
> is up to 7.11.0 (07/20/10). I had updated the firmware using cxgbtool
> to 7.11, but received complaints from the driver to 'upgrade' to
> 7.8.0, which I did.
> 
> my question is, is if the cxgb driver is being worked on to update to
> latest chelsio firmware and/or fix TSO for the quad port cards? I
> don't have the programming skill's to assist with that side of things,
> but I can easily provide a remote spare machine with a serial console
> for development and testing if its helpful.

Hello Bill,

TSO is not supported on the T304 (not even with the 7.11.0 firmware).
This is a 4 x gigabit card and you'll be able to max it out in either
direction without TSO.


> cxgbc0: Insufficient clusters and/or jumbo buffers.
> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^????

^^ this indicates you need to bump up the number of clusters and
jumbos.  Do so in /boot/loader.conf if you load if_cxgb early, or in
/etc/sysctl.conf if you load it after the system has booted up:

/boot/loader.conf:
kern.ipc.nmbclusters=262144

/etc/sysctl.conf:
kern.ipc.nmbclusters=262144
kern.ipc.nmbjumbo9=262144
kern.ipc.nmbjumbo16=262144

Regards,
Navdeep