SFP+ on PRO/10GbE

[Pieper, Jeffrey E]

You cannot force speed with ix, only force autoneg. You need to use the advertise_speed sysctl for this:

sysctl -d dev.ix.0.advertise_speed
dev.ix.0.advertise_speed:
Control advertised link speed using these flags:
        0x1 - advertise 100M
        0x2 - advertise 1G
        0x4 - advertise 10G
        0x8 - advertise 10M

        100M and 10M are only supported on certain adapters.

Jeff

-----Original Message-----
From: Dan Langille <dan at langille.org> 
Sent: Tuesday, March 24, 2020 2:23 PM
To: Gary Palmer <gpalmer at freebsd.org>
Cc: sthaug <sthaug at nethelp.no>; Pieper, Jeffrey E <jeffrey.e.pieper at intel.com>; freebsd-net at freebsd.org
Subject: Re: SFP+ on PRO/10GbE

On Sun, Mar 22, 2020, at 7:24 PM, Dan Langille wrote:
> On Sun, Mar 22, 2020, at 7:03 PM, Gary Palmer wrote:
> > On Sun, Mar 22, 2020 at 05:11:20PM -0400, Dan Langille wrote:
> > > On Sun, Mar 22, 2020, at 4:43 PM, sthaug at nethelp.no wrote:
> > > > > Partial success.  The card is now able to use an SFP+ optic.  
> > > > > It warns me when the optic is installed:
> > > > > 
> > > > > Mar 22 16:49:45 r720-01 kernel: WARNING: Intel (R) Network Connections are quality tested using Intel (R) Ethernet Optics. Using untested modules is not supported and may cause unstable operation or damage to the module or the adapter. Intel Corporation is not responsible for any harm caused by using untested modules.
> > > > > 
> > > > > I cannot use an SFP+ optic at the switch.  The connection just does not happen.
> > > > > 
> > > > > If I go back to the original SFP optic, the connection occurs, as expected at 1G.
> > > > > 
> > > > > On the switch side, I've tried a known good optic from an existing connection.
> > > > > 
> > > > > I could install an PRO/10GbE instead, that has a built-in 
> > > > > transceiver. I have two of those in use now, both working on 10G.
> > > > 
> > > > Have you tried connected it to something other than the Unifi switch?
> > > 
> > > The only SFP+ capable switches I have are Unifi.
> > > 
> > > I just tried the other switch (US-48) which had one SFP+ port free.  Same issues there.
> > 
> > Did the Unifi switch see the SFP+ optics on the switch end?
> 
> That port never lit up on the switch. I didn't check anything else, 
> switch-related.

I just inserted a 10G transceiver into port 8. It shows up as a 10GBase-SR

Screen shots at https://imgur.com/a/SSEgyxN

At the same time, on the server side, ifconfig indicates:

        status: no carrier
        supported media:
                media autoselect
                media 10Gbase-SR
        nd6 options=23<PERFORMNUD,ACCEPT_RTADV,AUTO_LINKLOCAL>
        plugged: SFP/SFP+/SFP28 10G Base-SR (LC)
        vendor: AVAGO PN: AFBR-703SDZ SN: AD0946A00YB DATE: 2009-11-10
        module temperature: 36.75 C Voltage: 3.32 Volts
        RX: 0.67 mW (-1.72 dBm) TX: 0.56 mW (-2.46 dBm)

I have not yet tried moving from auto-negotiate on both ends.

--
  Dan Langille
  dan at langille.org