12.2 - Issue with lagg not becoming "ACTIVE"

[Brian Mcgovern (bmcgover)]

I'm running in to a bit of a weird set of circumstances, and I'm guessing its an issue that someone has likely seen before.

So, I have FreeBSD 12.2 running on a Cisco UCS C240 LFF system. In the box, I have an Intel 4 port 10G card, and an Intel 2 port 40G card. I'm using Cisco optics for everything.

The 10G card works fine. Individual interfaces, binding them in to pairs with lagg interfaces, using them for bridges, etc.

The 40G card partially works. As an individual interface, it works fine. If I assign it an IP, or bridge it with the lagg interface on the 10G, it passes traffic fine.

However, when I try to lagg the two 40G ports together, I don't get an "ACTIVE" flag on the lagg interface. I've tried the configuration both with a single-switch LACP port-channel setup, and with a dual-switch VPC port channel.

lagg2: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=e503bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWFILTER,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
        ether 40:a6:b7:16:e2:10
        laggproto lacp lagghash l2,l3,l4
        laggport: ixl4 flags=18<COLLECTING,DISTRIBUTING>
        laggport: ixl5 flags=0<>
        groups: lagg
        media: Ethernet autoselect
        status: active
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>

And yet, the switch side is showing the port as actively participating in the port channel (as port channel 49). Bringing up the second switch (via VPC) has ixl5 going in to COLLECTING,DISTRIBUTING state, but again, no ACTIVE flag.

--------------------------------------------------------------------------------
Group Port-       Type     Protocol  Member Ports
      Channel
--------------------------------------------------------------------------------
5     Po5(SU)     Eth      LACP      Eth1/5(P)    Eth1/6(P)    Eth1/7(P)
                                     Eth1/8(P)
49    Po49(SU)    Eth      LACP      Eth1/49(P)
51    Po51(SU)    Eth      LACP      Eth1/51(P)   Eth1/52(P)

About the only thing I see if interest is that the optics are listed as "Unknown". Otherwise, the flags here match what I'd expect to see.

ixl4: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=e503bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWFILTER,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
        ether 40:a6:b7:16:e2:10
        media: Ethernet autoselect (Unknown <full-duplex>)
        status: active
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>


I'm hoping it may be a bug in the interface code, but I figured I'd ask to see if anyone has any good thoughts and some quick feedback before I start digging in to the code to figure it out.

                -Brian