[Bug 273043] ofed: GID not created when adding IP address to a VLAN interface

From: <bugzilla-noreply_at_freebsd.org>
Date: Thu, 10 Aug 2023 12:10:54 UTC
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=273043

            Bug ID: 273043
           Summary: ofed: GID not created when adding IP address to a VLAN
                    interface
           Product: Base System
           Version: CURRENT
          Hardware: amd64
                OS: Any
            Status: New
          Severity: Affects Some People
          Priority: ---
         Component: kern
          Assignee: bugs@FreeBSD.org
          Reporter: rafal.michna@gmail.com

Commit hash: 8a5c836b51ce, snapshot from August 3rd

When creating a VLAN interface, a GID is not created for IB devices, which
prevents RDMA traffic through VLAN
This works fine on release branches, both 13.2 and 12.4

14.0:
sys.class.infiniband.irdma-ice0.ports.1.gid_attrs.types.5: IB/RoCE v1
sys.class.infiniband.irdma-ice0.ports.1.gid_attrs.types.4: IB/RoCE v1
sys.class.infiniband.irdma-ice0.ports.1.gid_attrs.types.3: IB/RoCE v1
sys.class.infiniband.irdma-ice0.ports.1.gid_attrs.types.2: RoCE v2
sys.class.infiniband.irdma-ice0.ports.1.gid_attrs.types.1: RoCE v2
sys.class.infiniband.irdma-ice0.ports.1.gid_attrs.types.0: RoCE v2
sys.class.infiniband.irdma-ice0.ports.1.gid_attrs.ndevs.2: ice0
sys.class.infiniband.irdma-ice0.ports.1.gid_attrs.ndevs.1: ice0
sys.class.infiniband.irdma-ice0.ports.1.gid_attrs.ndevs.0: ice0

13.2:
sys.class.infiniband.irdma-ice0.ports.1.gid_attrs.types.7: IB/RoCE v1
sys.class.infiniband.irdma-ice0.ports.1.gid_attrs.types.6: IB/RoCE v1
sys.class.infiniband.irdma-ice0.ports.1.gid_attrs.types.5: RoCE v2
sys.class.infiniband.irdma-ice0.ports.1.gid_attrs.types.4: RoCE v2
sys.class.infiniband.irdma-ice0.ports.1.gid_attrs.types.3: RoCE v2
sys.class.infiniband.irdma-ice0.ports.1.gid_attrs.types.2: RoCE v2
sys.class.infiniband.irdma-ice0.ports.1.gid_attrs.types.1: RoCE v2
sys.class.infiniband.irdma-ice0.ports.1.gid_attrs.types.0: RoCE v2
sys.class.infiniband.irdma-ice0.ports.1.gid_attrs.ndevs.5: vlan104
sys.class.infiniband.irdma-ice0.ports.1.gid_attrs.ndevs.4: vlan104
sys.class.infiniband.irdma-ice0.ports.1.gid_attrs.ndevs.3: vlan104
sys.class.infiniband.irdma-ice0.ports.1.gid_attrs.ndevs.2: ice0
sys.class.infiniband.irdma-ice0.ports.1.gid_attrs.ndevs.1: ice0
sys.class.infiniband.irdma-ice0.ports.1.gid_attrs.ndevs.0: ice0

Example VLAN configuration:

vlan104: flags=1008843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,LOWER_UP> metric
0 mtu 1500
       
options=4600703<RXCSUM,TXCSUM,TSO4,TSO6,LRO,RXCSUM_IPV6,TXCSUM_IPV6,MEXTPG>
        ether 6c:fe:54:41:4a:70
        inet 104.0.0.87 netmask 0xffffff00 broadcast 104.0.0.255
        inet6 104::87 prefixlen 64
        inet6 fe80::6efe:54ff:fe41:4a70%vlan104 prefixlen 64 scopeid 0x6
        groups: vlan
        vlan: 104 vlanproto: 802.1q vlanpcp: 0 parent interface: ice0
        media: Ethernet autoselect (100GBase-CR4 <full-duplex>)
        status: active
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>


MLX is also affected, so it's not a driver issue:

14.0:
sys.class.infiniband.mlx5_0.ports.1.gid_attrs.types.3: RoCE v2
sys.class.infiniband.mlx5_0.ports.1.gid_attrs.types.2: IB/RoCE v1
sys.class.infiniband.mlx5_0.ports.1.gid_attrs.types.1: RoCE v2
sys.class.infiniband.mlx5_0.ports.1.gid_attrs.types.0: IB/RoCE v1
sys.class.infiniband.mlx5_0.ports.1.gid_attrs.ndevs.5: mce0
sys.class.infiniband.mlx5_0.ports.1.gid_attrs.ndevs.4: mce0
sys.class.infiniband.mlx5_0.ports.1.gid_attrs.ndevs.3: mce0
sys.class.infiniband.mlx5_0.ports.1.gid_attrs.ndevs.2: mce0
sys.class.infiniband.mlx5_0.ports.1.gid_attrs.ndevs.1: mce0
sys.class.infiniband.mlx5_0.ports.1.gid_attrs.ndevs.0: mce0

13.2:
sys.class.infiniband.mlx5_0.ports.1.gid_attrs.types.3: RoCE v2
sys.class.infiniband.mlx5_0.ports.1.gid_attrs.types.2: IB/RoCE v1
sys.class.infiniband.mlx5_0.ports.1.gid_attrs.types.1: RoCE v2
sys.class.infiniband.mlx5_0.ports.1.gid_attrs.types.0: IB/RoCE v1
sys.class.infiniband.mlx5_0.ports.1.gid_attrs.ndevs.11: vlan204
sys.class.infiniband.mlx5_0.ports.1.gid_attrs.ndevs.10: vlan204
sys.class.infiniband.mlx5_0.ports.1.gid_attrs.ndevs.9: vlan204
sys.class.infiniband.mlx5_0.ports.1.gid_attrs.ndevs.8: vlan204
sys.class.infiniband.mlx5_0.ports.1.gid_attrs.ndevs.7: vlan204
sys.class.infiniband.mlx5_0.ports.1.gid_attrs.ndevs.6: vlan204
sys.class.infiniband.mlx5_0.ports.1.gid_attrs.ndevs.5: mce0
sys.class.infiniband.mlx5_0.ports.1.gid_attrs.ndevs.4: mce0
sys.class.infiniband.mlx5_0.ports.1.gid_attrs.ndevs.3: mce0
sys.class.infiniband.mlx5_0.ports.1.gid_attrs.ndevs.2: mce0
sys.class.infiniband.mlx5_0.ports.1.gid_attrs.ndevs.1: mce0
sys.class.infiniband.mlx5_0.ports.1.gid_attrs.ndevs.0: mce0

-- 
You are receiving this mail because:
You are the assignee for the bug.