From nobody Sun Apr 21 13:18:29 2024 X-Original-To: freebsd-amd64@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VMpqK6Fv4z5JC8c for ; Sun, 21 Apr 2024 13:18:37 +0000 (UTC) (envelope-from knueffle@yahoo.com) Received: from sonic307-56.consmr.mail.ne1.yahoo.com (sonic307-56.consmr.mail.ne1.yahoo.com [66.163.190.31]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4VMpqJ4nrQz43NT for ; Sun, 21 Apr 2024 13:18:36 +0000 (UTC) (envelope-from knueffle@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=Fir9FiZr; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of knueffle@yahoo.com designates 66.163.190.31 as permitted sender) smtp.mailfrom=knueffle@yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1713705514; bh=pn5WDIWpYePj7CGexz+jkG8W4Puo4CBZaqlq0rLb8zI=; h=Date:From:To:Subject:References:From:Subject:Reply-To; b=Fir9FiZrIohd2fv39TVFZ1kGIL88KEKJ6rm7m2p7Ibt1X80ZYNjD3WOQSB9e6gquPbH8cmlLhaZVL5V4pu8pjVNpCjA75vWWDABb1xrxvn3j+Q8U38VtRYTM1kEIiV6rVjlZSfrKt8pBljEwJybEd1euot4Cw7bYcRedb3K33I8ZKtqHMMHmIteqyyCDCZBVLeXvIN2/A+WiHWuGrNnC//jZHIfZSbw7qTKwqVxSqaiw7qTAbk5hVRsCGJhhQX6tTS6EtV/UJmuXJsiD8LwdtFzzegWmbiTc+40ZhsDKPjUA6HfdNsSWbPn3vkGgWTK8jaMP7rissAAnCPn3SLB6Yw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1713705514; bh=fg44PpSkUh7jIfhskfWs+IFHDBb17lp0dFlOcZi4afk=; h=X-Sonic-MF:Date:From:To:Subject:From:Subject; b=FX1Q6wH0B5pwKG2Z4BmeRVJXvnQW3VVHibkz4QqFLVHVBMWypE/QBQEI8V3MkYJZZWPc1OGrw+D/3VdMqH8FIzmRHvG8V7AtAx6VgjZl6AqhUe3dmDMYUNs3h0K5fQ7N/Dw0GFm7yZl/9ci+7JZWph3v1oQy3KDfb7yC4wc2nIs0TnDJJi4UCZim3yguAWk5bIuBo9PL4QQWJSW5Zee4xOWqsGvcwGSR0OrImjB3FTmVyArUEuIm68YMscqqX2QT96OJns68oIK1aRDoHn/+1SjcwzLeM80U5SsWxMfHyiacYvSCg2bKijCsfOlRnpKNJLGWMr2tzLU9vgvNWiO9yw== X-YMail-OSG: zfNU0JgVM1ngu.gOX0c9k.knxuIcezPglEN.x1DjoQ7DD7ffk8EyRQ0A57DfH9a ikVPIUNNBOOKG.QffsVCUEE2sbO3oXJX.fbCJ4HKFAuwuEbjBk4ngDKgkfMMi45icZ0K6jYuq_9d s0gMePYnStGPtAsVy90gRxZbGe2oWyqC6JGA49yip1gFkDQpsQ6BDAHZ5YyNqyH2A8jFh69CdcM. u2DEu1BFQYwBdpn9q0tUbnBk12oc17Z8i1NiasS9JmNmSj6..QX_x00x7oaQRMR736wOdNA4_YPP ape8tPsxiYFGCFEWYH5_K6etv9WoRcGqvaa6bh_fGcQAgOyd9hIrvOWK6Nuc3LS.pCCn64QjkAge PVKd4fdlyqsKlmepFRziNiC5qD5XOQWvwjj7OBDxkeHI1GbiHp83wheIxRMoi3OtV97fufSLA9mr XC.hyNSzY_6NVe1xfn9SqxofwIHHRyL5krzLU.dhW5AwzI25fArd00E6J2Vunulu_JvCV8XKOHEW iTv26CnH1iI7q1qHh3LDHSjqsSiaA.q3PtQC3j7DrJ_GpwErZ9H7UqFm8eW9TSfmTqMQvln7mrkQ 25KbqYGuwWdlgiKFn9hJYw6FwiL7ZsEMoxdzSKlNW.Lkaw8HFRPPxrFW.TTnKF6n4RJITgJ6xikc u3bF5a7TBtqq7T1etRHdFLS0g_Wbg2WnjEdYffCnIG_xPRz7UNp1HpRaS22IuvwxXaOB4TjRsKz8 zk0QsCHq6c3iAt1Pqhrtq83Z2awl7uMeF6P28v5jVLcXD_jNdFdy9GXJxrZeD07bSIGDo1R9e51J QwPPOzm9nYTem3CpgnZkIbJyjzv7QiXp.niQA1V_IWinpWRbQIoPmd2e6kNo_ISNhf46QttPzf69 msaVr4vIHcVLP3aWkS7SR9auhkFYun4oepBovGL6cCFXAJ6sD1adjWXosnZBiOjJee4esHnvirWw yNgf.y.tp1rqJUn8I7Fg7v8_c4ALUUGHq5xxWqx7WweZU4C1HMl9lWzsuY8k5Jjq0unX0z2KlQpE 5nf.RbB6AltJwtH9GQTcLb3E.ih9asiAVDA4zCd5IGDFGLQBmztj4b5d_9DYx.yYy_s9ApriK76q qAUAfIOaGdmzm.47lmxy3Q36GzZRJoN1yZ6qlx8wMqwmJZxoTAXAHx82mnQARtMFK0fNhUPOBZZs MdVOuFj8Mqrk4CzguJMMI1.4cZQT7DJp1f2D9uREiufisjHk8LwxODz030oeg3LUJw37XeMVAF2F aGq2QXC.QMKV3WxgMKn8pNlo3Sq_Llaw5zjAkEB6jaqpeUtM_7GoE2LcV1tZvoa9qtVuA0VB35nt KporEgGEacSXtDt.VlKTyOTqOoVoaO1U3tdTeQNWCt1NoFPaAXpBAynSMW8VG16UPLIs2md1k4OS BRJALzWNZoDBXaawjQ7GnsZIBksj6g1x4NmRAds2LdMP6zDS_DOJs0c.tfdP8QyeZ9UxHhQ2z6Mc Ild4UUrWEN.gqSs0MOTP8Iarx.r.NubxrI8Y.NFzUcXSN5fs.GxPu3ONpU8LhPvQtga32i50H76N kcem1R71y3597r8OaGHBzrL.iRcR.YSH1JCQ9RT3mxOg0dVSkn4cJkzkjV5N6ybb0phmM69sFos1 0K12_lbzygW749vvMpcSesok_Eto.EP.KU8Liqb1Ja9wELQZ.rRcjhhQZk7prEPZ_a5lIE13o0nh rOFuIVmGKmLXRTatmd2CDJDLaZenRv29w0KB3PfELWb3r6wiH3Q7vQyUJjedQ98ei82FGhA1nrNV bw5AtFY5s94VBn_gVbyYhHjKlx_gC.f.heqPkXUrBBTyvcs0B4Ud4T34Is1F3KEbF_Gc0197rFA. chAIiYLjc6KYL._A4r9xkspl03VtVNTKahYvkjy3XmxnidO.6iQvqyFWbQ1Ohl_ZL2eon2z4qgki h1AT4gcwWHvbsnoifqJCZY36CS9VKhFBwZaheznPwqG50teeruNiyXEBQyKbGCyLEoPYGhpcbcwv Tm1380LCTLpBUfOmegz7hI_RrqzbcHkyW_80U8JoLec1ENp1NWn6pLjP93W9lE3dETa0BDJC7sAu .7Dnp3J8XsJRmO7.sJR1F1WUowXE6a5T7ODQDcAM2vFKOXxYvBPuFJzpEIhuurU7QSAJqp7NitkN ybbMYQ31I9D7TOQB0.hx5lvzZ2T3nYzMjm2q7nQGi7aXe4tVmQUoSh_XNhkBRPLPGsYOlulSO X-Sonic-MF: X-Sonic-ID: c736ed9a-661a-461c-bae4-e54c54da7005 Received: from sonic.gate.mail.ne1.yahoo.com by sonic307.consmr.mail.ne1.yahoo.com with HTTP; Sun, 21 Apr 2024 13:18:34 +0000 Date: Sun, 21 Apr 2024 13:18:29 +0000 (UTC) From: Jody Gugelhupf To: "freebsd-amd64@freebsd.org" Message-ID: <558198245.1841549.1713705509330@mail.yahoo.com> Subject: AMD nic v3000 driver issue? List-Id: Porting FreeBSD to the AMD64 platform List-Archive: https://lists.freebsd.org/archives/freebsd-amd64 List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-amd64@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable References: <558198245.1841549.1713705509330.ref@mail.yahoo.com> X-Mailer: WebService/1.1.22256 YMailNorrin X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.33 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-0.33)[-0.334]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; ARC_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; RCPT_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+]; TO_DN_EQ_ADDR_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MLMMJ_DEST(0.00)[freebsd-amd64@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; MID_RHS_MATCH_FROMTLD(0.00)[]; ASN(0.00)[asn:36646, ipnet:66.163.184.0/21, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[66.163.190.31:from]; RCVD_COUNT_ONE(0.00)[1]; RCVD_IN_DNSWL_NONE(0.00)[66.163.190.31:from] X-Rspamd-Queue-Id: 4VMpqJ4nrQz43NT Hi, I have a baremetal pc on which i'm trying to get the onboard 2 sfp+ ports t= o work. I tried with a freebsd 13.2 install and freebsd 14 livecd. Also tes= ted with ubuntu, where everything works fine with the same setup of cables = etc. With freebsd the sfp+ ports are recognized, but not sure what is going= on, although cables are connected, no matter what i try, i get: status: no= carrier. I had some help & suggestions on IRC, I was told it could be a dr= iver bug. I'm familiar with Linux but new to *bsd, so tried to collect rele= vant information in the hope to get it working or correct my mistakes. full dmesg output from freebsd 14 live usb medium boot: https://pastebin.co= m/6UGzidXq partial dmesg output on freebsd 14 for sfp+ nics:=C2=A0 Code: ax0: xgbe_phy_sfp_signals: port_sfp_inputs: 0x0 ax0: SFP detected: ax= 0: vendor: OEM ax0: part number: SFP-H10GB-CU5M ax0: revision level: 09 ax0= : serial number: CSC231202820016 ax1: xgbe_phy_sfp_signals: port_sfp_inputs= : 0x7 ax1: xgbe_phy_sfp_detect: mod absent ax1: xgbe_phy_sfp_signals: port_= sfp_inputs: 0x2 ax1: SFP detected: ax1: vendor: Walsun ax1: part number: HX= SX-ATRI-1 ax1: revision level: 1.0 ax1: serial number: H230S014913 ax1: xgb= e_phy_sfp_signals: port_sfp_inputs: 0x0 I can configure ax0 or ax1 fine and= bring them also up but it will show 'no carrier' in ifconfig Code: ax0: fl= ags=3D8867 metric 0 mtu 1500 description: OPT1 (opt1) options=3D4e0032b eth= er d0:63:b4:05:47:43 inet 10.133.120.125 netmask 0xffffff00 broadcast 10.13= 3.120.255 media: Ethernet autoselect status: no carrier nd6 options=3D29 ax= 1: flags=3D8867 metric 0 mtu 1500 description: LANSFP (opt1) options=3D4e00= 32b ether d0:63:b4:05:47:44 media: Ethernet autoselect status: no carrier n= d6 options=3D29 when I check with tcpdump on the baremetal pc and ping it f= rom my other arch linux on the local lan i see this: Code: tcpdump --interf= ace ax0 tcpdump: verbose output suppressed, use -v or -vv for full protocol= decode listening on ax0, link-type EN10MB (Ethernet), capture size 262144 = bytes 21:28:10.551283 IP6 fe80::3efd:feff:fe9e:cb7c > ff02::16: HBH ICMP6, = multicast listener report v2, 4 group record(s), length 88 21:28:11.287919 = IP6 fe80::3efd:feff:fe9e:cb7c > ff02::16: HBH ICMP6, multicast listener rep= ort v2, 4 group record(s), length 88 21:28:11.821977 IP6 fe80::3efd:feff:fe= 9e:cb7c > ff02::2: ICMP6, router solicitation, length 16 21:28:12.287909 LL= DP, length 69 21:28:13.284656 LLDP, length 69 21:28:14.281404 LLDP, length = 69 21:28:15.278147 LLDP, length 69 21:28:15.586787 IP6 fe80::3efd:feff:fe9e= :cb7c > ff02::2: ICMP6, router solicitation, length 16 21:28:16.053341 IP 1= 0.133.120.5.38313 > 239.255.255.250.ssdp: UDP, length 101 21:28:16.053354 I= P 10.133.120.5.33435 > 239.255.255.250.ssdp: UDP, length 101 21:28:16.05336= 3 IP 10.133.120.3.59149 > 239.255.255.250.ssdp: UDP, length 101 21:28:16.05= 3382 IP 10.133.120.4.33015 > 239.255.255.250.ssdp: UDP, length 101 21:28:16= .053388 IP 10.133.120.3.51253 > 239.255.255.250.ssdp: UDP, length 101 21:28= :16.053391 IP 10.133.120.4.44274 > 239.255.255.250.ssdp: UDP, length 101 21= :28:20.901812 IP 10.133.120.3.59695 > 239.255.255.250.ssdp: UDP, length 129= 21:28:20.901941 IP 10.133.120.4.48273 > 239.255.255.250.ssdp: UDP, length = 129 21:28:20.902080 IP 10.133.120.5.39369 > 239.255.255.250.ssdp: UDP, leng= th 129 21:28:21.102922 IP 10.133.120.3.59695 > 239.255.255.250.ssdp: UDP, l= ength 129 21:28:21.103053 IP 10.133.120.4.48273 > 239.255.255.250.ssdp: UDP= , length 129 21:28:21.103188 IP 10.133.120.5.39369 > 239.255.255.250.ssdp: = UDP, length 129 21:28:21.302014 IP 10.133.120.3.59695 > 239.255.255.250.ssd= p: UDP, length 129 21:28:21.302027 IP 10.133.120.4.48273 > 239.255.255.250.= ssdp: UDP, length 129 21:28:21.302152 IP 10.133.120.5.39369 > 239.255.255.2= 50.ssdp: UDP, length 129 21:28:23.113808 IP6 fe80::3efd:feff:fe9e:cb7c > ff= 02::16: HBH ICMP6, multicast listener report v2, 4 group record(s), length = 88 21:28:23.821144 IP6 fe80::3efd:feff:fe9e:cb7c > ff02::2: ICMP6, router s= olicitation, length 16 21:28:24.037080 IP6 fe80::3efd:feff:fe9e:cb7c > ff02= ::16: HBH ICMP6, multicast listener report v2, 4 group record(s), length 88= 21:28:26.053695 IP 10.133.120.3.34175 > 239.255.255.250.ssdp: UDP, length = 101 21:28:26.053703 IP 10.133.120.5.40299 > 239.255.255.250.ssdp: UDP, leng= th 101 21:28:26.053713 IP 10.133.120.4.42403 > 239.255.255.250.ssdp: UDP, l= ength 101 21:28:27.473666 IP6 fe80::3efd:feff:fe9e:cb7c > ff02::2: ICMP6, r= outer solicitation, length 16 21:28:34.769972 IP6 fe80::3efd:feff:fe9e:cb7c= > ff02::2: ICMP6, router solicitation, length 16 21:28:35.573080 IP6 fe80:= :3efd:feff:fe9e:cb7c > ff02::16: HBH ICMP6, multicast listener report v2, 4= group record(s), length 88 21:28:36.053367 IP 10.133.120.3.48149 > 239.255= .255.250.ssdp: UDP, length 101 21:28:36.053383 IP 10.133.120.4.59157 > 239.= 255.255.250.ssdp: UDP, length 101 21:28:36.053391 IP 10.133.120.5.52090 > 2= 39.255.255.250.ssdp: UDP, length 101 21:28:36.166390 IP6 fe80::3efd:feff:fe= 9e:cb7c > ff02::16: HBH ICMP6, multicast listener report v2, 4 group record= (s), length 88 21:28:36.820373 IP6 fe80::3efd:feff:fe9e:cb7c > ff02::2: ICM= P6, router solicitation, length 16 21:28:37.206600 LLDP, length 69 21:28:38= .203331 LLDP, length 69 21:28:39.200100 LLDP, length 69 21:28:40.196843 LLD= P, length 69 21:28:40.943626 IP6 fe80::3efd:feff:fe9e:cb7c > ff02::2: ICMP6= , router solicitation, length 16 21:28:46.053949 IP 10.133.120.3.60867 > 23= 9.255.255.250.ssdp: UDP, length 101 21:28:46.053966 IP 10.133.120.4.38949 >= 239.255.255.250.ssdp: UDP, length 101 21:28:46.053970 IP 10.133.120.5.4733= 2 > 239.255.255.250.ssdp: UDP, length 101 21:28:46.053973 IP 10.133.120.3.5= 1494 > 239.255.255.250.ssdp: UDP, length 101 21:28:46.053976 IP 10.133.120.= 4.55277 > 239.255.255.250.ssdp: UDP, length 101 21:28:46.053984 IP 10.133.1= 20.5.38689 > 239.255.255.250.ssdp: UDP, length 101 21:28:48.142246 IP6 fe80= ::3efd:feff:fe9e:cb7c > ff02::16: HBH ICMP6, multicast listener report v2, = 4 group record(s), length 88 21:28:48.592245 IP6 fe80::3efd:feff:fe9e:cb7c = > ff02::16: HBH ICMP6, multicast listener report v2, 4 group record(s), len= gth 88 21:28:48.819592 IP6 fe80::3efd:feff:fe9e:cb7c > ff02::2: ICMP6, rout= er solicitation, length 16 ^C 51 packets captured 51 packets received by fi= lter 0 packets dropped by kernel tested a few thing, below snippet includes ifconfig ouput, then I bring the= sfp+ devices up, assign static IPs and try to ping the other machine to wh= ich it is connected and in between ifconfig outputs: https://pastebin.com/S= gztQzjE Here some output from working ubuntu in case it helps in some way lspci out= put from working ubuntu Code: 0a:00.2 Ethernet controller: Advanced Micro D= evices, Inc. [AMD] Device 1458 Subsystem: Advanced Micro Devices, Inc. [AMD= ] Device 1458 Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- P= arErr- Stepping- SERR- FastB2B- DisINTx+ Status: Cap+ 66MHz- UDF- FastB2B- = ParErr- DEVSEL=3Dfast >TAbort- SERR- Capabilities: [50] Power Management ve= rsion 3 Flags: PMEClk- DSI- D1- D2- AuxCurrent=3D0mA PME(D0-,D1-,D2-,D3hot-= ,D3cold-) Status: D0 NoSoftRst+ PME-Enable- DSel=3D0 DScale=3D0 PME- Capabi= lities: [64] Express (v2) Endpoint, MSI 00 DevCap: MaxPayload 256 bytes, Ph= antFunc 0, Latency L0s <4us, L1 unlimited ExtTag+ AttnBtn- AttnInd- PwrInd-= RBE+ FLReset- SlotPowerLimit 0W DevCtl: CorrErr- NonFatalErr- FatalErr- Un= supReq- RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop+ MaxPayload 256 bytes, = MaxReadReq 512 bytes DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxP= wr- TransPend- LnkCap: Port #0, Speed 16GT/s, Width x16, ASPM L0s L1, Exit = Latency L0s <64ns, L1 <1us ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp+= LnkCtl: ASPM Disabled; RCB 64 bytes, Disabled- CommClk+ ExtSynch- ClockPM-= AutWidDis- BWInt- AutBWInt- LnkSta: Speed 16GT/s, Width x16 TrErr- Train- = SlotClk+ DLActive- BWMgmt- ABWMgmt- DevCap2: Completion Timeout: Range ABCD= , TimeoutDis+ NROPrPrP- LTR- 10BitTagComp+ 10BitTagReq- OBFF Not Supported,= ExtFmt- EETLPPrefix- EmergencyPowerReduction Not Supported, EmergencyPower= ReductionInit- FRS- TPHComp- ExtTPHComp- AtomicOpsCap: 32bit- 64bit- 128bit= CAS- DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- LTR- 10BitTagRe= q- OBFF Disabled, AtomicOpsCtl: ReqEn- LnkSta2: Current De-emphasis Level: = -3.5dB, EqualizationComplete- EqualizationPhase1- EqualizationPhase2- Equal= izationPhase3- LinkEqualizationRequest- Retimer- 2Retimers- CrosslinkRes: u= nsupported Capabilities: [a0] MSI: Enable- Count=3D1/8 Maskable- 64bit+ Add= ress: 0000000000000000 Data: 0000 Capabilities: [c0] MSI-X: Enable+ Count= =3D7 Masked- Vector table: BAR=3D2 offset=3D00000000 PBA: BAR=3D2 offset=3D= 00001000 Capabilities: [100 v1] Vendor Specific Information: ID=3D0001 Rev= =3D1 Len=3D010 Capabilities: [2a0 v1] Access Control Services ACSCap: SrcVa= lid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans- = ACSCtl: SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- = DirectTrans- Kernel driver in use: amd-xgbe Kernel modules: amd_xgbe 0a:00.= 3 Ethernet controller: Advanced Micro Devices, Inc. [AMD] Device 1458 Subsy= stem: Advanced Micro Devices, Inc. [AMD] Device 1458 Control: I/O- Mem+ Bus= Master+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisI= NTx+ Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=3Dfast >TAbort- SERR-= Capabilities: [50] Power Management version 3 Flags: PMEClk- DSI- D1- D2- = AuxCurrent=3D0mA PME(D0-,D1-,D2-,D3hot-,D3cold-) Status: D0 NoSoftRst+ PME-= Enable- DSel=3D0 DScale=3D0 PME- Capabilities: [64] Express (v2) Endpoint, = MSI 00 DevCap: MaxPayload 256 bytes, PhantFunc 0, Latency L0s <4us, L1 unli= mited ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset- SlotPowerLimit 0W Dev= Ctl: CorrErr- NonFatalErr- FatalErr- UnsupReq- RlxdOrd+ ExtTag+ PhantFunc- = AuxPwr- NoSnoop+ MaxPayload 256 bytes, MaxReadReq 512 bytes DevSta: CorrErr= - NonFatalErr- FatalErr- UnsupReq- AuxPwr- TransPend- LnkCap: Port #0, Spee= d 16GT/s, Width x16, ASPM L0s L1, Exit Latency L0s <64ns, L1 <1us ClockPM- = Surprise- LLActRep- BwNot- ASPMOptComp+ LnkCtl: ASPM Disabled; RCB 64 bytes= , Disabled- CommClk+ ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt- LnkSta:= Speed 16GT/s, Width x16 TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt- = DevCap2: Completion Timeout: Range ABCD, TimeoutDis+ NROPrPrP- LTR- 10BitTa= gComp+ 10BitTagReq- OBFF Not Supported, ExtFmt- EETLPPrefix- EmergencyPower= Reduction Not Supported, EmergencyPowerReductionInit- FRS- TPHComp- ExtTPHC= omp- AtomicOpsCap: 32bit- 64bit- 128bitCAS- DevCtl2: Completion Timeout: 50= us to 50ms, TimeoutDis- LTR- 10BitTagReq- OBFF Disabled, AtomicOpsCtl: ReqE= n- LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete- Equali= zationPhase1- EqualizationPhase2- EqualizationPhase3- LinkEqualizationReque= st- Retimer- 2Retimers- CrosslinkRes: unsupported Capabilities: [a0] MSI: E= nable- Count=3D1/8 Maskable- 64bit+ Address: 0000000000000000 Data: 0000 Ca= pabilities: [c0] MSI-X: Enable+ Count=3D7 Masked- Vector table: BAR=3D2 off= set=3D00000000 PBA: BAR=3D2 offset=3D00001000 Capabilities: [100 v1] Vendor= Specific Information: ID=3D0001 Rev=3D1 Len=3D010 Capabilities: [2a0 v1] A= ccess Control Services ACSCap: SrcValid- TransBlk- ReqRedir- CmpltRedir- Up= streamFwd- EgressCtrl- DirectTrans- ACSCtl: SrcValid- TransBlk- ReqRedir- C= mpltRedir- UpstreamFwd- EgressCtrl- DirectTrans- Kernel driver in use: amd-= xgbe Kernel modules: amd_xgbe ethtool output on ubuntu Code: Settings for e= np10s0f2: Supported ports: [ TP ] Supported link modes: 10000baseCR/Full Su= pported pause frame use: No Supports auto-negotiation: No Supported FEC mod= es: Not reported Advertised link modes: 10000baseCR/Full Advertised pause f= rame use: No Advertised auto-negotiation: No Advertised FEC modes: Not repo= rted Speed: 10000Mb/s Duplex: Full Auto-negotiation: off Port: None PHYAD: = 0 Transceiver: internal Current message level: 0x00000034 (52) link ifdown = ifup Link detected: yes Settings for enp10s0f3: Supported ports: [ FIBRE ] = Supported link modes: 10000baseSR/Full Supported pause frame use: No Suppor= ts auto-negotiation: No Supported FEC modes: Not reported Advertised link m= odes: 10000baseSR/Full Advertised pause frame use: No Advertised auto-negot= iation: No Advertised FEC modes: Not reported Speed: 10000Mb/s Duplex: Full= Auto-negotiation: off Port: None PHYAD: 0 Transceiver: internal Current me= ssage level: 0x00000034 (52) link ifdown ifup Link detected: yes ethtool -i= enp10s0f2 driver: amd-xgbe version: 6.2.0-39-generic firmware-version: 19.= 118.48 expansion-rom-version: bus-info: 0000:0a:00.2 supports-statistics: y= es supports-test: no supports-eeprom-access: no supports-register-dump: no = supports-priv-flags: no ethtool -i enp10s0f3 driver: amd-xgbe version: 6.2.= 0-39-generic firmware-version: 19.118.48 expansion-rom-version: bus-info: 0= 000:0a:00.3 supports-statistics: yes supports-test: no supports-eeprom-acce= ss: no supports-register-dump: no supports-priv-flags: no ifconfig entries = for sfp+ nic's on ubuntu, I setup a static network to test connectivity wit= h another local arch linux server on local lan: Code: enp10s0f2: flags=3D41= 63 mtu 1500 inet 10.133.120.11 netmask 255.255.255.0 broadcast 10.133.120.2= 55 inet6 fe80::d263:b4ff:fe05:4743 prefixlen 64 scopeid 0x20 ether d0:63:b4= :05:47:43 txqueuelen 1000 (Ethernet) RX packets 2 bytes 128 (128.0 B) RX er= rors 0 dropped 0 overruns 0 frame 0 TX packets 59 bytes 4448 (4.4 KB) TX er= rors 0 dropped 0 overruns 0 carrier 0 collisions 0 device interrupt 43 enp1= 0s0f3: flags=3D4163 mtu 1500 inet 10.133.120.12 netmask 255.255.255.0 broad= cast 10.133.120.255 inet6 fe80::d263:b4ff:fe05:4744 prefixlen 64 scopeid 0x= 20 ether d0:63:b4:05:47:44 txqueuelen 1000 (Ethernet) RX packets 1352 bytes= 92127 (92.1 KB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 47 byt= es 3975 (3.9 KB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 de= vice interrupt 58 ubuntu lshw network devices info: Code: lshw -class netwo= rk *-network description: Wireless interface product: Wi-Fi 6 AX210/AX211/A= X411 160MHz vendor: Intel Corporation physical id: 0 bus info: pci@0000:03:= 00.0 logical name: wlp3s0 version: 1a serial: 2c:33:58:f3:cc:4e width: 64 b= its clock: 33MHz capabilities: pm msi pciexpress msix bus_master cap_list e= thernet physical wireless configuration: broadcast=3Dyes driver=3Diwlwifi d= riverversion=3D6.2.0-39-generic firmware=3D72.a764baac.0 ty-a0-gf-a0-72.uc = latency=3D0 link=3Dno multicast=3Dyes wireless=3DIEEE 802.11 resources: irq= :113 memory:fcd00000-fcd03fff *-network description: Ethernet interface pro= duct: Intel Corporation vendor: Intel Corporation physical id: 0 bus info: = pci@0000:04:00.0 logical name: enp4s0 version: 04 serial: d0:63:b4:05:47:3f= capacity: 1Gbit/s width: 32 bits clock: 33MHz capabilities: pm msi msix pc= iexpress bus_master cap_list rom ethernet physical tp 10bt 10bt-fd 100bt 10= 0bt-fd 1000bt-fd autonegotiation configuration: autonegotiation=3Don broadc= ast=3Dyes driver=3Digc driverversion=3D6.2.0-39-generic firmware=3D2022:889= d latency=3D0 link=3Dno multicast=3Dyes port=3Dtwisted pair resources: irq:= 37 memory:fc900000-fc9fffff memory:fca00000-fca03fff memory:fc800000-fc8fff= ff *-network description: Ethernet interface product: Intel Corporation ven= dor: Intel Corporation physical id: 0 bus info: pci@0000:05:00.0 logical na= me: enp5s0 version: 04 serial: d0:63:b4:05:47:40 capacity: 1Gbit/s width: 3= 2 bits clock: 33MHz capabilities: pm msi msix pciexpress bus_master cap_lis= t rom ethernet physical tp 10bt 10bt-fd 100bt 100bt-fd 1000bt-fd autonegoti= ation configuration: autonegotiation=3Don broadcast=3Dyes driver=3Digc driv= erversion=3D6.2.0-39-generic firmware=3D2022:889d latency=3D0 link=3Dno mul= ticast=3Dyes port=3Dtwisted pair resources: irq:37 memory:fc600000-fc6fffff= memory:fc700000-fc703fff memory:fc500000-fc5fffff *-network description: E= thernet interface product: Intel Corporation vendor: Intel Corporation phys= ical id: 0 bus info: pci@0000:06:00.0 logical name: enp6s0 version: 04 seri= al: d0:63:b4:05:47:41 capacity: 1Gbit/s width: 32 bits clock: 33MHz capabil= ities: pm msi msix pciexpress bus_master cap_list rom ethernet physical tp = 10bt 10bt-fd 100bt 100bt-fd 1000bt-fd autonegotiation configuration: autone= gotiation=3Don broadcast=3Dyes driver=3Digc driverversion=3D6.2.0-39-generi= c firmware=3D2022:889d latency=3D0 link=3Dno multicast=3Dyes port=3Dtwisted= pair resources: irq:78 memory:fc300000-fc3fffff memory:fc400000-fc403fff m= emory:fc200000-fc2fffff *-network description: Ethernet interface product: = Intel Corporation vendor: Intel Corporation physical id: 0 bus info: pci@00= 00:07:00.0 logical name: enp7s0 version: 04 serial: d0:63:b4:05:47:42 capac= ity: 1Gbit/s width: 32 bits clock: 33MHz capabilities: pm msi msix pciexpre= ss bus_master cap_list rom ethernet physical tp 10bt 10bt-fd 100bt 100bt-fd= 1000bt-fd autonegotiation configuration: autonegotiation=3Don broadcast=3D= yes driver=3Digc driverversion=3D6.2.0-39-generic firmware=3D2022:889d late= ncy=3D0 link=3Dno multicast=3Dyes port=3Dtwisted pair resources: irq:78 mem= ory:fc000000-fc0fffff memory:fc100000-fc103fff memory:fbf00000-fbffffff *-n= etwork:0 description: Ethernet interface product: Advanced Micro Devices, I= nc. [AMD] vendor: Advanced Micro Devices, Inc. [AMD] physical id: 0.2 bus i= nfo: pci@0000:0a:00.2 logical name: enp10s0f2 version: 00 serial: d0:63:b4:= 05:47:43 size: 10Gbit/s width: 64 bits clock: 33MHz capabilities: pm pciexp= ress msi msix bus_master cap_list ethernet physical tp configuration: auton= egotiation=3Doff broadcast=3Dyes driver=3Damd-xgbe driverversion=3D6.2.0-39= -generic duplex=3Dfull firmware=3D19.118.48 ip=3D10.133.120.11 latency=3D0 = link=3Dyes multicast=3Dyes speed=3D10Gbit/s resources: irq:42 memory:fcb600= 00-fcb7ffff memory:fcb40000-fcb5ffff memory:fcb82000-fcb83fff *-network:1 d= escription: Ethernet interface product: Advanced Micro Devices, Inc. [AMD] = vendor: Advanced Micro Devices, Inc. [AMD] physical id: 0.3 bus info: pci@0= 000:0a:00.3 logical name: enp10s0f3 version: 00 serial: d0:63:b4:05:47:44 s= ize: 10Gbit/s width: 64 bits clock: 33MHz capabilities: pm pciexpress msi m= six bus_master cap_list ethernet physical fibre configuration: autonegotiat= ion=3Doff broadcast=3Dyes driver=3Damd-xgbe driverversion=3D6.2.0-39-generi= c duplex=3Dfull firmware=3D19.118.48 ip=3D10.133.120.12 latency=3D0 link=3D= yes multicast=3Dyes speed=3D10Gbit/s resources: irq:50 memory:fcb20000-fcb3= ffff memory:fcb00000-fcb1ffff memory:fcb80000-fcb81fff