From nobody Thu Jul 25 16:45:19 2024 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4WVGw42bfKz5SL5N for ; Thu, 25 Jul 2024 16:45:24 +0000 (UTC) (envelope-from karl@denninger.net) Received: from colo1.denninger.net (colo1.denninger.net [104.236.120.189]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4WVGw33Rf3z4q1B for ; Thu, 25 Jul 2024 16:45:23 +0000 (UTC) (envelope-from karl@denninger.net) Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=denninger.net; spf=pass (mx1.freebsd.org: domain of karl@denninger.net designates 104.236.120.189 as permitted sender) smtp.mailfrom=karl@denninger.net Received: from denninger.net (syn-096-033-195-197.res.spectrum.com [96.33.195.197]) by colo1.denninger.net (Postfix) with ESMTP id C4FC92110D6; Thu, 25 Jul 2024 12:45:35 -0400 (EDT) Received: from [192.168.10.28] (D18.Denninger.Net [192.168.10.28]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by denninger.net (Postfix) with ESMTPSA id D4B77388019; Thu, 25 Jul 2024 12:45:20 -0400 (EDT) Message-ID: Date: Thu, 25 Jul 2024 12:45:19 -0400 List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Content-Language: en-US To: freebsd-net@freebsd.org From: Karl Denninger Subject: Mellanox Connect 10GigE PCI card supported? Autocrypt: addr=karl@denninger.net; keydata= xsFNBF1Rd+gBEACmLAH7SAzdQq57ZN56QQEy0jDFfH5BvGOMZgCaP+Y5lJQ5u9WphCoCALMs Rg0o1Q9DRNWgUmy/cgsxioXAEzZFXXzOHPJhwplVOgfjxnoByD5KQhWG8Owm9QmATdtiZPSV 4UYVNUIbZv7btSnnAXysG2OUHajYS5PVeFQxFbhNFq/SS8VaXr1WEVTFa8NFKp2W3/KY1A+U KKDUlYwnOauK3fnY9chF2IRSoxAbBJFrJ4lPGz04HtzNos4Q9CBfTphKcdFjcPntNS9wrqs3 sm+7hLNTH9B2Kj6aekG5UhD03eyP+gevTgBy51RL6ULzI13Kc4aeyOByuBXrA8D2m2Ee67iy 4+ZSxM9Wn1gQce5624OWzCYIGBH2r75Bshp1KHKu36N2rN//kyKYnwl/z6UZB/S9cMUFKZgL gFx7QxpFX/HvSiBcPfcGS0meModpg6qma7/2jRoQAXacslpiT+uOfRGspNbnglkbw435RzX/ kMUclJQNZBBBUpPiGjVCjeBTiAfN8TyjS+pWzwxNCUZWbYO5xVaS0gbIhgVNoBOGn1rdTsdA PP65SRjaoL5KY6bzkkzrXLB2Djx8/p4vr0qIqxIQWbewJq3xKyKGiqI46ae77BF7k0B++Ndx g9K9UeWKl/iJ0eoI0ftR+xH3aIHTU1Or3j/tj4j8Z0tnVSyt1wARAQABzSNLYXJsIERlbm5p bmdlciA8a2FybEBkZW5uaW5nZXIubmV0PsLBfwQTAQgAKQUCZj4NhwIbIwUJDK6K2AcLCQgH AwIBBhUIAgkKCwQWAgMBAh4BAheAAAoJEG8twBXrj1l42DQP/A0AGcBuGhHzGh2aFyW94B29 ECEkmkxigmQt++AG9xr3Qv4gC6UtSGzKo50SWAdek5peBRTbeDALa/tQvBsbi2aJgYWxZVOV N2XLe89ZjvJuTZqXaG/iaV50es56/cWBlG7VR+5/ijw3uSWO6gZ+L5bkKnQ/p8OWUP0GbtV1 rmEL4DOf6Sel7vOHGLIOgppMxH3DqAgHINZPhOBn/ySnFYNRUyUzp+DxKweH3/6UT8kLST4z UykLcb6HCXEkPM8ECyXkQacE6AfSsrj+tpDv97ZU9UzfprMGY8MmtpACc2509YhdDgljoaGq dfC2//HDKjEt31apoiKwQ9x2oqDBRtkRJoSuqC+rxRDGYMFdxRUBTEJ/j/P3EJdqCO128Jb+ 2iw+0ERUqMyPJWpRXb+J/zdo4ge5RP39LreyNhblEF3aKIvNMj+KrGwznB0Muny8uP73O/bw w7Nkj6HuXbq9gZ1jV6WqHzP9seadWpxLhcR8UQZqgFbO7Q4Y1Lj7TWt/cEoGXe5TeBGO8/b/ Q0g+LF0+/waARlk9dwVx5vBol4ZJ4gDEwzZD6IqDYB5Knenv/wWAdK7WrzLqP4zBzU5vwpJ+ Aj8i+lkqGcaCdtMdRZpa3qR68eKgutuVCzCt3Ydt2Oeiz/D0ccI++FzJgqfD+r4B1pjWT/V3 SRerR30au23XzsFNBF1Rd+gBEADNVFS8nQ+kpKOpgtP+f3bCVxHAm7eHMbX6oew5yZiQwfD+ 1RWNWLVOMeTt7G2e5HsHpJOUwFUJhbDb0omB0r38xTSVSAig9kmUfb7tTMJG2bG7WfWykBOM WIZ4OhCf+ISv9dUkjNgx4ionWotFxwDiPRwWumVQ7WYZmRZlhDWMiaHgKvBrjJ7Y6GKPRbQc 5/0Qz9xGhXKlFxDQrrSMkyRThIOxXqdfD9z3rEsV3ZwOojzNsnkIImnQMKyIAR0FBQop34G9 wDQi7fxk8wGIfDszwfR4oAdDdPGq4gcAvE7Fd3xKyNpGyjSED5szoaFjldaZSXQIffquSUvy sFCTTLRIso5Dn9uQgi57gIv+5mnyKBfm2Z2P6pEQPSt073TED9rS0+JpniJL7rKRVpO5niqw sQJS6ht+JF88rXro+SiwxD/KeDpTuuJ10+ohLVi1Y+X82X7BIQEhqtFp9FVJSds4o/eNyaHd SoqfoeWMy3EV+rdJ3DneXcPS1BgxO57Rko5Hx3NUSVK83ovFb+Ofes9SLNdqNu3xAUcfpRdS DyxzpVbCq6Y2CIojiaweiYe5BOBhmR9OPGhqP8YD7GukYmQufAVuOrIVyctBlVPHgMBb+UX+ ItYXuX4weSJWLOsmM45xd/EYvBq2DWFpKlyihoktNzTGqxGsNeG7gCOEUTAnUwARAQABwsFl BBgBCAAPBQJmPg2HAhsMBQkMrorYAAoJEG8twBXrj1l4s28P/icoshBPgHA86zWSiBYWtR4M TXbg86Yo5tMm64gO2ipXHlDnS0fQOjkJvfo+1e8soq0Rf4RxvKGEDLF9sxLD3z0ptF4Lj8aN zddLPlWFUZ9iOGbDGZhdvnB6YfCWEOXnkXJHfdheYOd/cni54Y4MT1sPMUiPGDlB4Fpu1voL wMZdGfplQYuV+zYv2ezd6Aoc/YwmhixX3YSjy6vFa+7x8OXrGUK69XaZ649GGHpeZzYuLTPw jAfCjbYBk9a24GtQlO/sk9SHRlxIU1e/AflNMtOMYDwuEDLuPgTLe4pRt4lnSdnQSVsFoYz1 nO7XBtyJdUa2rrhcLfhmSxlbJF/4cmNB4ebyT+5v+9ChpMVqzpKBCjyxPm4s+WVq4aYQ7D24 caCcUknD82iMFDFvbV0dm/xAQKZ3k+L/apMhHtUS23dzhJemxWdeQ6Cs2l0FYoGtrEzfUguR Hj7U3opGU6F4dnH1nQt4CbaXAOXM2Zh4ik+z5xRv9ro7fZUG8KSaz8dHKc2scpnJsqdS5XEk NwcHQUCCwSOEPzbugPJY1vjkjlTGWu6ihN7mjxxfthNPGU21/Vfv0d+mlBNdTkl2YOlQtKci YBqkhRb5Re9KC+6O7dWFf5qPZQiD3iUOxUOWsaQhj/CxO+EYk7kxEJxV4tMZfesE90LgTINX Z7FdWd0DYG+m Cc: nbu-freebsd-drivers@nvidia.com Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="------------0u2yd3xv1H54BFo3d7r0hc6t" X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.24 / 15.00]; SIGNED_PGP(-2.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_LONG(-0.98)[-0.984]; DMARC_POLICY_ALLOW(-0.50)[denninger.net,none]; NEURAL_SPAM_MEDIUM(0.28)[0.282]; NEURAL_SPAM_SHORT(0.26)[0.256]; MIME_GOOD(-0.20)[multipart/signed,multipart/mixed,multipart/alternative,text/plain]; R_SPF_ALLOW(-0.20)[+mx]; MIME_BASE64_TEXT(0.10)[]; XM_UA_NO_VERSION(0.01)[]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; TO_DN_NONE(0.00)[]; ARC_NA(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; TO_MATCH_ENVRCPT_SOME(0.00)[]; HAS_ATTACHMENT(0.00)[]; ASN(0.00)[asn:14061, ipnet:104.236.64.0/18, country:US]; R_DKIM_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-net@freebsd.org]; FREEFALL_USER(0.00)[karl]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:+,4:~,5:~]; FROM_HAS_DN(0.00)[] X-Rspamd-Queue-Id: 4WVGw33Rf3z4q1B This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --------------0u2yd3xv1H54BFo3d7r0hc6t Content-Type: multipart/mixed; boundary="------------7aHPwAJhPnQFR9aDTAghvI1l"; protected-headers="v1" From: Karl Denninger To: freebsd-net@freebsd.org Cc: nbu-freebsd-drivers@nvidia.com Message-ID: Subject: Mellanox Connect 10GigE PCI card supported? --------------7aHPwAJhPnQFR9aDTAghvI1l Content-Type: multipart/alternative; boundary="------------1ca05YGwFJgO4ksttM0f9n3S" --------------1ca05YGwFJgO4ksttM0f9n3S Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: base64 SSBnZXQgdGhpcyB3aGVuIHRoZSBzeXN0ZW0gYm9vdHMgYW5kIHRoZSBpbnRlcmZhY2UgaXMg bm90IHRoZXJlIGluIGFuIA0KImlmY29uZmlnIjoNCg0KbWx4NF9jb3JlMDogPG1seDRfY29y ZT4gbWVtIDB4YTIzMDAwMDAtMHhhMjNmZmZmZiwweGEyODAwMDAwLTB4YTJmZmZmZmYgDQpp cnEgMTcgYQ0KdCBkZXZpY2UgMC4wIG9uIHBjaTINCm1seDRfY29yZTogTWVsbGFub3ggQ29u bmVjdFggY29yZSBkcml2ZXIgdjMuNy4xIChOb3ZlbWJlciAyMDIxKQ0KbWx4NF9jb3JlOiBJ bml0aWFsaXppbmcgMDAwMDowMjowMC4wDQptbHg0X2NvcmUwOiBVbmFibGUgdG8gZGV0ZXJt aW5lIFBDSSBkZXZpY2UgY2hhaW4gbWluaW11bSBCVw0KDQpJZiBJIGtsZHVubG9hZCB0aGUg ZHJpdmVyIGl0IGltbWVkaWF0ZWx5IHJlbG9hZHMgd2l0aDoNCg0KcGNpMjogPG5ldHdvcmss IGV0aGVybmV0PiBhdCBkZXZpY2UgMC4wIChubyBkcml2ZXIgYXR0YWNoZWQpDQptbHg0X2Nv cmUwOiA8bWx4NF9jb3JlPiBtZW0gMHhhMjMwMDAwMC0weGEyM2ZmZmZmLDB4YTI4MDAwMDAt MHhhMmZmZmZmZiANCmlycSAxNyBhdCBkZXZpY2UgMC4wIG9uIHBjaTINCm1seDRfY29yZTog TWVsbGFub3ggQ29ubmVjdFggY29yZSBkcml2ZXIgdjMuNy4xIChOb3ZlbWJlciAyMDIxKQ0K bWx4NF9jb3JlOiBJbml0aWFsaXppbmcgMDAwMDowMjowMC4wDQptbHg0X2NvcmUwOiBVbmFi bGUgdG8gZGV0ZXJtaW5lIFBDSSBkZXZpY2UgY2hhaW4gbWluaW11bSBCVw0KDQpBdCBwcmVz ZW50IEkgZG8gbm90IGhhdmUgdGhlIG90aGVyIGVuZCBjb25uZWN0ZWQgdG8gYW55dGhpbmcg KEkgaGF2ZSBhIA0Kc2hvcnQtZGlzdGFuY2UgZGlyZWN0LXdpcmUgU1BGKyBjYWJsZSBmcm9t IE1lbGxhbm94IHRoYXQgSSBpbnRlbmQgdG8gDQpwbHVnIGludG8gdGhlIHN3aXRjaCBpbiB0 aGUgc2FtZSByYWNrKSBidXQgSSB3b3VsZG4ndCBleHBlY3QgdGhhdCB0byANCmltcGFjdCB0 aGUgZHJpdmVyIGJlaW5nIHVuYWJsZSB0byBjb21lIHVwLg0KDQpEbyBJIGhhdmUgYSBjYXJk IHRoYXQgRnJlZUJTRCBkb2VzIG5vdCBzdXBwb3J0IGFuZCBoYXZlIGRyaXZlcnMgZm9yIA0K KGFsdGhvdWdoIGF0IGZpcnN0IGJsdXNoIGl0IGFwcGVhcnMgaXQgZG9lcyBmaW5kIGl0KT/C oCBUaGUgTnZpZGlhIA0KZG9jdW1lbnRhdGlvbiBwYWdlIGhhcyBhIGxpbmsgdG8gYW4gb2xk ZXIgZHJpdmVyIGludGVuZGVkIGZvciBGcmVlQlNEIA0KMTAuMSAoaXQgZG9lc24ndCByZXNv bHZlIGFuZCBuZWl0aGVyIGRvIHRoZSByZWxlYXNlIG5vdGUgb3IgdXNlciBtYW51YWwgDQps aW5rcykNCg0KVGhhbmtzIGluIGFkdmFuY2UhDQoNCi0tIA0KS2FybCBEZW5uaW5nZXINCmth cmxAZGVubmluZ2VyLm5ldA0KL1RoZSBNYXJrZXQgVGlja2VyLw0KL1tTL01JTUUgZW5jcnlw dGVkIGVtYWlsIHByZWZlcnJlZF0vDQo= --------------1ca05YGwFJgO4ksttM0f9n3S Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable

I get this when the system boots and the interface is not there in an "ifconfig":

mlx4_core0: <mlx4_core> mem 0xa2300000-0xa23fffff,0xa2800000-0xa2ffffff irq 17 a
t device 0.0 on pci2
mlx4_core: Mellanox ConnectX core driver v3.7.1 (November 2021)
= mlx4_core: Initializing 0000:02:00.0
mlx4_core0: Unable to determine PCI device chain minimum BW

If I kldunload the driver it immediately reloads with:

pci2: <network, ethernet> at device 0.0 (no driver attached)
mlx4_core0: <mlx4_core> mem 0xa2300000-0xa23fffff,0xa2800000-0xa2ffffff irq 17 at device 0.0 on pci2
mlx4_core: Mellanox ConnectX core driver v3.7.1 (November 2021)
= mlx4_core: Initializing 0000:02:00.0
mlx4_core0: Unable to determine PCI device chain minimum BW

At present I do not have the other end connected to anything (I have a short-distance direct-wire SPF+ cable from Mellanox that I intend to plug into the switch in the same rack) but I wouldn't expect that to impact the driver being unable to come up.

Do I have a card that FreeBSD does not support and have drivers for (although at first blush it appears it does find it)?=C2=A0 The= Nvidia documentation page has a link to an older driver intended for FreeBSD 10.1 (it doesn't resolve and neither do the release note or user manual links)

Thanks in advance!

--
Karl Denninger
karl@denninger.net
The Market Ticker
[S/MIME encrypted email preferred]<= /div> --------------1ca05YGwFJgO4ksttM0f9n3S-- --------------7aHPwAJhPnQFR9aDTAghvI1l-- --------------0u2yd3xv1H54BFo3d7r0hc6t Content-Type: application/pgp-signature; name="OpenPGP_signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="OpenPGP_signature.asc" -----BEGIN PGP SIGNATURE----- wsF4BAABCAAjFiEEvWWSxnGhSYSUSaCtby3AFeuPWXgFAmaigR8FAwAAAAAACgkQby3AFeuPWXhT HQ/44jDcPRKSDOw604lGMnPSUsn8aerEopahwf+ayHXLjA8z2bxNDtxoQV6njj3QgM77iPhRydhh DJDgteWuaoCuOHHj7FGCEqYvoJOPgSEI/0jw4OrLuepr2NRa5fH6EzNJn4VKKTuAMz/AaB0UTzu0 K+Gd4zCRDnNes+ZR+HYW8PCWKCQntyIUr7MzHNzAy+Tj418Vx8/rTuOPMGh5Ujdg39aNaoQhlah4 +w+IzyzbYuxKSM51kLVbX8iAjsB+ZA/yCUvzjsEAz89l3EsPmkhvyMLky6Yv5+/oB3Qq2iDS7G3u fGyBxSN6a1UAnIfBx9S3Zktio6hwfUvHPFoUi5TxqKqGlRynro5wvKMPlrctBM9tewL30Rm9L69I wbYk9+OiYhQsSepjSZb7X3PUYUEEOJce13rfDtgeBFSQ6plTZikSztEsU4QvQdvzLzB95IENU7L7 8XIFwT8WD2m8Oh8cUKdvqQMZgJqRIaDyGElO7/lDhoPibabIF3FO2hOrbuGGGAPe6+LHuVJIAvU4 Vwbpa4vkkrwMWfBBtyMVoNsUt+86FmNkIjnBhYnfpiCxFKqzBBpfUcrlS668OsBd7NtJXvi5QUO4 9ZTJ+/0Gi9vnLIWOAzSmCzQdgh+KH4Xu5ZBQENXA/hDQ1WTffp3g1yEveH6bruyAAafc6j0x3L5b tw== =187y -----END PGP SIGNATURE----- --------------0u2yd3xv1H54BFo3d7r0hc6t--