From nobody Mon Dec 18 10:02:40 2023 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4StwP03FqLz54GBR for ; Mon, 18 Dec 2023 10:02:44 +0000 (UTC) (envelope-from corvink@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4StwP01dlLz4jKl; Mon, 18 Dec 2023 10:02:44 +0000 (UTC) (envelope-from corvink@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1702893764; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references:autocrypt:autocrypt; bh=yzNv1MgnFL2/Nt3HRhCs0O8kxkFIxYWmYsIcUQZ3kck=; b=BH6K8IyuV6KAHhwesuoYtmrZa/MeHlRkoms7ZfrS/jbShvXDMpTXznt537o+2kfscwVACV ZpFlQgi7FdcVAdLwzoH1FRH4EKd0+Zf9v1CBPeLgaC8AgPssbEGaNYyqkeo+x3M76bO/yW Tm/HFEJ36oFZhWUkEdO+6OpuaZfZB7tZKpgZS/sBFpIKvsfYB16/QJfgn1HQ78Jvdqx2M4 6xH6vBzyUVvbWemLm0tcQsIeHfaNI2lKGEvcR8uXRxviwnABL0yId86UYhgTU9gTI7ObgH 6M33/7c28KALNkSJYZRwfDT9DMUz4QC142OaqjbFmz58jnw4Ya+BdFSvizkvCg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1702893764; a=rsa-sha256; cv=none; b=BXUQg/F37+vhOxx7XzdN1OJ9s9teEkP9hOnBXdtlk4xHXBPwyLzg0ndXNTmxinujoMPvGL LXQQXVQCPcesZx5kcm4viXaGn01eSbP/6olEhuGdxZv1wdzWhaKNBr0aSBgOBgZUmLr/vj 8cXaarr5jYSVGkXHUF8/QScNRM5HXuFM1V1qq89qW6Bz8fGG0N6ZeWvCkA4MOg4XfK+26R 3KeLybWK8V2v8370p2hYkFsy2uDs4CRDj4FITTR7rwIr6Orrxq/95vVMJusEoLWclWg9oR obMXTb+RhubZ/XyFpAcz5vdkLz1IQlY5iaQh7cCCvuqBzEhzkT2/JalaV+AmDg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1702893764; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references:autocrypt:autocrypt; bh=yzNv1MgnFL2/Nt3HRhCs0O8kxkFIxYWmYsIcUQZ3kck=; b=S8NbCj7GsPZkcjziB4EYYdw5ySO1NFkAOWKqYU1gmoCNr3BHc4H0IwBnswqGu0mlWM2cE+ 6Hz+iNxfXaqofyYFoQKA2GCbgTksXZGxWrZco8ntfsXttSH3fDbS6Gxi7RZNtk0GDALQfd RmUyher8MtRMmU/dtMSvUmyUefyyNLgbMuGcLbtVkUctErJE7ZQkQDK+E+DFTwPxV+LLFP wxGPwM/A8PYnLVr3OpXbhJIXbqmwU7bq/1UMOjwGl4vXhv6juCUEM0AJHzU7ouXwayN76c sLNKjNZDE+Xml/AneRKB87BSjh9kOcG0p5f0WGOVa2+M1gKJe68/D7hk61XXCA== Received: from [172.21.179.165] (unknown [195.226.174.194]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: corvink) by smtp.freebsd.org (Postfix) with ESMTPSA id 4StwNz50gkz868; Mon, 18 Dec 2023 10:02:43 +0000 (UTC) (envelope-from corvink@FreeBSD.org) Message-ID: <101df7552fd1673ddc73e14daf518630402129c4.camel@FreeBSD.org> Subject: Re: bhyve nvidia gtx-1650 mobile passthru on win11 From: Corvin =?ISO-8859-1?Q?K=F6hne?= To: Nuno Teixeira Cc: FreeBSD virtualization Date: Mon, 18 Dec 2023 11:02:40 +0100 In-Reply-To: References: Autocrypt: addr=corvink@FreeBSD.org; prefer-encrypt=mutual; keydata=mQINBGNjZaIBEADDTrDNf+0pwiuRPBdClcnZW83dH1UhuOi0u+A1J2SatEBbNaFVtXXAavewCTuyV/ZbNidjlhq3R/pWyiKjFKvs5dj7PMCw+3z2D5OWpMdHg7TrB+fbdFPOEsu0zQVKNaO+pSKCfN0Re0m7bL3wuvl7PXvBufRwA3Guo1P4j3TXWaEkuso7VupTvE25zVGg9ONHrGOjA9RUy+Yg4Se3NLgtUdjBgA21SBQTDvRQV4fDmVenlwvWeE0Xm8FcDcpQb6sJTihaDku78mi3Ux1HCk7rTcepVEB0xIB6qmFxv0sLlDmVv6Z6qg1y/Q5m23Pgz60o3TulMPV4F+3Itm8ifU+wgVSzBZbD29GYkd7LKqMkFbhvfSBk+5db3vbYY5OD//+LTM5AV7e2AhXuXMvG1UNBqXqSJTTSy6KZz+qmPQO0zos0dq46p8o82lKiBEGD2Hu0p+u0OyV+MmRYo1NIBFVbOPXp2MvUVl5II0UIJ3+N9gLBmfGA+HEpVO8PnvdoT/5NQ7m8JK1rQHzjiDub/iDPAYMqKH4C0eZ/7zO0fuY5FeRNtuNtpH1Bw/+7/5RJH7bcKkfGHHEp15FJUrGHgWNydoDLB9QBprwQc8FEldDXBjzOMXIgh6FGKLNu6DswvIPGy6M3u7DXwDakCXz+c9Ym0oFihLzZxWntrsxdswD/CwARAQABtCdDb3J2aW4gS8O2aG5lIDxjb3J2aW4ua29laG5lQGdtYWlsLmNvbT6JAlQEEwEIAD4WIQSC9FKVreba38fZT0bYVNpWMV4CagUCZArUIwIbAwUJCWYBgAULCQgHAgYVCgkICwIEFgIDAQIeAQIXgAAKCRDYVNpWMV4CalcID/44k2i/mqSSi4W6FAobSF1nFLtP/pfcRNJriWKx2UF7cfFMKyg7Nilg7FhLb5FDB1umUW2nFfchFPTUp4FfKzgRvPzIMg4RIRcVtTpYbl3z7zs9ZXD8q S//iibbiUG3quncm6tO2x1jLZD3ORC+8MuLGXhYQIa4O5vVF2SBHdb/U6P+wsrF+U+OpRdEdQ/4Xu9S02kltzBGgArjcexdhUqEqW01KCCSH0+qgfN1NE+9L934ZOB+cai2b9apPbCOGuV6KcUKMj4z0RWInhlXIyMqtmhdix/P/GjrQ1REVNdp74JeweSSedM15wwc6YLMXPrtOnnExyZ1gyNFYaub+Mdo3ZQ+83863B0C9IlpzEW0K8bYlZrl4WBNdcMOyByETAxgQmBgP6ZFErTtaeUOH1nX2FyR6o2GLSahRgngQmnREzScTpPbBEkMwJMDAO+rbjjGxjeKSUwD1WOfbI6QZj+MS/uBk2p08kgN7fQaCEwj6jqML/IIE+FZ9IIn6TNG0hChD384VHO+YioLBno1Atgi4Q7JUWSRIHQXZW+StQajFrWPPyKQwCe1MwqpKoMpX/q8IZBlzwJgZS8ShLeFZjtzOt1jgM99TD91Neonf9OzjTSbfo7sJviSWoICMhB/MvDZjj+naMVF86uGFxnIEsjVKyBxlJd4TRHnLYPTIHFKBLQjQ29ydmluIEvDtmhuZSA8Y29ydmlua0BGcmVlQlNELm9yZz6JAlQEEwEKAD4WIQSC9FKVreba38fZT0bYVNpWMV4CagUCY2NlogIbAwUJCWYBgAULCQgHAwUVCgkICwUWAwIBAAIeAQIXgAAKCRDYVNpWMV4CavfDEACCFnXpR7H9eOgP+GJMNPtK6i9/xnqdyXi8uCZIN0hYwjN4Xzo9SMLOf4UUlQEveOB+bGqbRfHd/fGKnrlXiPd0SGpKWJC21gqL/DsIH0J8I3Whth+O8tfPWeFy0oCsvBaaGFLIrDfoIgHF9i/gqEe48xhN42weB02Z3mdR1L0d7ME/BLwS0mCXe9Zh3uHw63S6xYB3Wsjptxe/ph6TpQDUKWtRJkjC6BqXPBdThpbbfIRWmjZbp2fKEJPvtRXS14+gbUqWeJ 4xCvprA3+ae7vtrp91X775yngyW3XTw5cmDiJIjykH8+zhEIoNQXNBpFrehkQDYrcM+WoE6NGSJo+3VJvSRWhUGWDVrxdTYNkbIjmTNlkI12NINC007DiuV7OF9XHWgrbbylvuZvbODmbJRdhTFy9upAUygX1/xUAQEIMqMiJmyTdv8i0IbZ611WElQx9XHgGeZgM6+39/laN8FwspM6gE/4NzZHIZN0LEBOerZqoF+Il6eccQpoEWx7nb/RilJp3dUUyvkBnJWg+AJByosg857kvvmDnZ3UB+bejWpcfFvnbkiKPUBPDO7tWPb5r2yFDpDe/Vg5x+sRbkkXGUFD6Rx0p/ZiRIneVVg8emTzhDR0IL/BZkq/uVJkdaphZli1F/31cNgf6ZJYnjxlk86uiYSySZQR0dKLDqq7QlQ29ydmluIEvDtmhuZSA8Yy5rb2VobmVAYmVja2hvZmYuY29tPokCVAQTAQgAPhYhBIL0UpWt5trfx9lPRthU2lYxXgJqBQJkCtScAhsDBQkJZgGABQsJCAcCBhUKCQgLAgQWAgMBAh4BAheAAAoJENhU2lYxXgJqI+QQAML5PTR7KpUFV3SLG60LQJGEOHUfDmJYczxBFbIAq1U4hIbivopu1AdLty7oDDrIjCVoa2/Cy34dd99O7lhLvUmZFB/zDSUtbUg2zhDkU0YSZ11FdrlWzky2tFaQRgxpDvWlUP0baa3Pd4dPDRiIUI6AOSR2SL6XANk6sJh56gLVM6G8yyafGsxSyDYg6Z78EEMFejHwB+KP2DdsahupzM+F97HeC1+bOHYxtqN+2hEkPLtQWizyumPqNg5FvZhwe7yO8V95hF3RhuDO+9aJT+WLLvcZEb/L1bI04IvZ5FWgCLI7Levd/DuOtZI8gWapHhqGZRbXB2fuJkCoKCl6V67h/7aWhU3LjFTsC5siJyrxPjapKcIk8a7PqZDswNCKR+24LJ5D59mPgEOnsiCCVpik1WE /kgD+rOu9dQxjpjKwuKowf4EJP1KYNkYtoy1HthzyTOqPwqXC3IUl0GVPO3xw6MhUM3irCVFruC+ecVrv85Rd37vrduT6JvgW92xjWegMsamtkDZH8Ik/cmYhH0K/qEc6OZVNea/4PTEZe0uxODJ6pbMd80AJyGqDPPVeAgWJtEIG4k6IS8XyD5v1QJtlpDVpPwP/bbFnVc3h3Oatfn8Etm1KAqYvNwyO+om2PkF1p732uapDZdLwksVmgc9s79+9pSpeP5DbIeMzhrIKuQINBGNjZaIBEAC4V8zlnLa957NAFPmOuW6cL1W1/E3pMtoxNYMaZmOtEDaOLV645qfie2XXh2Bn44hzN3vZ3ZaWV9FKipGTxCTNL6Im6o8ghKX4cIBiACeSbcAcIdsxCGnFLO46lPm7NYbGGfU532A8QfvpYeO4ue8H+qNWw9lWXCU1djoPwbo9McfyJ7CA3reT9wgPO4/nAo1StfeiYvkOWoxYwpiNstzUZMmd6dRCJhDtHyy639VB2YsvhyLYVB9yQdv5M2VPk2q+oodiTK/uZvaoubsIqkVlL/fqBdx+bZOG6eSogqTjTLFN5S6EjL4usCY1Vv19uDhWwuvADuMChu3jPNm4PC8pI6O4DPiWAqt+Aw4WDfKM2ie8JqzCtUXf/Iv+aSiMhNMT0qGn+Ybq98yWXs1k67M7PheurWO2hfYtMQJtpHYHqz3T7VC0F4bAPl3rDRL4PJ2Vr9eoo5upVPbZN1JXAA5oEX7coA1BQz/18LlTBhNmHk2wsi5omYZOnBoZelA7kpNx/8zc2zanOnO7NW0dJLq/o4GlfP56UFV8I1MWNyI351BAkIJyThrjv7aMxLhpNny6uYoms7X2oWf2R//QIMA/0jkqsGirksV4CW+7xhuQVwxGIHR2JskZYaPSjJaXTvoGxu/+SwqT00xnF64ZvwDUGiw7yB70s/LolEOZ/5JqgQARAQABiQI8BBgBCgAmFiEEgvRS la3m2t/H2U9G2FTaVjFeAmoFAmNjZaICGwwFCQlmAYAACgkQ2FTaVjFeAmrhSw/+NqYqv6oHppWZ7hpt+2Df+qIw2kOgvo0ecU8orastt7OfiJpRzlDFPK2nhok5t4+1PZCi4jcR5Ub22Ddy4O00FOCRAq70haA+cNNiZ0XlD5cDv+CxmT0NkD337ls5wz8zyOX7n7Z4jG8ghiJEkcLQbyp2qYaggKrz2sGWKUjByS7jySRCotPOO+0W6Iz2dw9215ZQ1F3uZwdRlpXA7ypzUBEvIJxc563fFuPetbZAIavGMT844hovsMXW2Q/MS3HI03USkgeVaqANbSOUFAdt2tgTrvUw/vXBckp4T+vATNdQH0WieBIX4nRQQ6SjfmaI82QxJuJjb5NJ6bgS+HPIUH8J1Iw958y/Rs5svzKW+/YYoZBDuhtbAeoJdiy7a7wtK6pBv+xMdpmKLBgVVXOeX6sucwJ/K68tb5aOmbuPLAaIoKgm/9IF8dqiI23JoM2ZhpYZjpVMpakGIxV6R4Kp2hrqC4oNpuVLJ7LQSMuocXduguvWYdYvVXSdpC1Ed+fLtFXA0h5fhDqHFDCDM2CgQX2DfzXe/rV7vChm61fQYn+85md1vPiefnsaunEh3+cbcFfIshNmIRfAKwA2//75eqgBuC2D5ZIr93LsEUCcabnQZdaZKGSo/ruWNZdPyjj/b6MhAifkoFFrkN4/dwIqYIev8wMbh3+7dcZIRza0foM= Content-Type: multipart/signed; micalg="pgp-sha256"; protocol="application/pgp-signature"; boundary="=-6KzN/P86HvMPwDJir/gB" User-Agent: Evolution 3.50.2 List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 --=-6KzN/P86HvMPwDJir/gB Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Sat, 2023-12-16 at 16:07 +0000, Nuno Teixeira wrote: > Hello all, >=20 > Specs: > - laptop with integrated intel + dedicated nvidia > - 15-CURRENT 3b1904d9eb04 amd64 > - win11 with nvme and tpm >=20 > I'm sharing my results with nvidia passthru: > ### > /boot/loader.conf.local: > vmm_load=3D"YES" > pptdevs=3D"1/0/0 1/0/1" >=20 > ppt0@pci0:1:0:0: =C2=A0 =C2=A0 =C2=A0 =C2=A0class=3D0x030000 rev=3D0xa1 h= dr=3D0x00 > vendor=3D0x10de device=3D0x1f99 subvendor=3D0x17aa subdevice=3D0x3fa5 > =C2=A0 =C2=A0 vendor =C2=A0 =C2=A0 =3D 'NVIDIA Corporation' > =C2=A0 =C2=A0 device =C2=A0 =C2=A0 =3D 'TU117M [GeForce GTX 1650 Mobile /= Max-Q]' > =C2=A0 =C2=A0 class =C2=A0 =C2=A0 =C2=A0=3D display > =C2=A0 =C2=A0 subclass =C2=A0 =3D VGA > ppt1@pci0:1:0:1: =C2=A0 =C2=A0 =C2=A0 =C2=A0class=3D0x040300 rev=3D0xa1 h= dr=3D0x00 > vendor=3D0x10de device=3D0x10fa subvendor=3D0x17aa subdevice=3D0x3ffb > =C2=A0 =C2=A0 vendor =C2=A0 =C2=A0 =3D 'NVIDIA Corporation' > =C2=A0 =C2=A0 class =C2=A0 =C2=A0 =C2=A0=3D multimedia > =C2=A0 =C2=A0 subclass =C2=A0 =3D HDA >=20 > bhyve: > -s 6:0,passthru,1/0/0 -s 6:1,passthru,1/0/1 > ### >=20 > - Installed nvidia drivers without problems > - graphic card is detected but is deactivated with a triangle and a > "!": > =C2=A0 "Windows stopped this device... code 43" > - hda is detected and shows no problem >=20 > I've read that some nvidia cards are working... > Any tips are welcome. >=20 > Not sure if it is possible to use intel integrated as it is already > in use by OS. >=20 > Thanks, >=20 > --=20 > Nuno Teixeira > FreeBSD Committer (ports) Hi, nvidia: At the moment, nvidia gpu passthrough is not supported by upstream. I have a small patch stack for nvidia [1] but it's not well tested and I don't know for which guests and cards it works. amd: Should work properly on 13.2, 14.0 and onward. Note that there's a hardware bug on many cards [2]. intel: Requires a patched EDKII firmware [3]. Unfortunately, it's not merged yet. Btw. even if you only have an Intel card available you can use it for GPU passthrough. [1] https://github.com/Beckhoff/freebsd-src/commits/phab/corvink/14.0/nvidia-wi= p/ [2] https://www.nicksherlock.com/2020/11/working-around-the-amd-gpu- reset-bug-on-proxmox/ [3] https://reviews.freebsd.org/D41710 --=20 Kind regards, Corvin --=-6KzN/P86HvMPwDJir/gB Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEgvRSla3m2t/H2U9G2FTaVjFeAmoFAmWAGMAACgkQ2FTaVjFe AmqinA/9Gh/l/zlLKK0Tb2Udn1VgRAiJdFm4m3z5rbFAkEKB5x++6WnZSNgQaPDk SA1K/4WTQPsjrMlDZPLERiyxIvjEqR2zXe1k/QDyFstf6yXg2vFQEbpRlSBdvCnW 8hRG1vGTNAGuTrfmmLYcSPn/SJGWTCaz3+GtR5vmypgWEBniUkJojDItm1JNOyvF RM2NVUsVUr8VBeTALFt26ZOs6sm7bkFCIfPC2JEqYnfsuR27GlSrL5E7bRIaZEzA PB7m83IHfogRM4KJlDQiY2rpi7qvIyii328IN3l35mNkNrm053t+D6nI1IuLgj1E e4rojeApYj19AnhWpD29H4llVgLRcwq3bA3DvGGJj2R1vNX2EPplMdUecie9KRQ9 g41ueHWJ1V2TJESzbfWS2komujIguRb0NVSkstoCo4rVlNX+D71j037ZQ+S1pmFM CSaz9fXQHDdag6N+HxT3V5PUpe5nDXs/h+nOzSC5sGjgcaufLNEy1iClpxIYFoX+ YqRkD+7L4bVtn9MicAWs9y6tnqvakr7WaA5+Ix6JFTqOkpeVH7LnyrGc7S2S+V9+ GBTH8Eo3JlKSl4hPQaqF5/SJlv+8QaE3PMKuoLf1bBKIQBOjin9lP2EuSGDTwmZt RYs+hiXXgMvpImjQS0KMPrZxQFq4JBQTULphBGJKFMSbn5ztozk= =o8lt -----END PGP SIGNATURE----- --=-6KzN/P86HvMPwDJir/gB--