From nobody Mon Dec 18 10:14:29 2023 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4StwgN6QQwz54Gwr for ; Mon, 18 Dec 2023 10:15:12 +0000 (UTC) (envelope-from marietto2008@gmail.com) Received: from mail-lf1-x130.google.com (mail-lf1-x130.google.com [IPv6:2a00:1450:4864:20::130]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4StwgN3SMnz3Hg0; Mon, 18 Dec 2023 10:15:12 +0000 (UTC) (envelope-from marietto2008@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-lf1-x130.google.com with SMTP id 2adb3069b0e04-50e23c620e8so2302777e87.1; Mon, 18 Dec 2023 02:15:12 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1702894510; x=1703499310; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=QgaVJozH3sN6h75bgoiAXsY4rkctpe7tIEZgSTnUcoM=; b=E6kIo+v1WfYvo4zSjn9CvA1nHIQ2/x7AkfE4ZdguOSYImyZC/ph4jOCy+8zbLZbuSS lf3kUjtWEz9FXtCR/Lq93ZvXkrsK2grXdXUZS/IamNmpZUtSf4qULEVwFo4qJjyH/wF5 20wgI4PADYUDyfV02n5td+Hp4Om9azK9RfecYQt+R3Usy4iqTxRH3sNY24sz3mpcpH+i RVS1aW2TZVB5x0HqFndT+03H3caNwDamOqMdXw3lJQbf2VCBsISyhfxzDfvRWMlNJ3OR QMwZxl6gHjeJbk2MFle324mzaTPIfPcsG/xtLEVgLBsgbc7cdO7iPO5QUKPGNSSnVUBm 3sqg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1702894510; x=1703499310; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=QgaVJozH3sN6h75bgoiAXsY4rkctpe7tIEZgSTnUcoM=; b=EFrESwgKNfeIKutAL9eQo7gtDVqNFMF0AG35yXO0ss9FNhVddV38UhOfX7kkJeWD74 MF+hh5F6Qp61fMHXUOlki2YgZS1N0AuKyYPdtzJg+btY9ddGYoETLOEckT8v/V8OCOeY 8XssIKFW7xhZvVP/9ECDzRY+jOiWZygIG19fjW2AFzfRAdwCaTkjzfwiVr3uhEKGpCZL MJ2ugkhQIgnyaPN/k80Qiv0aZ56nL3zchmCTaQhX/kvOo2nQT+wi4oCmydutJjA/edma BWT41LJUGr3GrcVi40HvUQeVsFhjIA01G5rYJ7aCbYYQI1DMPUGNvTPmymn61DIF5TJb FZHA== X-Gm-Message-State: AOJu0YzEfJeV5BcfioeHPrHp5yM3gr+mCT0EBLJDSywWQc7YcNAvHnsL hMoj6ReH5phKx7TKPubrle9tNVAq3ItHgCZtwxKp7U7Qcxc= X-Google-Smtp-Source: AGHT+IFCQBVEGktKelfea7W4YFz4YarMag/5kVwNtZeMYNmnQmzaFRcwXRFwHUyRefIjCiKEgN2nJvLqTmm7dUW3EVY= X-Received: by 2002:a05:6512:b9c:b0:50c:180:2162 with SMTP id b28-20020a0565120b9c00b0050c01802162mr8550923lfv.99.1702894505439; Mon, 18 Dec 2023 02:15:05 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 References: <101df7552fd1673ddc73e14daf518630402129c4.camel@FreeBSD.org> In-Reply-To: <101df7552fd1673ddc73e14daf518630402129c4.camel@FreeBSD.org> From: Mario Marietto Date: Mon, 18 Dec 2023 11:14:29 +0100 Message-ID: Subject: Re: bhyve nvidia gtx-1650 mobile passthru on win11 To: =?UTF-8?Q?Corvin_K=C3=B6hne?= Cc: Nuno Teixeira , FreeBSD virtualization Content-Type: multipart/alternative; boundary="000000000000163ec4060cc60625" X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Spamd-Bar: ---- X-Rspamd-Queue-Id: 4StwgN3SMnz3Hg0 --000000000000163ec4060cc60625 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hello Corvin, about point 1) : Nuno is trying to enable the passthru of his nvidia-gpu on Windows 11. Is your patch intended to work for Windows ? If yes,I would be ready to test it on my system. On Mon, Dec 18, 2023 at 11:02=E2=80=AFAM Corvin K=C3=B6hne wrote: > On Sat, 2023-12-16 at 16:07 +0000, Nuno Teixeira wrote: > > Hello all, > > > > Specs: > > - laptop with integrated intel + dedicated nvidia > > - 15-CURRENT 3b1904d9eb04 amd64 > > - win11 with nvme and tpm > > > > I'm sharing my results with nvidia passthru: > > ### > > /boot/loader.conf.local: > > vmm_load=3D"YES" > > pptdevs=3D"1/0/0 1/0/1" > > > > ppt0@pci0:1:0:0: class=3D0x030000 rev=3D0xa1 hdr=3D0x00 > > vendor=3D0x10de device=3D0x1f99 subvendor=3D0x17aa subdevice=3D0x3fa5 > > vendor =3D 'NVIDIA Corporation' > > device =3D 'TU117M [GeForce GTX 1650 Mobile / Max-Q]' > > class =3D display > > subclass =3D VGA > > ppt1@pci0:1:0:1: class=3D0x040300 rev=3D0xa1 hdr=3D0x00 > > vendor=3D0x10de device=3D0x10fa subvendor=3D0x17aa subdevice=3D0x3ffb > > vendor =3D 'NVIDIA Corporation' > > class =3D multimedia > > subclass =3D HDA > > > > bhyve: > > -s 6:0,passthru,1/0/0 -s 6:1,passthru,1/0/1 > > ### > > > > - Installed nvidia drivers without problems > > - graphic card is detected but is deactivated with a triangle and a > > "!": > > "Windows stopped this device... code 43" > > - hda is detected and shows no problem > > > > I've read that some nvidia cards are working... > > Any tips are welcome. > > > > Not sure if it is possible to use intel integrated as it is already > > in use by OS. > > > > Thanks, > > > > -- > > Nuno Teixeira > > FreeBSD Committer (ports) > > Hi, > > nvidia: > At the moment, nvidia gpu passthrough is not supported by upstream. I > have a small patch stack for nvidia [1] but it's not well tested and I > don't know for which guests and cards it works. > > amd: > Should work properly on 13.2, 14.0 and onward. Note that there's a > hardware bug on many cards [2]. > > intel: > Requires a patched EDKII firmware [3]. Unfortunately, it's not merged > yet. Btw. even if you only have an Intel card available you can use it > for GPU passthrough. > > [1] > > https://github.com/Beckhoff/freebsd-src/commits/phab/corvink/14.0/nvidia-= wip/ > [2] https://www.nicksherlock.com/2020/11/working-around-the-amd-gpu- > reset-bug-on-proxmox/ > > [3] https://reviews.freebsd.org/D41710 > > > -- > Kind regards, > Corvin > --=20 Mario. --000000000000163ec4060cc60625 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hello Corvin,

about point 1)= : Nuno is trying to enable the passthru of his nvidia-gpu on Windows 11. I= s your patch intended to work for Windows ? If yes,I would be ready to test= it on my system.

On Mon, Dec 18, 2023 at 11:02=E2=80=AFAM Corv= in K=C3=B6hne <corvink@freebsd.or= g> wrote:
On Sat, 2023-12-16 at 16:07 +0000, Nuno Teixeira wrote:
> Hello all,
>
> Specs:
> - laptop with integrated intel + dedicated nvidia
> - 15-CURRENT 3b1904d9eb04 amd64
> - win11 with nvme and tpm
>
> I'm sharing my results with nvidia passthru:
> ###
> /boot/loader.conf.local:
> vmm_load=3D"YES"
> pptdevs=3D"1/0/0 1/0/1"
>
> ppt0@pci0:1:0:0: =C2=A0 =C2=A0 =C2=A0 =C2=A0class=3D0x030000 rev=3D0xa= 1 hdr=3D0x00
> vendor=3D0x10de device=3D0x1f99 subvendor=3D0x17aa subdevice=3D0x3fa5<= br> > =C2=A0 =C2=A0 vendor =C2=A0 =C2=A0 =3D 'NVIDIA Corporation' > =C2=A0 =C2=A0 device =C2=A0 =C2=A0 =3D 'TU117M [GeForce GTX 1650 M= obile / Max-Q]'
> =C2=A0 =C2=A0 class =C2=A0 =C2=A0 =C2=A0=3D display
> =C2=A0 =C2=A0 subclass =C2=A0 =3D VGA
> ppt1@pci0:1:0:1: =C2=A0 =C2=A0 =C2=A0 =C2=A0class=3D0x040300 rev=3D0xa= 1 hdr=3D0x00
> vendor=3D0x10de device=3D0x10fa subvendor=3D0x17aa subdevice=3D0x3ffb<= br> > =C2=A0 =C2=A0 vendor =C2=A0 =C2=A0 =3D 'NVIDIA Corporation' > =C2=A0 =C2=A0 class =C2=A0 =C2=A0 =C2=A0=3D multimedia
> =C2=A0 =C2=A0 subclass =C2=A0 =3D HDA
>
> bhyve:
> -s 6:0,passthru,1/0/0 -s 6:1,passthru,1/0/1
> ###
>
> - Installed nvidia drivers without problems
> - graphic card is detected but is deactivated with a triangle and a > "!":
> =C2=A0 "Windows stopped this device... code 43"
> - hda is detected and shows no problem
>
> I've read that some nvidia cards are working...
> Any tips are welcome.
>
> Not sure if it is possible to use intel integrated as it is already > in use by OS.
>
> Thanks,
>
> --
> Nuno Teixeira
> FreeBSD Committer (ports)

Hi,

nvidia:
At the moment, nvidia gpu passthrough is not supported by upstream. I
have a small patch stack for nvidia [1] but it's not well tested and I<= br> don't know for which guests and cards it works.

amd:
Should work properly on 13.2, 14.0 and onward. Note that there's a
hardware bug on many cards [2].

intel:
Requires a patched EDKII firmware [3]. Unfortunately, it's not merged yet. Btw. even if you only have an Intel card available you can use it
for GPU passthrough.

[1]
https://github.com/Beck= hoff/freebsd-src/commits/phab/corvink/14.0/nvidia-wip/
[2] https://www= .nicksherlock.com/2020/11/working-around-the-amd-gpu-
reset-bug-on-proxmox/

[3] https://reviews.freebsd.org/D41710


--
Kind regards,
Corvin


--
Mario.
--000000000000163ec4060cc60625--