Re: devctl: Failed to detach pci0:1:0:0: Device busy / devctl: Failed to set pci0:1:0:0 driver to ppt: Device busy

---> Do you have 'vmm_load="YES"' in loader.conf ?

yes.

---> If you want to pass through the video card (as evidenced by devctl and
pptdevs) then why have the nvidia driver installed?

because I have 3 gpus on my PC. I use the intel gpu on the host ; I would
like to use the nvidia gtx 1060 within a bhyve Linux vm and the 2080 ti
with the Linuxulator to run stable diffusion,or vice versa. Stable
diffusion needs pytorch + cuda and they need the nVidia driver installed on
FreeBSD and the modules loaded.

My goal is to run stable diffusion and a bhyve / linux vm +my nvidia gpus
attached.

Thanks.

Il giorno mer 1 feb 2023 alle ore 07:24 Daniel O'Connor <darius@dons.net.au>
ha scritto:

>
>
> > On 30 Jan 2023, at 05:37, Mario Marietto <marietto2008@gmail.com> wrote:
> > In some FreeBSD 13.1 machines I have the problem below,in some others I
> don't have it. I would like to know what the causes could be and how to fix
> it.
> >
> > root@marietto:/usr/home/marietto # devctl detach pci0:1:0:0
> >
> > devctl: Failed to detach pci0:1:0:0: Device busy
> >
> > root@marietto:/usr/home/marietto # devctl detach pci0:2:0:0
> >
> > devctl: Failed to detach pci0:2:0:0: Device busy
> >
> > Not even it works if instead of detach them, I try to attach them
> directly to the ppt driver :
> >
> > root@marietto:/usr/home/marietto/bhyve/Files # devctl set driver
> pci0:2:0:0 ppt
> > devctl: Failed to set pci0:2:0:0 driver to ppt: Device busy
> >
> > root@marietto:/usr/home/marietto/bhyve/Files # devctl detach pci0:2:0:0
> > devctl: Failed to detach pci0:2:0:0: Device busy
> >
> > Pci addresses 1:0:0 and 2:0:0 belong to the two GPUs that I have on my
> PC :
> >
> > vgapci0@pci0:1:0:0:     class=0x030000 rev=0xa1 hdr=0x00 vendor=0x10de
> device=0x1c02 subvendor=0x19da subdevice=0x2438
> > vgapci1@pci0:2:0:0:     class=0x030000 rev=0xa1 hdr=0x00 vendor=0x10de
> device=0x1e04 subvendor=0x19da subdevice=0x2503
> >
> > Actually I have commented this line on /boot/loader.conf,because it
> makes no difference if I keep it uncommented or not. It is totally ignored.
> >
> > #pptdevs="1/0/0 1/0/1 2/0/0 2/0/1 2/0/2 2/0/3"
>
> Do you have 'vmm_load="YES"' in loader.conf?
>
> If not I am not sure it will have an effect - vmm must be loaded early
> otherwise the card will be grabbed by the vgapci driver rather than be put
> under ppt control.
>
> > In every FreeBSD machine I load the nvidia kernel modules adding the
> line below to /etc/rc.conf :
> >
> > kld_list="nvidia nvidia-modeset"
> >
> > and I have installed the nvidia-driver package on every machine. But as
> I said,in some of them I see the error above,in some others I don't see it.
> I'm not able to isolate the dysfunctional pattern. The xorg.conf file is
> the same for each machine. Can someone help me to troubleshoot the error ?
> thanks.
>
> If you want to pass through the video card (as evidenced by devctl and
> pptdevs) then why have the nvidia driver installed?
>
> Perhaps explain what you are trying to achieve rather than asking for help
> on how to sold what you think the problem is.
>
> PS I have trimmed the CCs as that seems impolite.
>
> --
> Daniel O'Connor
> "The nice thing about standards is that there
> are so many of them to choose from."
> -- Andrew Tanenbaum
>
>

-- 
Mario.