From nobody Thu Feb 10 14:19:57 2022 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 8B63B19C28EB for ; Thu, 10 Feb 2022 14:20:35 +0000 (UTC) (envelope-from marietto2008@gmail.com) Received: from mail-lf1-x12e.google.com (mail-lf1-x12e.google.com [IPv6:2a00:1450:4864:20::12e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Jvf6V6HcYz4qXb for ; Thu, 10 Feb 2022 14:20:34 +0000 (UTC) (envelope-from marietto2008@gmail.com) Received: by mail-lf1-x12e.google.com with SMTP id f41so3572634lfv.12 for ; Thu, 10 Feb 2022 06:20:34 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:from:date:message-id:subject:to; bh=84G7ohZ0gU7sKLGzWs7mvz55jmjOimxuAGROFwSdw4M=; b=eaKgrRzdwy3IGNa2Y5DArhhAJejeWClYHDGfVEIOwiGPOt+ak4eyEkLV/rVzs7+do7 NBosUjUtM5TbxWgjsFe210Ux5+cPuyyNYiwap4WzHBbDScs5jsqGpid4+/HGbA7ESZbV DV4e/+Fg2mxBydkX4RpC1MXVTfnjitp4/nGkJmK+y8nkg4DRQ5FSHJpm7qk3y2xr9b0t zxpTJk2PBoHgjhZj2TMg0bQOq53iwv3lNjtDnbifRWxOuUMq/eiVPfgh+YQsSnxiFXir rCDgmpAmYc05vth78YY2oEoJtyK/J6GHT3I4w/6ikV2gnUsHzkrAKXssJOMhg1P6pa74 yilw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=84G7ohZ0gU7sKLGzWs7mvz55jmjOimxuAGROFwSdw4M=; b=e8j5sFKjDw3IGtIdn50vqzxTnOQwZShc39IDQGn9HbwfmbBDhohwR2zJkzupLKHqrR gbZz61yClo0/hs1A6lHUwGULTFpePvwHTrzH3Kan1lG884rRfaqPW5s9a7VXHu/U9xQJ 6R+V3Z85vmr32fF6QBwtcSCgn9SWgZRiJtXyUV2rAhx/4angUrHTvbtNhDErVO6wBN+p fPNGsPdYh0JrTr9cSj/rdMRt8FS99M4N1RNQ3sDokgloibyz4nSBX4juFLVYeX7LbFw0 DwPwvPkPZbo1ANH9CacnIHlQePM0kLR2ktKEiHs+QmaXcGCO0OfyKJt/brRm8AxNNimL bbUA== X-Gm-Message-State: AOAM5305Hk7Ma0ZpoDjevbQg4IYufo7Vo8UlpoLOoGhimWihCmu91R5E ZWwPwh8k0HQ6ScTJglvkN88kfxNeeLHW2jF3UuC295xYBFpu+g== X-Google-Smtp-Source: ABdhPJzzaXkbbOTde1BNvt+yf0nppJZnVNfb5BkheMISK+6/CcgwXo7WlCOCJ1X8lrAg2b+V624+/z0SSfqEKp77BZQ= X-Received: by 2002:a05:6512:2821:: with SMTP id cf33mr5252521lfb.37.1644502832978; Thu, 10 Feb 2022 06:20:32 -0800 (PST) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 From: Mario Marietto Date: Thu, 10 Feb 2022 15:19:57 +0100 Message-ID: Subject: !!!! X64 Exception Type - 06(#UD - Invalid Opcode) CPU Apic ID - 00000000 !!!! while trying to pass thru my devices with bhyve on FreeBSD 14-CURRENT To: FreeBSD virtualization Content-Type: multipart/alternative; boundary="000000000000311d2205d7aaa7c5" X-Rspamd-Queue-Id: 4Jvf6V6HcYz4qXb X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=eaKgrRzd; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of marietto2008@gmail.com designates 2a00:1450:4864:20::12e as permitted sender) smtp.mailfrom=marietto2008@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; SUBJECT_HAS_EXCLAIM(0.00)[]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::12e:from]; HTTP_TO_IP(1.00)[]; MLMMJ_DEST(0.00)[freebsd-virtualization]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --000000000000311d2205d7aaa7c5 Content-Type: text/plain; charset="UTF-8" Hello. I've bought an additional PCI to USB (Renesas) controller that I've attached to the PCIe Gen3 x4 (Type 22110) of my MOBO Gigabyte Aorus Pro with Intel I9 chipset and Nvidia Geforce RTX 2080 ti. On this controller I've attached two USB disks and my KInect 2. The nVidia geforce RTX 2080 ti is attached to the PCIe Gen3 x 4 (Type 2280). Check this image : https://ibb.co/fC0jR1p check by yourself the logs showing that my passed through devices are working great : dmesg --> https://pastebin.ubuntu.com/p/cSy7jkHdZz/ pciconf -vl --> https://pastebin.ubuntu.com/p/xZNggrz6D5/ On FreeBSD 14 the bhyve setup below works. I can boot Linux passing through the devices that you see. But I have used a raw image file (not a physical installation on a sata or nvme disk,because in this case it wont work and for this I've opened another bug). With this I want to demonstrate that there aren't any problems with my bios settings and with my passed thru devices. bhyve -S -c sockets=2,cores=2,threads=2 -m 8G -w -H \ -s 0,hostbridge \ -s 1,virtio-blk,/mnt/da1p2/bhyve/os/Linux/impish-cuda-11-5-nvidia-495.img \ -s 3:0,passthru,2/0/0 \ -s 3:1,passthru,2/0/1 \ -s 3:2,passthru,2/0/2 \ -s 3:3,passthru,2/0/3 \ -s 4:0,passthru,1/0/0 \ -s 9,virtio-net,tap0 \ -s 29,fbuf,tcp=0.0.0.0:5900,w=1440,h=900 \ -s 30,xhci,tablet \ -s 31,lpc \ -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \ -l com1,stdio \ vm0 My host graphic card is not an Nvidia card. It's the graphic chipset integrated on the motherboard (CoffeeLake-S GT2 [UHD Graphics 630); to use it I've installed the xf86-video-intel driver with this xorg.conf file : Section "Device" Identifier "Card0" Driver "intel" BusID "PCI:0:2:0" EndSection so,now,let's to straight to this problem : I've created a new VM with the goal to passthru my graphic card and my usb controller from the host os (freebsd 14-CURRENT) to the guest os (freebsd 13R p7) and I've used the parameters below : bhyve -S -c sockets=1,cores=2,threads=2 -m 4G -w -H -A \ -s 0,hostbridge \ -s 1,ahci-hd,/mnt/da2p2/bhyve/os/BSD/freebsd13vm.img \ -s 2,passthru,1/0/0 \ -s 3:0,passthru,2/0/0,rom=TU102.rom \ -s 3:1,passthru,2/0/1 \ -s 3:2,passthru,2/0/2 \ -s 3:3,passthru,2/0/3 \ -s 8,virtio-net,tap1 \ -s 9,virtio-9p,sharename=/ \ -s 29,fbuf,tcp=0.0.0.0:5901,w=1440,h=900,wait \ -s 30,xhci,tablet \ -s 31,lpc \ -l bootrom,/usr/local/share/uefi-firmware/BHYVE_BHF_CODE.fd \ -l com1,stdio \ vm1 inside /etc/rc.conf I've added the following parameters : linux_enable="YES" linux_mounts_enable="YES" vm_enable="YES" kdm5_enable="YES" dbus_enable="YES" sddm_enable="YES" on /boot/loader.conf : nvidia_load="YES" vmm_load="YES" nmdm_load="YES" if_tap_load="YES" if_bridge_load="YES" bridgestp_load="YES" linprocfs_load="YES" linsysfs_load="YES" tmpfs_load="YES" verbose_loading="YES" hw.vmm.topology.cores_per_package=8 kern.racct.enable=1 snd_hda_load="YES" on /etc/sysctl.conf net.link.tap.up_on_open=1 net.inet.ip.forwarding=1 net.inet.ip.random_id=1 kern.evdev.rcpt_mask=6 kern.init_shutdown_timeout="900" kern.capmode_coredump=1 and with this xorg.conf file : Section "ServerLayout" Identifier "X.org Configured" Screen 0 "Screen0" 0 0 #Screen 1 "Screen1" RightOf "Screen0" InputDevice "Mouse0" "CorePointer" InputDevice "Keyboard0" "CoreKeyboard" EndSection Section "Module" Load "glx" EndSection Section "Files" ModulePath "/usr/local/lib/xorg/modules" FontPath "/usr/local/share/fonts/misc/" FontPath "/usr/local/share/fonts/TTF/" FontPath "/usr/local/share/fonts/OTF/" FontPath "/usr/local/share/fonts/Type1/" FontPath "/usr/local/share/fonts/100dpi/" FontPath "/usr/local/share/fonts/75dpi/" FontPath "catalogue:/usr/local/etc/X11/fontpath.d" EndSection Section "InputDevice" Identifier "Mouse0" Driver "mouse" Option "Protocol" "auto" Option "Device" "/dev/sysmouse" Option "ZAxisMapping" "4 5 6 7" EndSection Section "Monitor" Identifier "Monitor0" VendorName "Monitor Vendor" ModelName "Monitor Model" EndSection Section "Device" ### Available Driver options are:- ### Values: : integer, : float, : "True"/"False", ### : "String", : " Hz/kHz/MHz", ### : "%" ### [arg]: arg optional #Option "SWcursor" # [] #Option "kmsdev" # #Option "ShadowFB" # [] #Option "AccelMethod" # #Option "PageFlip" # [] #Option "ZaphodHeads" # #Option "DoubleShadow" # [] #Option "Atomic" # [] Identifier "Card0" Driver "nvidia" BusID "PCI:0:4:0" EndSection this is what happens when I boot it : Loading kernel... /boot/kernel/kernel text=0x17b9e0 text=0xdd6d50 text=0x65ba0c data=0x140 data=0x1b9348+0x445cb8 syms=[0x8+0x178ed8+0x8+0x1990a2] Loading configured modules... snd_hda...if_bridge.../boot/kernel/if_bridge.ko size 0xfc48 at 0x2112000 loading required module 'bridgestp' /boot/kernel/bridgestp.ko size 0x8178 at 0x2122000 tmpfs.../boot/kernel/tmpfs.ko size 0x14820 at 0x212b000 /etc/hostid.../etc/hostid size=0x25 /boot/entropy.../boot/entropy size=0x1000 if_tap...linprocfs.../boot/kernel/linprocfs.ko size 0x10e50 at 0x2141000 loading required module 'linux_common' /boot/kernel/linux_common.ko size 0x2c650 at 0x2152000 nvidia.../boot/modules/nvidia.ko size 0x28c8640 at 0x217f000 loading required module 'linux' /boot/kernel/linux.ko size 0x9e070 at 0x4a48000 nmdm.../boot/kernel/nmdm.ko size 0x4110 at 0x4ae7000 bridgestp...linsysfs.../boot/kernel/linsysfs.ko size 0x79b8 at 0x4aec000 vmm.../boot/kernel/vmm.ko size 0x5748f0 at 0x4af4000 Start @ 0xffffffff8037c000 ... efi_check_space: Unable to expand staging area efi_check_space: Unable to expand staging area EFI framebuffer information: addr, size 0xc3000000, 0x1000000 dimensions 1440 x 900 stride 1440 masks 0x00ff0000, 0x0000ff00, 0x000000ff, 0xff000000 !!!! X64 Exception Type - 06(#UD - Invalid Opcode) CPU Apic ID - 00000000 !!!! RIP - 00000000000C000E, CS - 0000000000000038, RFLAGS - 0000000000010086 RAX - 0000000054A218D8, RCX - 0000000000000002, RDX - 0000000000000002 RBX - 0000000005069001, RSP - 00000000BFF58098, RBP - 00000000BFF58100 RSI - 0000000000001000, RDI - 0000000040001000 R8 - 0000000000000001, R9 - 00000000BFF580D8, R10 - 00000000B902D6E0 R11 - 0000000000000D80, R12 - 00000000BE819050, R13 - 0000000005069000 R14 - 00000000BE819058, R15 - 00000000BE819048 DS - 0000000000000030, ES - 0000000000000030, FS - 0000000000000030 GS - 0000000000000030, SS - 0000000000000030 CR0 - 0000000080010033, CR2 - 0000000000000000, CR3 - 00000000BFC01000 CR4 - 0000000000000668, CR8 - 0000000000000000 DR0 - 0000000000000000, DR1 - 0000000000000000, DR2 - 0000000000000000 DR3 - 0000000000000000, DR6 - 00000000FFFF0FF0, DR7 - 0000000000000400 GDTR - 00000000BFBEEA98 0000000000000047, LDTR - 0000000000000000 IDTR - 00000000BF832018 0000000000000FFF, TR - 0000000000000000 FXSAVE_STATE - 00000000BFF57CF0 !!!! Can't find image information. !!!! it freezes here and I can't do anything anymore. -- Mario. --000000000000311d2205d7aaa7c5 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hello.

I've bought an additional PCI to US= B (Renesas) controller that I've attached to the PCIe Gen3 x4 (Type 221= 10) of my MOBO Gigabyte Aorus Pro with Intel I9 chipset and Nvidia Geforce = RTX 2080 ti. On this controller I've attached two USB disks and my KIne= ct 2. The nVidia geforce RTX 2080 ti is attached to the PCIe Gen3 x 4 (Type= 2280). Check this image : https://ibb.c= o/fC0jR1p

check by yourself the logs showing that my passed th= rough devices are working great :

dmesg --> https://pastebin.ubuntu.com/p/cSy7jkHdZz/<= /a>
pciconf -vl --> https://pastebin.ubuntu.com/p/xZNggrz6D5/

On FreeBSD 14 the= bhyve setup below works. I can boot Linux passing through the devices that= you see. But I have used a raw image file (not a physical installation on = a sata or nvme disk,because in this case it wont work and for this I've= opened another bug). With this I want to demonstrate that there aren't= any problems with my bios settings and with my passed thru devices.
bhyve -S -c sockets=3D2,cores=3D2,threads=3D2 -m 8G -w -H \
-s 0,hostbr= idge \
-s 1,virtio-blk,/mnt/da1p2/bhyve/os/Linux/impish-cuda-11-5-nvidia= -495.img \
-s 3:0,passthru,2/0/0 \
-s 3:1,passthru,2/0/1 \
-s 3:2,= passthru,2/0/2 \
-s 3:3,passthru,2/0/3 \
-s 4:0,passthru,1/0/0 \
-= s 9,virtio-net,tap0 \
-s 29,fbuf,tcp=3D0= .0.0.0:5900,w=3D1440,h=3D900 \
-s 30,xhci,tablet \
-s 31,lpc \-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd \
-l com1,stdio= \
vm0
=C2=A0
My host graphic card is not an Nvidia card. It's= the graphic chipset integrated on the motherboard (CoffeeLake-S GT2 [UHD G= raphics 630); to use it I've installed the xf86-video-intel driver with= this xorg.conf file :

Section "Device"
Identifier =C2= =A0"Card0"
Driver =C2=A0 =C2=A0 =C2=A0"intel"
Bus= ID =C2=A0 =C2=A0 =C2=A0 "PCI:0:2:0"
EndSection

so,now,l= et's to straight to this problem :

I've created a new VM wit= h the goal to passthru my graphic card and my usb controller from the host = os (freebsd 14-CURRENT) to the guest os (freebsd 13R p7) and I've used = the parameters below :

bhyve -S -c sockets=3D1,cores=3D2,threads=3D2= -m 4G -w -H -A \
-s 0,hostbridge \
-s 1,ahci-hd,/mnt/da2p2/bhyve/os/= BSD/freebsd13vm.img \
-s 2,passthru,1/0/0 \
-s 3:0,passthru,2/0/0,rom= =3DTU102.rom \ =C2=A0 =C2=A0
-s 3:1,passthru,2/0/1 \
-s 3:2,passthru= ,2/0/2 \
-s 3:3,passthru,2/0/3 \
-s 8,virtio-net,tap1 \
-s 9,virti= o-9p,sharename=3D/ \
-s 29,fbuf,tcp=3D0.= 0.0.0:5901,w=3D1440,h=3D900,wait \
-s 30,xhci,tablet \
-s 31,lpc = \
-l bootrom,/usr/local/share/uefi-firmware/BHYVE_BHF_CODE.fd \
-l co= m1,stdio \
vm1

inside /etc/rc.conf I've added the following p= arameters :

linux_enable=3D"YES"
linux_mounts_enable=3D= "YES"
vm_enable=3D"YES"
kdm5_enable=3D"YES&q= uot;
dbus_enable=3D"YES"
sddm_enable=3D"YES"
<= br>on /boot/loader.conf :

nvidia_load=3D"YES"
vmm_load= =3D"YES"
nmdm_load=3D"YES"
if_tap_load=3D"YE= S"
if_bridge_load=3D"YES"
bridgestp_load=3D"YES&q= uot;
linprocfs_load=3D"YES"
linsysfs_load=3D"YES"=
tmpfs_load=3D"YES"
verbose_loading=3D"YES"
hw= .vmm.topology.cores_per_package=3D8
kern.racct.enable=3D1
snd_hda_loa= d=3D"YES"

on /etc/sysctl.conf

net.link.tap.up_on_op= en=3D1
net.inet.ip.forwarding=3D1
net.inet.ip.random_id=3D1
kern.e= vdev.rcpt_mask=3D6
kern.init_shutdown_timeout=3D"900"
kern.= capmode_coredump=3D1

and with this xorg.conf file :

Section &= quot;ServerLayout"
=C2=A0 =C2=A0 =C2=A0 =C2=A0Identifier =C2=A0 =C2= =A0 "X.org Configured"
=C2=A0 =C2=A0 =C2=A0 =C2=A0Screen =C2= =A0 =C2=A0 =C2=A00 =C2=A0"Screen0" 0 0
=C2=A0 =C2=A0 =C2=A0 = =C2=A0#Screen =C2=A0 =C2=A0 =C2=A01 =C2=A0"Screen1" RightOf "= ;Screen0"
=C2=A0 =C2=A0 =C2=A0 =C2=A0InputDevice =C2=A0 =C2=A0"= ;Mouse0" "CorePointer"
=C2=A0 =C2=A0 =C2=A0 =C2=A0InputDe= vice =C2=A0 =C2=A0"Keyboard0" "CoreKeyboard"
EndSect= ion

Section "Module"
=C2=A0 =C2=A0 =C2=A0 =C2=A0Load = =C2=A0"glx"
EndSection

Section "Files"
=C2= =A0 =C2=A0 =C2=A0 =C2=A0ModulePath =C2=A0 "/usr/local/lib/xorg/modules= "
=C2=A0 =C2=A0 =C2=A0 =C2=A0FontPath =C2=A0 =C2=A0 "/usr/loca= l/share/fonts/misc/"
=C2=A0 =C2=A0 =C2=A0 =C2=A0FontPath =C2=A0 =C2= =A0 "/usr/local/share/fonts/TTF/"
=C2=A0 =C2=A0 =C2=A0 =C2=A0F= ontPath =C2=A0 =C2=A0 "/usr/local/share/fonts/OTF/"
=C2=A0 =C2= =A0 =C2=A0 =C2=A0FontPath =C2=A0 =C2=A0 "/usr/local/share/fonts/Type1/= "
=C2=A0 =C2=A0 =C2=A0 =C2=A0FontPath =C2=A0 =C2=A0 "/usr/loca= l/share/fonts/100dpi/"
=C2=A0 =C2=A0 =C2=A0 =C2=A0FontPath =C2=A0 = =C2=A0 "/usr/local/share/fonts/75dpi/"
=C2=A0 =C2=A0 =C2=A0 = =C2=A0FontPath =C2=A0 =C2=A0 "catalogue:/usr/local/etc/X11/fontpath.d&= quot;
EndSection

Section "InputDevice"
=C2=A0 =C2=A0= =C2=A0 =C2=A0Identifier =C2=A0"Mouse0"
=C2=A0 =C2=A0 =C2=A0 = =C2=A0Driver =C2=A0 =C2=A0 =C2=A0"mouse"
=C2=A0 =C2=A0 =C2=A0 = =C2=A0Option =C2=A0 =C2=A0 =C2=A0"Protocol" "auto"
= =C2=A0 =C2=A0 =C2=A0 =C2=A0Option =C2=A0 =C2=A0 =C2=A0"Device" &q= uot;/dev/sysmouse"
=C2=A0 =C2=A0 =C2=A0 =C2=A0Option =C2=A0 =C2=A0 = =C2=A0"ZAxisMapping" "4 5 6 7"
EndSection

Sec= tion "Monitor"
=C2=A0 =C2=A0 =C2=A0 =C2=A0Identifier =C2=A0 &q= uot;Monitor0"
=C2=A0 =C2=A0 =C2=A0 =C2=A0VendorName =C2=A0 "Mo= nitor Vendor"
=C2=A0 =C2=A0 =C2=A0 =C2=A0ModelName =C2=A0 =C2=A0&qu= ot;Monitor Model"
EndSection

Section "Device"
= =C2=A0 =C2=A0 =C2=A0 =C2=A0### Available Driver options are:-
=C2=A0 =C2= =A0 =C2=A0 =C2=A0### Values: <i>: integer, <f>: float, <bool= >: "True"/"False",
=C2=A0 =C2=A0 =C2=A0 =C2=A0###= <string>: "String", <freq>: "<f> Hz/kHz/M= Hz",
=C2=A0 =C2=A0 =C2=A0 =C2=A0### <percent>: "<f>= ;%"
=C2=A0 =C2=A0 =C2=A0 =C2=A0### [arg]: arg optional
=C2=A0 = =C2=A0 =C2=A0 =C2=A0#Option =C2=A0 =C2=A0 "SWcursor" =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0# [<bool>]
=C2= =A0 =C2=A0 =C2=A0 =C2=A0#Option =C2=A0 =C2=A0 "kmsdev" =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0# <str>=C2=A0 =C2=A0 =C2=A0 =C2=A0#Option =C2=A0 =C2=A0 "ShadowFB" =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0# [<bool>]=
=C2=A0 =C2=A0 =C2=A0 =C2=A0#Option =C2=A0 =C2=A0 "AccelMethod"= ; =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 # <str>
=C2=A0 = =C2=A0 =C2=A0 =C2=A0#Option =C2=A0 =C2=A0 "PageFlip" =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0# [<bool>]
=C2= =A0 =C2=A0 =C2=A0 =C2=A0#Option =C2=A0 =C2=A0 "ZaphodHeads" =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 # <str>
=C2=A0 =C2= =A0 =C2=A0 =C2=A0#Option =C2=A0 =C2=A0 "DoubleShadow" =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0# [<bool>]
=C2=A0 =C2=A0 =C2= =A0 =C2=A0#Option =C2=A0 =C2=A0 "Atomic" =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0# [<bool>]
=C2=A0 =C2= =A0 =C2=A0 =C2=A0Identifier =C2=A0"Card0"
=C2=A0 =C2=A0 =C2=A0= =C2=A0Driver =C2=A0 =C2=A0 =C2=A0"nvidia"
=C2=A0 =C2=A0 =C2= =A0 =C2=A0BusID =C2=A0 =C2=A0 =C2=A0 "PCI:0:4:0"
EndSection
this is what happens when I boot it :

Loading kernel...
/boo= t/kernel/kernel text=3D0x17b9e0 text=3D0xdd6d50 text=3D0x65ba0c data=3D0x14= 0 data=3D0x1b9348+0x445cb8 syms=3D[0x8+0x178ed8+0x8+0x1990a2]
Loading co= nfigured modules...
snd_hda...if_bridge.../boot/kernel/if_bridge.ko size= 0xfc48 at 0x2112000
loading required module 'bridgestp'
/boo= t/kernel/bridgestp.ko size 0x8178 at 0x2122000
tmpfs.../boot/kernel/tmpf= s.ko size 0x14820 at 0x212b000
/etc/hostid.../etc/hostid size=3D0x25
= /boot/entropy.../boot/entropy size=3D0x1000
if_tap...linprocfs.../boot/k= ernel/linprocfs.ko size 0x10e50 at 0x2141000
loading required module = 9;linux_common'
/boot/kernel/linux_common.ko size 0x2c650 at 0x21520= 00
nvidia.../boot/modules/nvidia.ko size 0x28c8640 at 0x217f000
loadi= ng required module 'linux'
/boot/kernel/linux.ko size 0x9e070 at= 0x4a48000
nmdm.../boot/kernel/nmdm.ko size 0x4110 at 0x4ae7000
bridg= estp...linsysfs.../boot/kernel/linsysfs.ko size 0x79b8 at 0x4aec000
vmm.= ../boot/kernel/vmm.ko size 0x5748f0 at 0x4af4000
Start @ 0xffffffff8037c= 000 ...
efi_check_space: Unable to expand staging area
efi_check_spac= e: Unable to expand staging area
EFI framebuffer information:
addr, s= ize =C2=A0 =C2=A0 0xc3000000, 0x1000000
dimensions =C2=A0 =C2=A0 1440 x = 900
stride =C2=A0 =C2=A0 =C2=A0 =C2=A0 1440
masks =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A00x00ff0000, 0x0000ff00, 0x000000ff, 0xff000000
!!!! X64= Exception Type - 06(#UD - Invalid Opcode) =C2=A0CPU Apic ID - 00000000 !!!= !
RIP =C2=A0- 00000000000C000E, CS =C2=A0- 0000000000000038, RFLAGS - 00= 00000000010086
RAX =C2=A0- 0000000054A218D8, RCX - 0000000000000002, RDX= - 0000000000000002
RBX =C2=A0- 0000000005069001, RSP - 00000000BFF58098= , RBP - 00000000BFF58100
RSI =C2=A0- 0000000000001000, RDI - 00000000400= 01000
R8 =C2=A0 - 0000000000000001, R9 =C2=A0- 00000000BFF580D8, R10 - 0= 0000000B902D6E0
R11 =C2=A0- 0000000000000D80, R12 - 00000000BE819050, R1= 3 - 0000000005069000
R14 =C2=A0- 00000000BE819058, R15 - 00000000BE81904= 8
DS =C2=A0 - 0000000000000030, ES =C2=A0- 0000000000000030, FS =C2=A0- = 0000000000000030
GS =C2=A0 - 0000000000000030, SS =C2=A0- 00000000000000= 30
CR0 =C2=A0- 0000000080010033, CR2 - 0000000000000000, CR3 - 00000000B= FC01000
CR4 =C2=A0- 0000000000000668, CR8 - 0000000000000000
DR0 =C2= =A0- 0000000000000000, DR1 - 0000000000000000, DR2 - 0000000000000000
DR= 3 =C2=A0- 0000000000000000, DR6 - 00000000FFFF0FF0, DR7 - 0000000000000400<= br>GDTR - 00000000BFBEEA98 0000000000000047, LDTR - 0000000000000000
IDT= R - 00000000BF832018 0000000000000FFF, =C2=A0 TR - 0000000000000000
FXSA= VE_STATE - 00000000BFF57CF0
!!!! Can't find image information. !!!!<= br>
it freezes here and I can't do anything anymore.

--
Mario.
--000000000000311d2205d7aaa7c5--