From nobody Mon Aug 16 21:58:07 2021 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id E09FD1768083 for ; Mon, 16 Aug 2021 21:58:15 +0000 (UTC) (envelope-from bergerkos@yahoo.co.uk) Received: from sonic302-21.consmr.mail.ir2.yahoo.com (sonic302-21.consmr.mail.ir2.yahoo.com [87.248.110.84]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4GpShk09QHz3lLb for ; Mon, 16 Aug 2021 21:58:13 +0000 (UTC) (envelope-from bergerkos@yahoo.co.uk) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.co.uk; s=s2048; t=1629151091; bh=79uwKsJSeoOprLALfYveXmZomVP8RPnaNhEmuo6DkX4=; h=Date:From:To:In-Reply-To:References:Subject:From:Subject:Reply-To; b=eURo7uOQzJGBCIZ5WchymwrGTAFCNrI+gHxpkcxmB1PGLbo40peAvLYS1VXiEli1gRyLJZdSwEXshue+eZhF2WEoHkdx9m6w2HInIO/UYekXICG4xk+zy/cQI2tSSU6ALW9wqmetqwMTFEWssaHmoHQALBnJWS1BzcHJDnT6f8xT1BxWX0e8+EdwcKdHk6UswRQBspBAH/4vjAOLfYNs1D4iqzgNJFpk/VznOidtl85SjxOax/l3QAfP3izKaTv1rBtNQwXsos44xCllKV4hGvxhPJbJ4Pxb0hcpw3cvfYY593Ct1dAfRcAAbHQrhOsLY/qEE9LkcGIiCV2Bg77rDQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1629151091; bh=dqjmpoSjdGc4df3JqCdeYTJ2zmn3FeHAjK9NRISdKtA=; h=X-Sonic-MF:Date:From:To:Subject:From:Subject; b=QdqET8oAyHDQ1aYeVRiD6noEfgT3zMafaA9qzo3RBRWNRVZWioMPxe6x4c2ecDSG78oot4c7nMatFTNO85TdH6G3lg27wabQDRCRAxogGWjwEH/sUpcl7fb8AVTb5INTLR9nUCmGwp5W1BBCEq3LJG6GTSIz8DwyatCrQtazE8pi3A3OlEJpDzUyU5iKXCt89J4aHbsUnt+ApYvt4GNzzRB6IkSJsF/oXFSXfizcU8kJs76IZ8ctgjuW76hpqim7nRbLbFz2U5si0rDiAJ1ghiLJ4Cm2EnY7OjaGmRCHLqHKeseEOTXk3HrqSd+f4hbqQR7EYfsepdCbYFsmIyKFvg== X-YMail-OSG: OLWFRp8VM1k8mv0WgdQERoPIWQi6msfhZnuggiZY40N0frZd0DzZ_VwP43eCkIp z8tz4XWhbvFdaN4ZAwf5Udw3Q1ihrbd0HHCp.E.4JMEYi7X_zjYyirrr3aWFAlhSETXtui8ubYAx 9dhJOjYrv1F.zwa0VYgcE2pCVoaRuDc.nX4vTEWXmSaGglFxUbORDVBflodtIdGWXo5d1D6fJJhU 4Et0uzphBck5M3IoyUDmo2WP4rGsfCVMhRKB_S6fQHW27OiaDtes7Zs2KE4s73GKZ1tXSPS_j.dS YwaBUOoi3HSDznIyVJO83YQmDZVnYCHfPyP8Xd5NT8EqtBUkAAqYdBKsyHFoItrafIkSlCK5.6.k HCQnXHFQoPLxYJ7XorBrRxIc829uhGrjTpQUb_y5oYIT1Zx9AiclGlG5N2oBsjoFCwvDwQiVDd2J 8CwLzedYCopzGsVxFK7wo6gPaEomnuP0YsO6vWIBoN01uOMQyjv1dGDjSvFK8.bDEv5pzxGlgLyz vU2EaB1V16l3lCocRDeGkrYnzMQuCVOaY4umyJwF27xc62HVfGNQSgJMvghBvfiWmV7YaggjMjkX 4k7pl2kY4z3RY8KXRLG19u6KtqB1tHSqhedJxI5BEPpPC843tgjKRRV5PUpg4xuXE0H0r83SosyJ aP9DWMiTZvgadXk1_cOh03jsNqI6vUlBUJcAI4416bvinVpQtUNa01XYiAdDn2PVY2tXn6G06EZb UqUwyMP.DX9TqaKHMQvbLG9wc6JMZyCrptFp2A0vHv8FsHxJ8bgn5YqfKP5tOGMsS9geaSNVpSSG 1hokcesF8cUBnocDUxZn.4elFI9NwmO3z73LKCukL5ulKad85U5Uhu_tIsSDU5sse8V9hejuj5EQ At_Afb57c7P5waZGbQbBs5hr_swnocmNGUVHaPYBqZsv_B5Y2SyslEigTnh4Ywy4SHmmYmmEoTCV y3PJ9F7nAG9uSg91UG_KxJPR5bjN37nwN7NrG8HgHc4zjdwUA2wxyRhiKoONF.U.sjWzFcK5V9we N7qLXKtj4aEKaHOBO9XZVUKG3IHNrD8IPF0eobeCjjpWJV0TrQFqpff34L.De6ixOpXJKuEjWtJ6 AFq6IWENRKUmbfrxtWWnf1f9lIAwYa2h__yPBDvX4FxjwWhO6a3J94ODyl9jfZqQPkUeC5whBLsm I4I8Q2eGzE2xgEmQUjtL7qGIuI.oIEZgpy7MceAe9yJ0yn0uIO7z5ZTCTxbfO7IGN7TddA0291BM x5zaegQSN_XSELXveIU6XNFDaaNr1_8AxvAywmniTCtvtooxO323ixd694XzrJrW1MqEkx1gbrYd ZgSCbhZWv8YB6H3beJJBON1Kgm.p4QLZr2ji5nE1xa7HugBfam.dPZ3n97RK3lSDwv3mYT02v5Xi svYxtRPGGvRDAFhfNN5H0X4ke0bg23b1PbJvYLViD.vgZWXHQNCL1ALcZCbfBqQhBMLQl65uzgPS XocegI2nbwrGqqAfdbSUZiu.bjjZCsAI.w4k_7joZJQSepiJf3OFHdumM_6nY3Kq.vYYhIjbf5Sv 6aJIhJ_SMHfoE8zLtTjM5BVEMyySZWHkz43WKm.jg7Q1TMn0OmVgBF6MMfM1LAoaYUNrT.uILgk0 biD0PGkzktVd9t2MD2mh8JkC9DkFg1vmWA4NQDyqjaJ0TiLL.AWOMHcUmLTDAgGq93PnMGr0XP_n JNpcAy0RI5mP3ZoDFPMP76EipZWiZPMkMOQ79cCGFFThRBgCjyCo.bxqMlqXG5FAoWQ_oRa3ZYGJ 0T6.hrtDvZZ85UJTxXJM1G.h0HfVnAgpn5Mo2cIxIgmpiYNxSymsXRgW0SNM3t.gWRVzB_tnwA8H u8GsboQEL2rSRcfQjL0sIOsubbLsA4FUat55d2fXvNSCADrvdSmwrGG2NFozb8Qt9BhcScY1jeqs MUmbohXLB.GAabhVnVuUKt4Mx2GsKkO0ctRNSh7O4hUIvyY2C1nBikn06lntI5RQJNaNWy7kwhDM BApAL9Qext9XyaXLL1s75k77yl7uaTn3A33Thl_QV5JY2DWM7NxDR2MZL1gpsNh3UENFZfTWv85y Qxty7xZK9_NeCk7wn0prtJEiTSGi8ADFjlcIPoEUHONcUXXw0f7K7iPXJSh3CryZeZGBfvVZCWJt 5wpwPH0EwcMNl_tzDRJKgAjmawFeVFzCqr2cdpNMihggc0gMbYYCYB9wJhRCi5h88Yl_eLXwe4Qg tZxAT7QfWnBynImYJ8fTVO4PQ2TOxCsPKXonKZTRXCfeeXvMSJXFZHDH22eU68znxDQ-- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic302.consmr.mail.ir2.yahoo.com with HTTP; Mon, 16 Aug 2021 21:58:11 +0000 Date: Mon, 16 Aug 2021 21:58:07 +0000 (UTC) To: "freebsd-virtualization@FreeBSD.org" Message-ID: <966160298.1289476.1629151087763@mail.yahoo.com> In-Reply-To: <1464014049.1262174.1629143810702@mail.yahoo.com> References: <1719430894.822301.1629094618334.ref@mail.yahoo.com> <1719430894.822301.1629094618334@mail.yahoo.com> <272551640.837942.1629097084918@mail.yahoo.com> <1464014049.1262174.1629143810702@mail.yahoo.com> Subject: Re: debug crash List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_1289475_384571049.1629151087761" X-Mailer: WebService/1.1.18850 YMailNorrin X-Rspamd-Queue-Id: 4GpShk09QHz3lLb X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.co.uk header.s=s2048 header.b=eURo7uOQ; dmarc=pass (policy=reject) header.from=yahoo.co.uk; spf=pass (mx1.freebsd.org: domain of bergerkos@yahoo.co.uk designates 87.248.110.84 as permitted sender) smtp.mailfrom=bergerkos@yahoo.co.uk X-Spamd-Result: default: False [-4.00 / 15.00]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.co.uk:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.co.uk]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCPT_COUNT_ONE(0.00)[1]; DKIM_TRACE(0.00)[yahoo.co.uk:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.co.uk,reject]; RCVD_IN_DNSWL_NONE(0.00)[87.248.110.84:from]; NEURAL_HAM_SHORT(-1.00)[-1.000]; TO_DN_EQ_ADDR_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[yahoo.co.uk]; ASN(0.00)[asn:34010, ipnet:87.248.110.0/24, country:GB]; RCVD_COUNT_TWO(0.00)[2]; RWL_MAILSPIKE_POSSIBLE(0.00)[87.248.110.84:from] Reply-To: bergerkos@yahoo.co.uk From: Kostya Berger via freebsd-virtualization X-Original-From: Kostya Berger X-ThisMailContainsUnwantedMimeParts: N ------=_Part_1289475_384571049.1629151087761 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable OK, went back to BIOS and reset to defaults, that fixed it.Too bad we won't= be able now to figure out the problem... But then, I doubt that anyone wil= l use this combination of hardware anyway... With kindest regards, Kostya Berger =20 =20 On Monday, 16 August 2021, 22:57:19 GMT+3, Kostya Berger via freebsd-vi= rtualization wrote: =20 =20 OK, here is another part of the crash message:vm exit[0] reason=C2=A0 =C2=A0 =C2=A0 =C2=A0 VMX ip=C2=A0 =C2=A0 =C2=A0 =C2=A0 0x00000000015eaa03 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 inst_length=C2=A0 =C2= =A0 2 status=C2=A0 =C2=A0 =C2=A0 =C2=A0 0 exit_reason=C2=A0 =C2=A0 2 (Triple fault) =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 qualification=C2=A0 =C2=A0 0x= 0000000000000000 inst_type=C2=A0 =C2=A0 =C2=A0 =C2=A0 0 inst_error=C2=A0 0Additional information: this ONLY happens to Windows-10 b= ased VMs -- whether existing one or just a Win-10 Pro installation ISO boot= ed for initial setup.Tried to boot Ubuntu on the same machine -- all boots = fine. With kindest regards, Kostya Berger =20 =20 =C2=A0 =C2=A0 On Monday, 16 August 2021, 09:58:54 GMT+3, Kostya Berger via = freebsd-virtualization wrote:=C2=A0=20 =20 Forgot to mention, I'm using 2 passthrough PCI-e cards. But the problem is= , it crashes even without passthrough enabled. With kindest regards, Kostya Berger =20 =20 =C2=A0 =C2=A0 On Monday, 16 August 2021, 09:16:58 GMT+3, Kostya Berger wrote:=C2=A0=20 =20 Hello, dear friends :) I"m on 13.0-p3. Suddenly, after some hardware reconfiguration (PCI-e cards = exchanged slots) my bhyve stopped working.In particular, in my Win 10 VM, i= t goes as far as offer to type in BitLocker password, after which starts bo= oting and immediately crashes. However, I tried to start afresh without ANY= disks attached, except Win 10 installation ISO. Gets as far as 'type a key= to boot from CD', then crashes on an attempt to boot. This is the message that I see on the screen:./bhyve-1: line 11: =C2=A02954= Abort trap =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0bhyve -S -c soc= kets=3D1,cores=3D4,threads=3D2 -m 8G -H -w -s 0,hostbridge -s 4,virtio-blk,= win-alt.img,sectorsize=3D512/4096 -s 5,ahci-cd,Win10_21H1_English_x64.iso -= s 29,fbuf,tcp=3D0.0.0.0:5900,w=3D1600,h=3D900,wait -s 30,xhci,tablet -s 31,= lpc -l com1,stdio -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd w= indows-10 For the purity of experiment, I tried it with a fresh installation on the s= ame machine -- same thing. So I assume it is hardware related. As such, I r= ecall in the past there was a patch=20 NOTE: in the past, pre-13.0, I had similar crash related to a PCI-e card wi= th multiple bars, as described here:https://forums.freebsd.org/threads/bhyv= e-pci-passthru-windows-10-problem.74265/ However, the patch cured that, and it has long been incorporated into the b= hyve code... But the card is still in my machine, it's a 4-port Intel NIC. = I haven't yet tried removing this or that card from my system... didn't hav= e the time yet. But I'd like to keep having it, of course... My question is, how can I debug this crash? In dmesg it only says:pid 2954 = (bhyve), jid 0, uid 0: exited on signal 6=20 With kindest regards, Kostya Berger =20 =C2=A0=C2=A0 =20 ------=_Part_1289475_384571049.1629151087761--