From nobody Thu Mar 28 00:33:39 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4V4l0K3FDRz5FnpW for ; Thu, 28 Mar 2024 00:34:09 +0000 (UTC) (envelope-from jbo@insane.engineer) Received: from mail-4022.proton.ch (mail-4022.proton.ch [185.70.40.22]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "protonmail.com", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4V4l0G5t6jz45tJ for ; Thu, 28 Mar 2024 00:34:06 +0000 (UTC) (envelope-from jbo@insane.engineer) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=insane.engineer header.s=protonmail3 header.b=FtH3d+s7; dmarc=pass (policy=none) header.from=insane.engineer; spf=pass (mx1.freebsd.org: domain of jbo@insane.engineer designates 185.70.40.22 as permitted sender) smtp.mailfrom=jbo@insane.engineer DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=insane.engineer; s=protonmail3; t=1711586038; x=1711845238; bh=NCyTKZnI7wrtC9m4KuCYS7APDYPasUSqMr4pghlNeZ8=; h=Date:To:From:Subject:Message-ID:Feedback-ID:From:To:Cc:Date: Subject:Reply-To:Feedback-ID:Message-ID:BIMI-Selector; b=FtH3d+s7PvjhhNaYZWAQ2KgL/RwKNwf1LkU8cdS+pi61MARFfSS1VstECjKbT5Ek/ pRBpoo50n9dQUbY/vpuYcHwy2VOmndRP68dXXQu46OkcDw+K4xFLgEZpAFm/9HL0IT 96mUnPo0Ty/i16wP0PB8JhGpEXZJrcmB15D12RLcglUj5/5LUrSEcEfYGSiIWgfKNc +VO8OfMlPuHlaCns7k1W0bUN0YoEoJOHmtoIRoKc/Svs6d4LfgxF8mg92g++gcQDBH oC2oq08Tz3FsjeKV0yEUg4LP8VZDcqxW8aWQgqEfUBOmUf4qjZ03kOs77UcHgMiqbU t/uNDJy5JE1iw== Date: Thu, 28 Mar 2024 00:33:39 +0000 To: "freebsd-virtualization@freebsd.org" From: jbo@insane.engineer Subject: Windows guest hangs with PCI passthru if more than once core Message-ID: Feedback-ID: 40997969:user:proton List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.20 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[insane.engineer,none]; RWL_MAILSPIKE_VERYGOOD(-0.20)[185.70.40.22:from]; R_DKIM_ALLOW(-0.20)[insane.engineer:s=protonmail3]; R_SPF_ALLOW(-0.20)[+ip4:185.70.40.0/24]; MIME_GOOD(-0.10)[text/plain]; FREEFALL_USER(0.00)[jbo]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:62371, ipnet:185.70.40.0/24, country:CH]; FROM_NO_DN(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_ZERO(0.00)[0]; MID_RHS_MATCH_FROM(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MISSING_XM_UA(0.00)[]; TO_DN_EQ_ADDR_ALL(0.00)[]; MLMMJ_DEST(0.00)[freebsd-virtualization@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[insane.engineer:+] X-Rspamd-Queue-Id: 4V4l0G5t6jz45tJ Hey guys, I'm currently dealing with an issue that's almost driving me insane. Scenario: - FreeBSD FreeBSD 14.0-STABLE #5 stable/14-n266935-fdfb8e783c3e: Tue Mar = 5 17:41:08 CET 2024 - Intel Core i7-8086K - Windows 11 Pro guest What I'm observing is that the VM guest generally boots and works fine with= out any issues. However, once I passthru a PCIe USB controller card, the VM seems to hang w= hen Windows is booting. At that point, I can only kill -9 the bhyve process. Anything else just han= gs (including bhyvectl --destroy). If I change the VM configuration to use only 1 CPU core, it boots fine 100%= of the time with the passthru. The same is true if I give it 1 CPU core and 2 threads (boots fine 100% of = the time). But once I give it more than 1 CPU core, it locks up when the passthru is e= nabled. Is this a known issue? I have seen [1] but I'm not sure whether it's the sa= me scenario or whether there are any patches I could apply to get me out of this madness. I earlier posted here [2]. [1] https://lists.freebsd.org/archives/freebsd-virtualization/2023-January/= 001080.html [2] https://forums.freebsd.org/threads/bhyve-vm-stuck-when-passthru-enabled= .92854 Best regards, ~ jbo@