From nobody Sat May 04 18:06:59 2024 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VWwc40mDSz5JJmF for ; Sat, 4 May 2024 18:07:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4VWwc34k1Pz4vFB for ; Sat, 4 May 2024 18:06:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1714846019; a=rsa-sha256; cv=none; b=JCog1giuZ8iq7is5+aRIVg3YvW36XUbFWDVNw9SQqmNs6UIlQzuM+UCiRzpFCdT59F6S9Q cbjVajs7ww3TWsWq5k4SK6KWnWmgZm9nmcHmIFpHphEdyCeiLXOkTIO5q16n+JUYa9aQzo BvBbEIqbiclNlO2PgJmG4dsHzTzIKcsFNRyYLUb6BKIUgR2YR8tQXCBleKmUw6qW/OpvWt mpejBJtXYic4BPFZzYi6f52VZzpXJoiKwhmuEgdfzu1RkxHe+khorup6pS/zmM/2KMrJfG 2B1KRQ8ZqFr9tFiVn3aLypptB+UFpDAbVr1bieC1D0DPUTR3gnRi0n56dVJ3yg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1714846019; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=FcF9DDeGYfx3B9AcEe6dju75AAkPXTZrk5d2Ckqlpp0=; b=X3kEzK721pCuLe9OCkMJwZJoctaFj8RwfEDrcNLerROCSJmyDQmfOTaaHayUnAF8ESgXIE d2EmDz7bbpU+6j/MLb8vqlQVk6uZDmDSBh2nNjfZ/IxOfR4sGSMeC9ROzpAZG9z+8cjOGq VMGTyJFOdBSQv8ZIxkZWqNr7yiGBiOST8ZzAqS2Mq2b0zcRz5KGbvSjTvF2J60v8Cr9Xxp A3Ga6kZIcBWQ25iEMxfG605C8+cJhxzYSmtxao/d6+OrU7w0HvLYGxb7S6mZD+lT1jdMIi aQFyWVPzuJ91D+veYzlhvZqSNcIUUP8Noue+KnQnmr34127zKCI1t/sWZKg+Kg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4VWwc34Dw3zg7x for ; Sat, 4 May 2024 18:06:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 444I6x1t080392 for ; Sat, 4 May 2024 18:06:59 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 444I6xiH080387 for virtualization@FreeBSD.org; Sat, 4 May 2024 18:06:59 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 278058] Simultaneous use of Bhyve AND vnet on network PCI devices causes network failure Date: Sat, 04 May 2024 18:06:59 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: 14.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mark@markmcb.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D278058 --- Comment #1 from Mark McBride --- I listened the the bhyve production user call [1] and noticed people still speculating that bhyve+vnet SR-IOV issues might be PCI card specific. To clarify, I can reproduce this issue 100% of the time on Chelsio, Intel, and Mellanox NICs. I have reproduced it on two Supermicro motherboards (X12STH-= F, X11SSM-F) with 3 different Intel CPUs (Xeon E-2388G, Xeon E-2324G, Xeon E3-= 1275 v6).=20 So if hardware is a consideration, the only common thread for me is Supermi= cro motherboards and Intel Xeon CPUs. It's worth noting again, if bhyve alone is used for passthrough, I have no issues at all. It's only when the on-metal FreeBSD host passes VFs to bhyve= AND vnet jails that I observe issues. I currently have 8 network VFs and 1 iGPU passed to 4 bhyve instances with = no problems. My workaround is to use vnet+epair for any jail networking in the host (instead of vnet+VF). 1. Bhyve Production User Call 2024-04-25 https://www.youtube.com/watch?v=3DgGzpLLJTHS0 --=20 You are receiving this mail because: You are the assignee for the bug.=