[Bug 278058] Simultaneous use of Bhyve AND vnet on network PCI devices causes network failure

From: <bugzilla-noreply_at_freebsd.org>
Date: Sun, 31 Mar 2024 00:24:13 UTC
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=278058

            Bug ID: 278058
           Summary: Simultaneous use of Bhyve AND vnet on network PCI
                    devices causes network failure
           Product: Base System
           Version: 14.0-RELEASE
          Hardware: amd64
                OS: Any
            Status: New
          Severity: Affects Some People
          Priority: ---
         Component: bhyve
          Assignee: virtualization@FreeBSD.org
          Reporter: mark@markmcb.com

This is a more specific report that follows PR 273372 [1] and a forum post [2].

Simultaneous use of vnet and byhve will cause networking networking to fail if
both are used on PCI hardware devices.

Setup: 2 SR-IOV VFs created from a capable card (the vendor doesn't matter,
I've tried Intel, Chelsio, and Mellanox).

Fail Scenario: 1 passed through to a bhyve guest (OS doesn't matter). 1 setup
with vnet for a jail. About 90 seconds after both are running, networking dies.
Only console access is possible.

Non-Fail Scenario: 2 byhve guests setup. 1 VF passed to each. One of the guests
is FreeBSD, and in that guest give the network device to a jail and set it up
with vnet. No problems.

Also Non-Fail: Any number of bhyve passthrough devices OR any number of vnet
jails using VFs. Alone they work just fine. It's only when together there is an
issue.

There appears to be a conflict between byhve and vnet when both are in use "on
the same level," but if you separate them with a layer virtualization, no
issues arise.

1. https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=273372
2.
https://forums.freebsd.org/threads/pci-passthrough-of-vfs-crash-host-card-if-jails-bhyve-in-use.92409/

-- 
You are receiving this mail because:
You are the assignee for the bug.