[Bug 273372] SR-IOV Networking in Bhyve Causes Chelsio T520-SO-CR to Fail on Host, Kernel Panic if Reset

From: <bugzilla-noreply_at_freebsd.org>
Date: Fri, 08 Dec 2023 14:10:09 UTC
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=273372

--- Comment #9 from Mark McBride <mark@markmcb.com> ---
More data (as of 14.0-RELEASE-p2)

Bug still present. I reversed my testing to see how things would go with a
VM-first approach.

* I disabled all jails
* I set SR-IOV on each of 2 NIC ports to 2 passthrough, 4 non-passthrough.
Altogether, 12 VFs on 2 PFs.
* I set the processor's iGPU device and 4 NIC passthrough VFs for passthrough
in /boot/loader.conf via pptdevs=
* I started a Debian VM (gpu + VF) and FreeBSD VM (VF) using vm-bhyve

Everything works fine. Both VMs start, I can see the GPU and setup networking
on the VFs in Debian. And networking is fine in FreeBSD. No issues after
several hours.

However, starting any jail using an SR-IOV VF will bring it all down.

* I config jails.conf with 1 jail: vnet; vnet.interface = "cxlv0";
* I start the jail

Almost immediately the Chelsio card fails. As usual, I can connect to the
system via serial console and all seems well except networking is dead.

In summary, I can create VMs, or I can create jails. The first will succeed,
and the second will trigger failure.

-- 
You are receiving this mail because:
You are the assignee for the bug.