[Bug 270966] PCI passthru stops working after ~30 guest reboots (ivhd, ILLEGAL CMD, IO_PAGE_FAULT)

From: <bugzilla-noreply_at_freebsd.org>
Date: Thu, 20 Apr 2023 19:59:23 UTC 
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=270966

            Bug ID: 270966
           Summary: PCI passthru stops working after ~30 guest reboots
                    (ivhd, ILLEGAL CMD, IO_PAGE_FAULT)
           Product: Base System
           Version: 13.2-RELEASE
          Hardware: amd64
                OS: Any
            Status: New
          Severity: Affects Only Me
          Priority: ---
         Component: bhyve
          Assignee: virtualization@FreeBSD.org
          Reporter: raul.munoz@custos.es

I've seen this problem (or related) since 13.1 using passthru/SRIOV and
somewhat complex configs. Setting a new server give me the chance to reduce the
problem to this scenario. Reboot a bhyve guest using ppt nic, ~30 times.

fresh install on new server, using passthru with an integrated nic (bge)

With a script like:
[....]
#!/bin/sh
count=1
while :
do
  vm stop debian1
  sleep 5
  vm start debian1
  sleep 15
  echo "Reboots: $count"
  count=`expr $count + 1`
done
[....]

I see:
[....]
Sending ACPI shutdown to debian1                                                
Starting debian1                                                                
  * found guest in /usr/local/vm-bhyve/debian1                                  
  * booting...                                                                  
Reboots: 1                                                                      
Sending ACPI shutdown to debian1                                                
Starting debian1                                                                
  * found guest in /usr/local/vm-bhyve/debian1                                  
  * booting...                                                                  
Reboots: 2                                                                      
Sending ACPI shutdown to debian1                                                
Starting debian1                                                                
  * found guest in /usr/local/vm-bhyve/debian1                                  
  * booting...                         

... ... ...

Reboots: 27
Sending ACPI shutdown to debian1
Starting debian1
  * found guest in /usr/local/vm-bhyve/debian1
  ! guest appears to be running already
[....]

and messages show:
[....]
Apr 20 21:26:17 cache-D-2023 kernel: ivhd0: EVT INTR 0 Status:0xa EVT Head:0x0
Tail:0x10]
Apr 20 21:26:17 cache-D-2023 kernel:   [CMD Total 0x105] Tail:0x50, Head:0x30.
Apr 20 21:26:17 cache-D-2023 kernel: ivhd0:     [Event0: Head:0x0 Tail:0x10]
Apr 20 21:26:17 cache-D-2023 kernel:    [ILLEGAL CMD EVT]
Apr 20 21:26:17 cache-D-2023 kernel:    CMD opcode= 0x3 0xc009 0x14
0x7ffffffffffff003
Apr 20 21:26:18 cache-D-2023 kernel: ivhd0: Error: completion failed tail:0xe0,
head:0x30.
Apr 20 21:26:18 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:26:18 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:26:20 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0x190, head:0x30.
Apr 20 21:26:20 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:26:20 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:26:29 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0x240, head:0x30.
Apr 20 21:26:29 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:26:29 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:26:31 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0x2f0, head:0x30.
Apr 20 21:26:31 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:26:31 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:26:32 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0x3a0, head:0x30.
Apr 20 21:26:32 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:26:32 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:26:40 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0x450, head:0x30.
Apr 20 21:26:40 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:26:40 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:26:41 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0x500, head:0x30.
Apr 20 21:26:41 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:26:41 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:26:42 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0x5b0, head:0x30.
Apr 20 21:26:42 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:26:42 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:26:51 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0x660, head:0x30.
Apr 20 21:26:51 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:26:51 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:26:52 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0x710, head:0x30.
Apr 20 21:26:52 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:26:52 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:26:53 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0x7c0, head:0x30.
Apr 20 21:26:53 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:26:53 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:27:01 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0x870, head:0x30.
Apr 20 21:27:01 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:27:01 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:27:02 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0x920, head:0x30.
Apr 20 21:27:02 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:27:02 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:27:03 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0x9d0, head:0x30.
Apr 20 21:27:03 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:27:03 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:27:12 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0xa80, head:0x30.
Apr 20 21:27:12 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:27:12 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:27:13 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0xb30, head:0x30.
Apr 20 21:27:13 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:27:13 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:27:14 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0xbe0, head:0x30.
Apr 20 21:27:14 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:27:14 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:27:22 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0xc90, head:0x30.
Apr 20 21:27:22 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:27:22 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:27:23 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0xd40, head:0x30.
Apr 20 21:27:23 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:27:23 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:27:24 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0xdf0, head:0x30.
Apr 20 21:27:24 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:27:24 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:27:33 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0xea0, head:0x30.
Apr 20 21:27:33 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:27:33 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:27:34 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0xf50, head:0x30.
Apr 20 21:27:34 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:27:34 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:27:35 cache-D-2023 kernel: ivhd0: Error: completion failed tail:0x0,
head:0x30.
Apr 20 21:27:35 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:27:35 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:27:38 cache-D-2023 kernel: ivhd0: EVT INTR 1 Status:0xa EVT Head:0x10
Tail:0x20]
Apr 20 21:27:38 cache-D-2023 kernel:   [CMD Total 0x200] Tail:0x0, Head:0x30.
Apr 20 21:27:38 cache-D-2023 kernel: ivhd0:     [Event0: Head:0x10 Tail:0x20]
Apr 20 21:27:38 cache-D-2023 kernel:    [IO_PAGE_FAULT EVT: devId:0xc301
DomId:0x17 Addr:0x101290000 0x0]
Apr 20 21:27:43 cache-D-2023 kernel: ivhd0: Error: completion failed tail:0xb0,
head:0x30.
Apr 20 21:27:43 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:27:43 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:27:44 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0x160, head:0x30.
Apr 20 21:27:44 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:27:44 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:27:45 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0x210, head:0x30.
Apr 20 21:27:45 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:27:45 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:27:55 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0x2c0, head:0x30.
Apr 20 21:27:55 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:27:55 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:27:56 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0x370, head:0x30.
Apr 20 21:27:56 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:27:56 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:27:57 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0x420, head:0x30.
Apr 20 21:27:57 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:27:57 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:28:05 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0x4d0, head:0x30.
Apr 20 21:28:05 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:28:05 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:28:06 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0x580, head:0x30.
Apr 20 21:28:06 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:28:06 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:28:07 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0x630, head:0x30.
Apr 20 21:28:07 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:28:07 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:28:16 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0x6e0, head:0x30.
Apr 20 21:28:16 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:28:16 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:28:17 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0x790, head:0x30.
Apr 20 21:28:17 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:28:17 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:28:18 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0x840, head:0x30.
Apr 20 21:28:18 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:28:18 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:28:26 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0x8f0, head:0x30.
Apr 20 21:28:26 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:28:26 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:28:27 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0x9a0, head:0x30.
Apr 20 21:28:27 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:28:27 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:28:28 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0xa50, head:0x30.
Apr 20 21:28:28 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:28:28 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:28:37 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0xb00, head:0x30.
Apr 20 21:28:37 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:28:37 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:28:38 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0xbb0, head:0x30.
Apr 20 21:28:38 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:28:38 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:28:39 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0xc60, head:0x30.
Apr 20 21:28:39 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:28:39 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:28:42 cache-D-2023 kernel: ivhd0: EVT INTR 2 Status:0xa EVT Head:0x20
Tail:0x30]
Apr 20 21:28:42 cache-D-2023 kernel:   [CMD Total 0x2c6] Tail:0xc60, Head:0x30.
Apr 20 21:28:42 cache-D-2023 kernel: ivhd0:     [Event0: Head:0x20 Tail:0x30]
Apr 20 21:28:42 cache-D-2023 kernel:    [IO_PAGE_FAULT EVT: devId:0xc301
DomId:0x1a Addr:0x1074a0000 0x0]
Apr 20 21:28:47 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0xd10, head:0x30.
Apr 20 21:28:47 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:28:47 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:28:49 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0xdc0, head:0x30.
Apr 20 21:28:49 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:28:49 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:28:49 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0xe70, head:0x30.
Apr 20 21:28:49 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:28:49 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:28:59 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0xf20, head:0x30.
Apr 20 21:28:59 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:28:59 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:29:00 cache-D-2023 kernel: ivhd0: Error: completion failed
tail:0xfd0, head:0x30.
Apr 20 21:29:00 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:29:00 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
Apr 20 21:29:01 cache-D-2023 kernel: ivhd0: Error: completion failed tail:0x80,
head:0x30.
Apr 20 21:29:01 cache-D-2023 kernel: ivhd0: Dump last 1 command(s):
Apr 20 21:29:01 cache-D-2023 kernel:   [CMD0, off:0x20] opcode= 0x1 0x50aebb1
0x0 0xa5a5
[....]

% uname -a
FreeBSD cache-D-2023 13.2-RELEASE FreeBSD 13.2-RELEASE
releng/13.2-n254617-525ecfdad597 GENERIC amd64

% dmesg | grep CPU:
CPU: AMD EPYC 9124 16-Core Processor                 (3000.16-MHz K8-class CPU)

% dmesg | grep ivhd
ivhd0: <AMD-Vi/IOMMU ivhd with EFR> on acpi0
ivhd0: Flag:b0<IotlbSup,Coherent>
ivhd0: Features(type:0x11) MsiNumPPR = 0 PNBanks= 2 PNCounters= 0
ivhd0: Extended
features[31:0]:a2295afe<PPRSup,<b2>,NXSup,GTSup,<b5>,IASup,GASup,PCSup> HATS =
0x2 GATS = 0x1 GLXSup = 0x1 SmiFSup = 0x1 SmiFRC = 0x2 GAMSup = 0x1
DualPortLogSup = 0x2 DualEventLogSup = 0x2
ivhd0: Extended
features[62:32]:25bf732f<USSup,PprOvrflwEarlySup,PPRAutoRspSup,BlKStopMrkSup,PerfOptSup,MsiCapMmioSup,GIOSup,HASup,EPHSup,AttrFWSup,HDSup>
Max PASID: 0x2f DevTblSegSup = 0x2 MarcSup = 0x0
ivhd0: supported paging level:7, will use only: 4
ivhd0: device [0xc003 - 0xfffe] config:0
ivhd0: PCI cap 0x190b640f@0x40 feature:19<IOTLB,EFR,CapExt>
ivhd1: <AMD-Vi/IOMMU ivhd with EFR> on acpi0
ivhd1: Flag:b0<IotlbSup,Coherent>
ivhd1: Features(type:0x11) MsiNumPPR = 0 PNBanks= 2 PNCounters= 0
ivhd1: Extended
features[31:0]:a2295afe<PPRSup,<b2>,NXSup,GTSup,<b5>,IASup,GASup,PCSup> HATS =
0x2 GATS = 0x1 GLXSup = 0x1 SmiFSup = 0x1 SmiFRC = 0x2 GAMSup = 0x1
DualPortLogSup = 0x2 DualEventLogSup = 0x2
ivhd1: Extended
features[62:32]:25bf732f<USSup,PprOvrflwEarlySup,PPRAutoRspSup,BlKStopMrkSup,PerfOptSup,MsiCapMmioSup,GIOSup,HASup,EPHSup,AttrFWSup,HDSup>
Max PASID: 0x2f DevTblSegSup = 0x2 MarcSup = 0x0
ivhd1: supported paging level:7, will use only: 4
ivhd1: device [0x8003 - 0xbffe] config:0
ivhd1: PCI cap 0x190b640f@0x40 feature:19<IOTLB,EFR,CapExt>
ivhd2: <AMD-Vi/IOMMU ivhd with EFR> on acpi0
ivhd2: Flag:b0<IotlbSup,Coherent>
ivhd2: Features(type:0x11) MsiNumPPR = 0 PNBanks= 2 PNCounters= 0
ivhd2: Extended
features[31:0]:a2295afe<PPRSup,<b2>,NXSup,GTSup,<b5>,IASup,GASup,PCSup> HATS =
0x2 GATS = 0x1 GLXSup = 0x1 SmiFSup = 0x1 SmiFRC = 0x2 GAMSup = 0x1
DualPortLogSup = 0x2 DualEventLogSup = 0x2
ivhd2: Extended
features[62:32]:25bf732f<USSup,PprOvrflwEarlySup,PPRAutoRspSup,BlKStopMrkSup,PerfOptSup,MsiCapMmioSup,GIOSup,HASup,EPHSup,AttrFWSup,HDSup>
Max PASID: 0x2f DevTblSegSup = 0x2 MarcSup = 0x0
ivhd2: supported paging level:7, will use only: 4
ivhd2: device [0x3 - 0x3ffe] config:0
ivhd2: device [0xff00 - 0xffff] config:0
ivhd2: PCI cap 0x190b640f@0x40 feature:19<IOTLB,EFR,CapExt>
ivhd3: <AMD-Vi/IOMMU ivhd with EFR> on acpi0
ivhd3: Flag:b0<IotlbSup,Coherent>
ivhd3: Features(type:0x11) MsiNumPPR = 0 PNBanks= 2 PNCounters= 0
ivhd3: Extended
features[31:0]:a2295afe<PPRSup,<b2>,NXSup,GTSup,<b5>,IASup,GASup,PCSup> HATS =
0x2 GATS = 0x1 GLXSup = 0x1 SmiFSup = 0x1 SmiFRC = 0x2 GAMSup = 0x1
DualPortLogSup = 0x2 DualEventLogSup = 0x2
ivhd3: Extended
features[62:32]:25bf732f<USSup,PprOvrflwEarlySup,PPRAutoRspSup,BlKStopMrkSup,PerfOptSup,MsiCapMmioSup,GIOSup,HASup,EPHSup,AttrFWSup,HDSup>
Max PASID: 0x2f DevTblSegSup = 0x2 MarcSup = 0x0
ivhd3: supported paging level:7, will use only: 4
ivhd3: device [0x4003 - 0x7ffe] config:0
ivhd3: PCI cap 0x190b640f@0x40 feature:19<IOTLB,EFR,CapExt>

I'll try on 14.
Thanks in advance.

-- 
You are receiving this mail because:
You are the assignee for the bug.