From nobody Thu Jul 21 01:09:58 2022 X-Original-To: virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4LpDxy23hDz4XQTZ for ; Thu, 21 Jul 2022 01:09:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4LpDxy0dBLz3wpb for ; Thu, 21 Jul 2022 01:09:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4LpDxx6jgrz1Hn1 for ; Thu, 21 Jul 2022 01:09:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 26L19vYv091006 for ; Thu, 21 Jul 2022 01:09:57 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 26L19vjn091005 for virtualization@FreeBSD.org; Thu, 21 Jul 2022 01:09:57 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: virtualization@FreeBSD.org Subject: [Bug 265196] talos linux vms hang on reboot at the com ports, need to reboot the host to clear it up Date: Thu, 21 Jul 2022 01:09:58 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bhyve X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: ler@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-virtualization@freebsd.org X-BeenThere: freebsd-virtualization@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1658365798; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=PVLsbIM2FNpfSn6CEEXt16dQKzeeZYl26DQzgEEF6/M=; b=VgmriKcGC82slVwayD2DyUqmehg1M3RTzucsVzSG9xZ8XnGAvV8Z8rgdb5epCgLLbL2t26 D4K2glzRjyHHB/Wcqb4u0dg+YBDSzpFNFKFBw0nDPZqUkZvpzV1fJ+sEXUkePNk5ibLwdO Ez3WPqCXn7ZQQPjK0CSThO0wN/Vcd4M7vqkaFPVPboiwdvKBapNwoezgxl2XJDvR+FAlB3 yOFDmAyp6QBl0vnQPGEvbaw0r4vpaQAWA3/pdv6ll7oW2f5CMaJNSGrhf2EOp1IjvzM8o8 p5FsMyJEy1k0vfJli0eygQiRtL90mr/6cLbK1auKPOGhd/mDGaMPbnuQeJhTdw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1658365798; a=rsa-sha256; cv=none; b=ZrMgfA7oiICi3GIemoYEatWUV+B+XfFeI5sX5PbQLH9mtimBITmf3YvjwxHWdTjwc0waPt g+oPt5voUxLWXgZf6ljrwW5UtXAoIC85IYaTriIyVr3/l6ndb0MAQZ89Bk6Vhanp8ae6LP GvtMVm7mYZaL7AtXJjA+bF/LD0i5C0kLN74AK1I17LmAVGc8HMyeK1/ImSva5BIqxVyPQx 4z57xBrO2HzFrjCpO8TpcbYtzE9h4zNDGGIl9xK5MFPl0jcgYzwr4h0dvBOwekiGoOyp30 NcTrBjmJ1ZHnSF3Ut9/AfsD4iz4l4nX5L4GxJe3RtE5zgXnTwUl8Qz0il5nuwA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265196 --- Comment #16 from Larry Rosenman --- and we have the same crash as on 14: oldtbh2# ls -ltr total 2190746 -rw-r--r-- 1 root wheel 22292 Jul 20 19:44 worker.yaml -rw-r--r-- 1 root wheel 24176 Jul 20 19:56 controlplane.yaml -rw-r--r-- 1 root wheel 1617 Jul 20 20:00 talosconfig -rw-r--r-- 1 root wheel 279 Jul 20 20:02 talos1.conf -rw------- 1 root wheel 107374182400 Jul 20 20:07 disk0.img -rw-r--r-- 1 root wheel 869 Jul 20 20:08 bhyve.log -rw-r--r-- 1 root wheel 17080 Jul 20 20:08 vm-bhyve.log oldtbh2# tail bhyve.log reason VMX rip 0xffffffff8ccd32b6 inst_length 3 status 0 exit_reason 2 (Triple fault) qualification 0x0000000000000000 inst_type 0 inst_error 0 vm exit[2] reason VMX oldtbh2# cat bhyve.log rdmsr to register 0x140 on vcpu 0 wrmsr to register 0x140(0) on vcpu 0 rdmsr to register 0x140 on vcpu 1 wrmsr to register 0x140(0) on vcpu 1 rdmsr to register 0x140 on vcpu 2 wrmsr to register 0x140(0) on vcpu 2 rdmsr to register 0x140 on vcpu 3 wrmsr to register 0x140(0) on vcpu 3 rdmsr to register 0x34 on vcpu 1 Unhandled ps2 mouse command 0xe1 rdmsr to register 0x48 on vcpu 1 rdmsr to register 0x122 on vcpu 1 rdmsr to register 0x10f on vcpu 1 rdmsr to register 0x123 on vcpu 1 rdmsr to register 0xc0011020 on vcpu 1 Unhandled ps2 keyboard command 0xf6 rdmsr to register 0x140 on vcpu 0 wrmsr to register 0x140(0) on vcpu 0 rdmsr to register 0x34 on vcpu 0 vm exit[1] vm exit[3] reason VMX rip 0xffffffff8ccd32b6 inst_length 3 status 0 exit_reason 2 (Triple fault) qualification 0x0000000000000000 inst_type 0 inst_error 0 vm exit[2] reason VMX oldtbh2# [ 30.243879] pci 0000:00:00.0: [1275:1275] type 00 class 0x060000 [ 30.245830] pci 0000:00:00.0: reg 0x30: [mem 0x00000000-0x000007ff pref] [ 30.247330] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 [ 30.248960] pci 0000:00:04.0: reg 0x10: [io 0x2000-0x207f] [ 30.250497] pci 0000:00:04.0: reg 0x14: [mem 0xc0000000-0xc0001fff] [ 30.252527] pci 0000:00:04.0: reg 0x30: [mem 0x00000000-0x000007ff pref] [ 30.255292] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 [ 30.256847] pci 0000:00:05.0: reg 0x10: [io 0x2080-0x20bf] [ 30.258496] pci 0000:00:05.0: reg 0x14: [mem 0xc0002000-0xc0003fff] [ 30.260471] pci 0000:00:05.0: reg 0x30: [mem 0x00000000-0x000007ff pref] [ 30.263584] pci 0000:00:1f.0: [8086:7000] type 00 class 0x060100 [ 30.265814] pci 0000:00:1f.0: reg 0x30: [mem 0x00000000-0x000007ff pref] [ 30.266838] ACPI: PCI: Interrupt link LNKA configured for IRQ 0 [ 30.268145] ACPI: PCI: Interrupt link LNKA disabled [ 30.269349] ACPI: PCI: Interrupt link LNKB configured for IRQ 0 [ 30.270376] ACPI: PCI: Interrupt link LNKB disabled [ 30.271589] ACPI: PCI: Interrupt link LNKC configured for IRQ 0 [ 30.272887] ACPI: PCI: Interrupt link LNKC disabled [ 30.274511] ACPI: PCI: Interrupt link LNKD configured for IRQ 0 [ 30.275816] ACPI: PCI: Interrupt link LNKD disabled [ 30.277025] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 30.278376] ACPI: PCI: Interrupt link LNKE disabled [ 30.279586] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 30.280887] ACPI: PCI: Interrupt link LNKF disabled [ 30.282516] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 30.283815] ACPI: PCI: Interrupt link LNKG disabled [ 30.285016] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 30.286376] ACPI: PCI: Interrupt link LNKH disabled [ 30.287947] iommu: Default domain type: Translated [ 30.289030] iommu: DMA domain TLB invalidation policy: lazy mode [ 30.290419] vgaarb: loaded [ 30.291276] SCSI subsystem initialized [ 30.292553] ACPI: bus type USB registered [ 30.293563] usbcore: registered new interface driver usbfs [ 30.294398] usbcore: registered new interface driver hub [ 30.295655] usbcore: registered new device driver usb [ 30.296938] pps_core: LinuxPPS API ver. 1 registered [ 30.298376] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 30.300477] PTP clock support registered [ 30.301505] EDAC MC: Ver: 3.0.0 [ 30.302733] Registered efivars operations [ 30.304279] NET: Registered PF_ATMPVC protocol family [ 30.305438] NET: Registered PF_ATMSVC protocol family [ 30.306413] NetLabel: Initializing [ 30.307205] NetLabel: domain hash size =3D 128 [ 30.308208] NetLabel: protocols =3D UNLABELED CIPSOv4 CALIPSO [ 30.309534] NetLabel: unlabeled traffic allowed by default [ 30.310482] PCI: Using ACPI for IRQ routing [ 30.453201] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 30.454376] hpet0: 8 comparators, 32-bit 16.777216 MHz counter [ 30.459434] clocksource: Switched to clocksource tsc-early [ 30.884569] VFS: Disk quotas dquot_6.6.0 [ 30.885604] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 byte= s) [ 30.887397] pnp: PnP ACPI init [ 30.888713] system 00:02: [io 0x0220-0x0223] has been reserved [ 30.890189] system 00:02: [io 0x0224-0x0227] has been reserved [ 30.891614] system 00:02: [io 0x04d0-0x04d1] has been reserved [ 30.893072] system 00:02: [io 0x0400-0x0407] has been reserved [ 30.894477] system 00:02: [mem 0xe0000000-0xefffffff] has been reserved [ 30.896192] pnp: PnP ACPI: found 6 devices [ 30.905688] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 30.907933] NET: Registered PF_INET protocol family [ 30.914048] IP idents hash table entries: 262144 (order: 9, 2097152 byte= s, linear) [ 30.923312] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 30.925782] Table-perturb hash table entries: 65536 (order: 6, 262144 by= tes, linear) [ 30.932707] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 30.937944] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 30.939883] TCP: Hash tables configured (established 262144 bind 65536) [ 30.943188] UDP hash table entries: 16384 (order: 7, 524288 bytes, linea= r) [ 30.946233] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 30.948210] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 30.949956] RPC: Registered named UNIX socket transport module. [ 30.951353] RPC: Registered udp transport module. [ 30.952473] RPC: Registered tcp transport module. [ 30.953585] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 30.955451] pci 0000:00:04.0: BAR 6: assigned [mem 0xc0004000-0xc00047ff pref] [ 30.957163] pci 0000:00:05.0: BAR 6: assigned [mem 0xc0004800-0xc0004fff pref] [ 30.958887] pci 0000:00:1f.0: BAR 6: assigned [mem 0xc0005000-0xc00057ff pref] [ 30.960584] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7] [ 30.961916] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] [ 30.963381] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff windo= w] [ 30.965021] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xdfffffff windo= w] [ 30.966677] pci_bus 0000:00: resource 8 [mem 0xf0000000-0xf07fffff windo= w] [ 30.968324] pci_bus 0000:00: resource 9 [mem 0xd000000000-0xd0000fffff window] [ 30.970136] pci 0000:00:1f.0: Activating ISA DMA hang workarounds [ 30.971554] PCI: CLS 0 bytes, default 64 [ 30.972649] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 30.974187] software IO TLB: mapped [mem 0x00000000b3281000-0x00000000b7281000] (64MB) [ 30.976523] Unpacking initramfs... [ 30.982873] kvm: no hardware support [ 30.983721] has_svm: not amd or hygon [ 30.984572] kvm: no hardware support [ 31.267875] Initialise system trusted keyrings [ 31.270673] workingset: timestamp_bits=3D40 max_order=3D23 bucket_order= =3D0 [ 31.281801] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 31.287563] NFS: Registering the id_resolver key type [ 31.288805] Key type id_resolver registered [ 31.289831] Key type id_legacy registered [ 31.294650] nfs4filelayout_init: NFSv4 File Layout Driver Registering... [ 31.296246] nfs4flexfilelayout_init: NFSv4 Flexfile Layout Driver Registering... [ 31.307381] Key type cifs.spnego registered [ 31.308431] Key type cifs.idmap registered [ 31.309654] fuse: init (API version 7.34) [ 31.311178] SGI XFS with ACLs, security attributes, quota, no debug enab= led [ 31.319765] ceph: loaded (mds proto 32) [ 31.342755] NET: Registered PF_ALG protocol family [ 31.343962] xor: measuring software checksum speed [ 31.346075] prefetch64-sse : 10534 MB/sec [ 31.348345] generic_sse : 8196 MB/sec [ 31.349397] xor: using function: prefetch64-sse (10534 MB/sec) [ 31.358726] Key type asymmetric registered [ 31.359720] Asymmetric key parser 'x509' registered [ 31.366699] Block layer SCSI generic (bsg) driver version 0.4 loaded (ma= jor 249) [ 31.368545] io scheduler mq-deadline registered [ 31.369638] io scheduler kyber registered [ 31.371744] IPMI message handler: version 39.2 [ 31.372887] ipmi device interface [ 31.378807] ipmi_si: IPMI System Interface driver [ 31.380600] ipmi_si: Unable to find any System Interface(s) [ 31.381958] IPMI poweroff: Copyright (C) 2004 MontaVista Software - IPMI Powerdown via sys_reboot [ 31.384472] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 31.391112] ACPI: button: Power Button [PWRF] [ 31.393367] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 31.399434] virtio-pci 0000:00:04.0: virtio_pci: leaving for legacy driv= er [ 31.401820] virtio-pci 0000:00:05.0: virtio_pci: leaving for legacy driv= er [ 31.407588] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 31.409352] 00:03: ttyS0 at I/O 0x3f8 (irq =3D 4, base_baud =3D 115200) = is a 16550A [ 31.415250] 00:04: ttyS1 at I/O 0x2f8 (irq =3D 3, base_baud =3D 115200) = is a 16550A --=20 You are receiving this mail because: You are the assignee for the bug.=