From nobody Sun Nov 28 19:59:47 2021 X-Original-To: bugs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 945C318B509D for ; Sun, 28 Nov 2021 19:59:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4J2K834z7jz4T8M for ; Sun, 28 Nov 2021 19:59:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 7D4BF14ECA for ; Sun, 28 Nov 2021 19:59:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1ASJxlxr019994 for ; Sun, 28 Nov 2021 19:59:47 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1ASJxlXX019993 for bugs@FreeBSD.org; Sun, 28 Nov 2021 19:59:47 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: bugs@FreeBSD.org Subject: [Bug 260095] panic when restarting jails service Date: Sun, 28 Nov 2021 19:59:47 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: timf@puroto.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter attachments.created Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Bug reports List-Archive: https://lists.freebsd.org/archives/freebsd-bugs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-bugs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1638129587; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=fVLAkmAoAYLP+9HzHGZaDrWisiUzNrvc9oHrO/NH4RI=; b=jnF1vk+LgA03OxvxeOSGObjRJjyEUWJcGShQGy2GPu0CmxyDwEQ7arIZHYlx53G3qjC6PU SwNIBypIdcX3pmeR5B5pgiBdoBy5OFlBTWk89hvpUe/E8YN4TEiisCxV75+5nqp0MuqPa5 94BHBJngS8MZHmJdKZX8GKBP9mfeYeWtRuXh/OAlRl4bt6v0jaDU8mPyCtMyHh74jcj68r MuQumtL5eoynUnBRqkLUUJ+1cj8odwLzBjQMwc5HjEpltX3rF/+5a0CAingPsG/Jaljmoa rm1he4JbOsPctqUROiNuSsqm/veexrgstYaaHm7FQU2M/Tn3lVimHreTobHTuw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1638129587; a=rsa-sha256; cv=none; b=hv3AKdkw8K3rx7LN698wJNoeRyY67Skvn3ZD7ErTKmLUD/15/u98or9XrFg8eLfmOFsa2v /+esGF2hjgTpYXRdI9daMzbfhzuT5Mo23LoD6o7YlYBCRH7hXp13LDtndsOweWWEd2+lcv YvayDYJZgV/Kb4pKwsVhVLUM+phm7IXE1t5JdNq6eGZnS8NKy3SIZQe95o6Ed2Q+V/DsRS CaJ8Yo1TAnyzofCf8aavbCvycNI9BxXLzlJsNTgaJISDvdNxNki044b4gdJTNn4Bxq05mf NHjqSqfOAnW64355vk045Mok+d1kRZfy7UdSBlhjSBWTLFcAJuHxDzyQThfeFw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260095 Bug ID: 260095 Summary: panic when restarting jails service Product: Base System Version: 13.0-STABLE Hardware: amd64 OS: Any Status: New Severity: Affects Only Me Priority: --- Component: kern Assignee: bugs@FreeBSD.org Reporter: timf@puroto.org Created attachment 229768 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D229768&action= =3Dedit dmesg output from the bhyve instance I have an 8GB bhyve instance running=20 FreeBSD puroto 13.0-RELEASE-p4 FreeBSD 13.0-RELEASE-p4 #0: Tue Aug 24 07:33= :27 UTC 2021=20=20=20=20 root@amd64-builder.daemonology.net:/usr/obj/usr/src/amd64.amd64/sys/GENERIC= =20 amd64 which panics reliably when I do: # service jails restart The system runs several vtnet jails which have been working fine since Free= BSD 11.x or so. In case it's useful, I've attached recent dmesg output, as well= as my rc.conf and jails.conf I feel like this might be related to https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D234985 but that's just a gut-feeling. The panic looks like: Fatal trap 12: page fault while in kernel mode cpuid =3D 2; apic id =3D 02 fault virtual address =3D 0x440 fault code =3D supervisor read data, page not present instruction pointer =3D 0x20:0xffffffff80be7cc2 stack pointer =3D 0x28:0xfffffe00d3013620 frame pointer =3D 0x28:0xfffffe00d30136a0 code segment =3D base 0x0, limit 0xfffff, type 0x1b =3D DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags =3D interrupt enabled, resume, IOPL =3D 0 current process =3D 9000 (ifconfig) trap number =3D 12 panic: page fault cpuid =3D 2 time =3D 1638128325 KDB: stack backtrace: #0 0xffffffff80c574c5 at kdb_backtrace+0x65 #1 0xffffffff80c09ea1 at vpanic+0x181 #2 0xffffffff80c09d13 at panic+0x43 #3 0xffffffff8108b1b7 at trap_fatal+0x387 #4 0xffffffff8108b20f at trap_pfault+0x4f #5 0xffffffff8108a86d at trap+0x27d #6 0xffffffff81061958 at calltrap+0x8 #7 0xffffffff80d27254 at htable_prefix_free+0xf4 #8 0xffffffff80d26fcd at lltable_prefix_free+0x6d #9 0xffffffff80d9fcd1 at in_scrubprefix+0x281 #10 0xffffffff80d9f46d at in_difaddr_ioctl+0x30d #11 0xffffffff80d9e8bf at in_control+0x5bf #12 0xffffffff80d1f4df at ifioctl+0x55f #13 0xffffffff80c76e6d at kern_ioctl+0x26d #14 0xffffffff80c76b66 at sys_ioctl+0xf6 #15 0xffffffff8108babc at amd64_syscall+0x10c #16 0xffffffff8106227e at fast_syscall_common+0xf8 Uptime: 2m13s Dumping 443 out of 8152 MB: I've tried dropping into the kernel debugger on panic, but haven't been abl= e to get that to work (even with a 'boot -d') and I seem to be unable to inspect= the crash dump: root@puroto:/var/crash # kgdb /boot/kernel/kernel vmcore.0 GNU gdb (GDB) 11.1 [GDB v11.1 for FreeBSD] Copyright (C) 2021 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-portbld-freebsd13.0". Type "show configuration" for configuration details. For bug reporting instructions, please see: . Find the GDB manual and other documentation resources online at: . For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /boot/kernel/kernel... (No debugging symbols found in /boot/kernel/kernel) /wrkdirs/usr/ports/devel/gdb/work-py38/gdb-11.1/gdb/thread.c:1345: internal-error: void switch_to_thread(thread_info *): Assertion `thr !=3D N= ULL' failed. A problem internal to GDB has been detected, further debugging may prove unreliable. Quit this debugging session? (y or n) n This is a bug, please report it. For instructions, see: . /wrkdirs/usr/ports/devel/gdb/work-py38/gdb-11.1/gdb/thread.c:1345: internal-error: void switch_to_thread(thread_info *): Assertion `thr !=3D N= ULL' failed. A problem internal to GDB has been detected, further debugging may prove unreliable. Create a core file of GDB? (y or n) n Command aborted. (kgdb) --=20 You are receiving this mail because: You are the assignee for the bug.=