From nobody Sat Jan 15 17:49:39 2022 X-Original-To: bugs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 63139195ECBB for ; Sat, 15 Jan 2022 17:49:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Jblzl3G4Pz3HHp for ; Sat, 15 Jan 2022 17:49:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 2E22C30F7 for ; Sat, 15 Jan 2022 17:49:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 20FHndSO094456 for ; Sat, 15 Jan 2022 17:49:39 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 20FHndjD094455 for bugs@FreeBSD.org; Sat, 15 Jan 2022 17:49:39 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: bugs@FreeBSD.org Subject: [Bug 261233] Frequent kernel panics during disk access after upgrading from 12.2-RELEASE-p7 to 12.2-p12 or 12.3 on i386 Date: Sat, 15 Jan 2022 17:49:39 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.2-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: fbsdzilla@coupin.net X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Bug reports List-Archive: https://lists.freebsd.org/archives/freebsd-bugs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-bugs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1642268980; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=/T5CGNTvp0kk8sHEP/bt9MignJjlcUZ3GpAbUoH8FPw=; b=dgquBsQuR+VLKupN9eughwbMwf80WaFPwnch3U4YfY9nL2jyROcWub9SwoPHcqmtyOpW9u qs+2uvi1ncvpWlHxJYvKU0+r6i2PI80GdjSADx6s6+56cL8Owp2pEJwYOf9vCQRM9zcUCo FF3wqSaMyq1MKP4xux9IpCXSO6NnZEiLCbjxU4Dhwz0kvzBEDcrib8tymT3ASZjXwlukd5 lmFVeA1mw5Trid4oi5ksr2AvvFCg3+BmcBoVHmqlfR7yZ1fZ8kOxFYT1VYmEx77j/ipa6Y KSgszeBh2aXFY7V1BInaKA5zGFhqlMTf+BDfALQvfA8i+6FPy2jXcT2rvRqbVA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1642268980; a=rsa-sha256; cv=none; b=vjyfsiV+lPhHRuh1lE7JmNhu5EoTU2EFjhRop7/jVy17U4SjAM4DySqUB+2BiajinJVRnm HIQ7QUPb8mNkeFavDVyagJn05CCWYjSAqebBLMokfyIrUudisZT3DhVWOrbgtJqDwbXwZr hWCRzl0TmTM5kku011I7uAWdOIeogFhJlyGHAE9P6iTxvEC/d6mlTvFMObee0Pi1M5oI/D 0Kf8vHREuV/scDOcopfT92S5xYp3KojAkCQvOLuZRv673v0uA+gUNbBPV0DxuFSEiDXw6o hNMiaCC0jyem7T2xSj704v3l21iRms4QrcD4ImFg1r1cwnEiDv8uyt6tlfnaqA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261233 Bug ID: 261233 Summary: Frequent kernel panics during disk access after upgrading from 12.2-RELEASE-p7 to 12.2-p12 or 12.3 on i386 Product: Base System Version: 12.2-RELEASE Hardware: i386 OS: Any Status: New Severity: Affects Only Me Priority: --- Component: kern Assignee: bugs@FreeBSD.org Reporter: fbsdzilla@coupin.net I updated my server 2 days ago using freebsd-update from a 12.2-RELEASE-p7 kernel to p12 and since then it panicked something like 20 times in 24h as = soon as there's filesystem activity. gmirror repairs seemed to have no impact though. Reverting to old p7 kernel it's now been stable again for 24h. I tr= ied upgrading to 12.3 but it crashed like 12.2p12 after the kernel upgrade step= and even before I got a chance to upgrade binaries. I managed to snap a picture of the panic stacktrace right before it rebooted after one of the crashes (see transcript below). I read the changes from p7 to p12 and I think it's related to changes made = in the pmap code by this commit (1) as the stacktrace starts in PTDpde. I'll admit, that while I've been running FreeBSD servers since, I think, 2.7 I'm not familiar with the kernel code but it reeks of race condition under load. The machine is a Core i5 2400 (see details below), and yes I know I could be running the 64 bits version, but I never needed to go above 4GB of RAM and = it's been running the 32 bits version of the OS flawlessly for years now. Sorry if this is a duplicate but I searched and could not find anything related. (1) https://github.com/freebsd/freebsd-src/commit/a165b4591e48cd2adce8215fca731= 47c016e6cea#diff-b34ee41e14f87fb2b18fdf77337237f336830ae88aac2a02e1c32aa45e= 43b4de panic: vm_fault: fault on nofault entry, addr: 0 cpuid =3D 1 time =3D 1642161900 KDB: stack backtrace: #0 0x10327ae at kdb_backtrace+0x4e #1 0xfed128 at vpanic+0x118 #2 0xfeda4 at panic+0x14 #3 0x12e5733 at vm_fault+0x2613 #4 0x12e3832 at vm_fault_trap+0x42 #5 0x154c0f5 at trap_pfault+0x115 #6 0x154b71f at trap+0x36f #7 0xffc0319d at PTDpde-0x41a5 #8 0x18bbaa3 at _umtx_op_nwake_private+0x93 #9 0x154c7b9 at syscall+0=C3=973e9 #10 0xffc033e7 at PTDpde+0x43ef Uptime:3m20s CPU: Intel(R) Core(TM) i5-2400 CPU @ 3.10GHz (3093.04-MHz 686-class CPU) Origin=3D"GenuineIntel" Id=3D0x206a7 Family=3D0x6 Model=3D0x2a Steppi= ng=3D7 =20 Features=3D0xbfebfbff =20 Features2=3D0x1fbae3ff AMD Features=3D0x28100000 AMD Features2=3D0x1 XSAVE Features=3D0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID TSC: P-state invariant, performance statistics --=20 You are receiving this mail because: You are the assignee for the bug.=