From nobody Fri Apr 07 20:11:00 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PtTys19r4z446wx for ; Fri, 7 Apr 2023 20:11:17 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic306-20.consmr.mail.gq1.yahoo.com (sonic306-20.consmr.mail.gq1.yahoo.com [98.137.68.83]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4PtTyr5jwGz47Vl for ; Fri, 7 Apr 2023 20:11:16 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1680898273; bh=K4knMD+srTrsnGXXKHBnlyPWl9z6Pex/azRF5lgWB3A=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=QHsInAtuhDzJXVlR5EATOGeQOvqd0U21KBhrZyJsj41rS2+ErbYZVgzWXXbQ6k7iziMukECNdfWWCx2k168ptodws0RtJ2ueKqko7iqMtpEi0X2ms5hIL2oiyzRFWKogGnG4+kujxIpzl/3fmQuHscjpv3TWgs60mvOOqJGsLlp+vraf1GKDREDP5017YQRICKV73CjE5k5JjioT4pNU9cyJ4mVO/5bjxirKlIfh7KVEcKHrNS2KwhTGzK+yGDIDUauHNsM4k+FpR8HItgXbNAAvLqRQMDFFtcv5AwNXSP69IGsx80fKDGpDWbrmBem7PfvLSdfeYrV7YdQgM5OkdA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1680898273; bh=T1Zj+WIpLsTx3i1DYfksWVUipVkxmkHDtKN4N+O3Rki=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=GMJXpFhR0UqZDqrD9Nw9DTrastG6HEVaJoQGC2wXnPYkN8FIfLbAqlAtdH80ztLNwSzgg0bnn4iqhxVfagFZuWNFXmXvDQg7FM6msrb4T9jyjSJ+AOnPYmfDEVill4eu/4/ZBj/vE/XXt0iiaGlIFXqxcSnj0tGo9x3Uf9KPO5cMV7NEWo3YOIyoNGgcmdLkdauDVOYX+1oiUWfxjSr7Q70P9i6+omc3JJniEQgEi0wbG5rgxKFkepF2whoCQ//RsFmR7VGO07QmefRf6ki7rDOJvIbTiqNKTFcenEHWXYOggK7AC2dx5+6kGWheZhBumfBD3HDOa3+KdhXfLxHMIg== X-YMail-OSG: yQ5CJp4VM1kgpaeE8pMySdB2CIdS6Mfwr2VIIsgqip9RxeZKKdZfIkYBRBb_sGu mx04wHTF2N9AHqztZjpw_5KuGkUcrR4dtByhkpNqR_y6s401joo6rzjWuutsbimXhPxwxahRWejf xE_ASMiD7AwRtkYajZ3HXO1DX9WSlGfx0tAan.4SFgz03Hq2Iae2qRxwU8dyrIIRQYunQ9mrzuqF GTmwQuG_NUZIN4dCVicOPfKVOACS.1Vi7zB1bx5GFfaQXuzJlGencuUeItF8DsEWxXQ0U6vQAwdi zjXtlc3_3C0OVs1FUQxpyx9U9ZYWcl67aDBjaFJZaGQpkJE23GnAlDFFYl0vfsoA_arqPPRSyy5F I8bTxiLlHpeXLdMwDkDJ4WxbY1d4VeaspiM0ROiBALCuuYaMAIGxeoagr1CNqgBtinq0dwexS_sF KAV4lKU2ew3RseVQuzdXR1A3eVrkO4.mP5.i.Aa39ONl.KvGOap.RcKjSqQ0lN610PYnpMNd389Y 2HlPCb15pnotIEDguKRi5VYmsDA5S1lphJpmO8QcHOb2K2fmu8MUeMXXHMxYEVodjlLEHcc65hhM 3DD_Xrx_e4Pysd22PGgNiWLY_cR1dKVBq55bO3WgWfsFDnRTHzDnduFsYy6198ElAu0LyyaQIVV3 lBRJ.GW81KZtlrvFirEBZnLyu.EyFobx6x3RNvBKcW8EwYfM68WSGTl32.I0vHyYeuKJt2rBxVwl JCzIT7mq5RV9oo4A4ZY31saX_ds1Gz2YR_keNFvGDV2R0xFIpjlGnCtgIFcC1vSNlnvphtreaM8b YRHJi1WpErpkNi60WlPlJGRADXPe2NA.aNNfm9Z77W.ZKlByMH1LtgnDzuY.BGFH5VjQn1.cS72R _ifOKuRkNWaVbGH7HORRWX0V0wvyZBcDDu9tzMBzvPZwdcWUpU32O022hYq6OsRx.GH6sN4bqhvA 6BNLL2LgsMsEH1Hx35QOPSmHLf8kPHOpjQ_fHHzEfebLhQ1h7BeCOnYvglyi2mXM4ANlce1EJych y7t1K2tUS2L_DfbqGXcV9fEVQHFjHxk7.d73k6BkqRiDCYvdQ4PSCLie3VFjdE2bAWu56DtRLbx4 9alhRjRDCxLWNl8eh8h0KuKTOhG6QjQ3GO1TBcvRzks7GY0zrEcZNs4sMCIS0DTVuaCqZ9pGhR4m Z1RgdbpSSEAVPRJ6dJEwOQO4RHaBV3uq6mhQtKmxhh5vKZc8p5H2GCeHvCt2I0XpYb1JxaYrm1f0 U6uS0DUdUClNv7EZLS.30.WtqvrbH6WMq9.0wuUCDpXSPRzuORFGpsTna7CfbC6p4SXoL_hdVjF8 Ve3tDwBBpx5atU4ntYW1qTUJWus9Hbw9HkZ9Jz0MZoecRtL60VzSBSVRvkrnsjUxVSEJJHx8Hut2 DwQRDQxZxqj1SHMDKcPXe4eVcX4._lxtyo8Cuewrcu_3Kct6LnFFVbxUU2XpkT59.KYn7KsXubV6 Npksq68dQipvlpOSePCBTvsmNAh8jVeBLXV1zRB6J1MN0R5lH4O51WkqTzrxp_Peg5nnjOvSYUbv T4n_J4Jz5XH7HtjE8odSVJXeBOTTj4q4tXXxjz_mLrMrXj9VAkN.Yw280_50HMDIqtaEgiYq1AZd YZxvVFzIZPjrTZpggIGzWN6FhcODRG8VQnnSvEDafnVuvBxRXPaHhi6R9muHQ6yJt3HtFA8jm3Lp 4isA16D38_izV0nbLdN78pXhPNmkVcyYoKu2YHE62Sq1S0CCqpp7aFeqLF1onnWwrWNvWbvKwnEB yhrEVtDbSx6rm3lQWl0EA4uszJzsnBxZjngkGOKEjneDH5fXtY.j84rjYHF1U64gVdvyO4NDKLHv 6tDqO5EMy9k28j1p1un6kv4HdpQCUKnBzjImks7kda_4pGBH2RaHeAdJtsa0iHuFhsbVonfAmSVL XMvkJc9_WEsXgPHiObUcyMP8L_BVdGwaZTFAqUjmAJjQxpGXArYDMmhmKYJUob3mk1BQaHmJa1T0 CnXU7L26PV6BqX8OxuYyUPpm.uESKStLne6ZFWBBy2zWp.E9n_KOADL7CI1gMrjSQAFbQ0ab4fEp bmfeU_jGPr9xGMXmHtLUxZtyg8LCCd7DcdZIMYVJYi_uxQNgWZjaeF1wbLsHYVl8DW1TIxgj1MEH Mq7EODoMSZij7J9r8VhMxsfdXK3k45MTHOWebsqlkBmxsr5p_dvyZORQsnf9gTtlil5Jsp9qwpvD z6QMEsox_poapmxguMy3uddihwmd.dCfKNWRm2z9aK2OYVyAhAVKcwO6t6kD4ZEj3y2d8jZ4ong- - X-Sonic-MF: X-Sonic-ID: 81816a13-65b1-484c-b4ae-6d881cc89268 Received: from sonic.gate.mail.ne1.yahoo.com by sonic306.consmr.mail.gq1.yahoo.com with HTTP; Fri, 7 Apr 2023 20:11:13 +0000 Received: by hermes--production-bf1-5f9df5c5c4-p5s6l (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID c56ed0df2a517ad059fb9cbbf5eaba4c; Fri, 07 Apr 2023 20:11:12 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.400.51.1.1\)) Subject: Re: Another VFP-in-kernel problem on armv8 From: Mark Millard In-Reply-To: <911B8107-4FAC-4180-97D0-49B44212B788@mit.edu> Date: Fri, 7 Apr 2023 13:11:00 -0700 Cc: "freebsd-arm@freebsd.org" , Current FreeBSD Content-Transfer-Encoding: quoted-printable Message-Id: References: <911B8107-4FAC-4180-97D0-49B44212B788@mit.edu> To: John F Carr X-Mailer: Apple Mail (2.3731.400.51.1.1) X-Rspamd-Queue-Id: 4PtTyr5jwGz47Vl X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Apr 7, 2023, at 06:06, John F Carr wrote: > I upgraded from mid-February CURRENT (5dc00f00b747) to yesterday = (f02879f19925) and my system panics during boot with >=20 > panic: VFP exception in the kernel >=20 > Most likely this panic is while trying to import the root ZFS pool. = The crash is at the first vector instruction in zfs_sha256_block_neon = (in zfs.ko): >=20 > f9284: 4cdf7020 ld1 { v0.16b }, [x1], #16 >=20 > This instruction is implemented on my CPU (Cortex A-57), confirmed by = running it in user mode. >=20 > I don't see any obviously related changes in ZFS since the last = working kernel. What's going on recently with VFP in the kernel? I've a simpler reproducer context based on just official materials: Downloaded and dd'd an 2023-Apr-06 snapshot image and powered up a small aarch64 board with it: . . . FreeBSD 14.0-CURRENT #0 main-n262010-f21faa67ab6b: Thu Apr 6 11:49:31 = UTC 2023 = root@releng1.nyi.freebsd.org:/usr/obj/usr/src/arm64.aarch64/sys/GENERIC = arm64 FreeBSD clang version 15.0.7 (https://github.com/llvm/llvm-project.git = llvmorg-15.0.7-0-g8dfdcc7b7bf6) . . . So: A just-UFS boot context. Then login and try "zpool import" without having any zfs media present, just the UFS boot media: Login: root Password: Apr 6 13:00:28 generic login[1443]: ROOT LOGIN (root) ON ttyu0 FreeBSD 14.0-CURRENT #0 main-n262010-f21faa67ab6b: Thu Apr 6 11:49:31 = UTC 2023 = root@releng1.nyi.freebsd.org:/usr/obj/usr/src/arm64.aarch64/sys/GENERIC Welcome to FreeBSD! Release Notes, Errata: https://www.FreeBSD.org/releases/ Security Advisories: https://www.FreeBSD.org/security/ FreeBSD Handbook: https://www.FreeBSD.org/handbook/ FreeBSD FAQ: https://www.FreeBSD.org/faq/ Questions List: https://www.FreeBSD.org/lists/questions/ FreeBSD Forums: https://forums.FreeBSD.org/ Documents installed with the system are in the = /usr/local/share/doc/freebsd/ directory, or can be installed later with: pkg install en-freebsd-doc For other languages, replace "en" with a language code like de or fr. Show the version of FreeBSD installed: freebsd-version ; uname -a Please include that output and any error messages when posting = questions. Introduction to manual pages: man man FreeBSD directory layout: man hier To change this login announcement, see motd(5). root@generic:~ # zpool import x0: ffff0000f0fa9168 (ucom_cons_softc + efbf1bb8) x1: ffff0000ff900000 ($d.1 + afa318) x2: ffff0000ff900400 ($d.1 + afa718) x3: ffff0000fec1b0a4 (sha_incremental + 0) x4: 0 x5: 100000 x6: 8e16db93 x7: 0 x8: ffff0000feb06168 (tf_sha256_neon + 0) x9: ffff0000fea931fb ($d.1 + b) x10: ffff0000feb045f4 (SHA2Update + f4) x11: 29 x12: 1 x13: 0 x14: 0 x15: 2 x16: ffff0000feaf7500 ($d.0 + 0) x17: ffff000000476cf0 (nanouptime + 0) x18: ffff0000f0fa9000 (ucom_cons_softc + efbf1a50) x19: ffff0000f0fa9168 (ucom_cons_softc + efbf1bb8) x20: 400 x21: ffff0000ff900000 ($d.1 + afa318) x22: ffff0000f0fa9198 (ucom_cons_softc + efbf1be8) x23: 0 x24: 0 x25: 0 x26: ffff0000fed2df70 (sha256_neon_impl + 0) x27: 203 x28: 31 x29: ffff0000f0fa9040 (ucom_cons_softc + efbf1a90) sp: ffff0000f0fa9000 lr: ffff0000feb04668 (SHA2Update + 168) elr: ffff0000feaf8684 (zfs_sha256_block_neon + 14) spsr: 20000045 esr: 000000001fe00000 panic: VFP exception in the kernel cpuid =3D 3 time =3D 1680786034 KDB: stack backtrace: db_trace_self() at db_trace_self db_trace_self_wrapper() at db_trace_self_wrapper+0x30 vpanic() at vpanic+0x13c panic() at panic+0x44 do_el1h_sync() at do_el1h_sync+0x210 handle_el1h_sync() at handle_el1h_sync+0x10 --- exception, esr 0xffff0000f0fa9198 (null)() at 0x400 KDB: enter: panic [ thread pid 1446 tid 100101 ] Stopped at kdb_enter+0x44: undefined f905c27f db>=20 =3D=3D=3D Mark Millard marklmi at yahoo.com