From nobody Tue Apr 18 22:46:27 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Q1Jv373J5z45nl3 for ; Tue, 18 Apr 2023 22:46:39 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ej1-x62b.google.com (mail-ej1-x62b.google.com [IPv6:2a00:1450:4864:20::62b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Q1Jv36f57z3CVw for ; Tue, 18 Apr 2023 22:46:39 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ej1-x62b.google.com with SMTP id dx24so33081303ejb.11 for ; Tue, 18 Apr 2023 15:46:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20221208.gappssmtp.com; s=20221208; t=1681857999; x=1684449999; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=ujarkVJtZON5/zCQzEjUOhn9K7Gppkzzs4kwx75CZxg=; b=z88fdFMC4WPjosZQyWcEhDC+VraGC8PUa2oFHLUL9QReSi4ZzAQCbA1e7Qfrpe1fUm DNxMTSqA/BiihT/EAcoPzJv1K4imYYOfv/Uww/fG8SgsRPbaaFfpBW6ELl5L2Uud7Z6u zT5m2pTGRAhzic6wN+2TnxyoTve0ylUPQvIx/avNGdNqIwkqw7ZW2hoolYwwe/DqiiLy ipbbvPwkiQVvoNBUvQ2ulInF+MznAaMuxYJ7Sc5aBL3HD+3aYnuisO7Yc9QGIFxW/iab Uez5ThnvAuVT0S8A+5isTsHu/lT6GWu9MWd3RTj6cK6yMTqBIMAERrLTBWRbKmtTmBHy upTQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1681857999; x=1684449999; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=ujarkVJtZON5/zCQzEjUOhn9K7Gppkzzs4kwx75CZxg=; b=g1aWUAi5LflCsc7TAKm+zIKRQpG7VJvoUvfk7DnojslbM80n6sEsv8o7F2QtyAJHh/ cMSxvS22edZpoOr5bp6KzqWR4U/5eDJUABJOiGmpjcWr6Tdat+/yqvKDvjlUIjhzJa2G z+PMq5x4+QlE0YNuxFJjxg/w3Qj02rm24QDXY9fJx/eao/N1d6iZjZqBkr+RiumjIs2N xy28ybCGIGFDp4Or9PUeDrQvzYAAxgizT4WtRJI8n47NZH/lhpqVcAmRfrVubPr0hphj yhPMsS7DCr7Xyfx0MhIy2xl4SCjlshM3AZTWi/NCQRpCjor7piwzRya4B/xDPK7rOCGI 1k6g== X-Gm-Message-State: AAQBX9clSzWjkHIbqHebfwztktgx/b+wmconn9h+EXaGiclxjtD0i8Z/ DVzEfyHwSDm7DqOSNb25DGq6B9GG1eTTW/krBTbS7w== X-Google-Smtp-Source: AKy350YJQh/eVsrs26iYNxeUR9WXZOmO40tOmZ396WaA/d1cUU9XngTwB1H3KlsU1RV1iLFuueshFv82JfqVMBHQ88Q= X-Received: by 2002:a17:906:cc48:b0:94e:bc04:c6f6 with SMTP id mm8-20020a170906cc4800b0094ebc04c6f6mr11809779ejb.9.1681857998634; Tue, 18 Apr 2023 15:46:38 -0700 (PDT) List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 References: <6CB8D120-1600-40E6-8A1E-87E709DCEC8F.ref@yahoo.com> <6CB8D120-1600-40E6-8A1E-87E709DCEC8F@yahoo.com> In-Reply-To: <6CB8D120-1600-40E6-8A1E-87E709DCEC8F@yahoo.com> From: Warner Losh Date: Tue, 18 Apr 2023 16:46:27 -0600 Message-ID: Subject: Re: The import of openzfs vs. armv7: boot crashs To: Mark Millard Cc: Current FreeBSD , freebsd-arm , Mateusz Guzik , Pawel Jakub Dawidek , Kyle Evans Content-Type: multipart/alternative; boundary="0000000000009253ac05f9a414a4" X-Rspamd-Queue-Id: 4Q1Jv36f57z3CVw X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --0000000000009253ac05f9a414a4 Content-Type: text/plain; charset="UTF-8" Fun... I'm also fighting aarch64 issues... Warner On Tue, Apr 18, 2023, 4:45 PM Mark Millard wrote: > > https://github.com/openzfs/zfs/commit/d0cbd9feaf5b82130f2e679256c71e0c7413aae9 > > does not seem to cover armv7, just aarch64. (FreeBSD disabled > floating point for both armv7 and aarch64 but that is a > different change than above.) > > I used: > > > FreeBSD-14.0-CURRENT-arm-armv7-GENERICSD-20230406-f21faa67ab6b-262010.img.xz > > booted an RPi2B v1.1 and tried (note the KSTACK_PAGES notice and the > "undefined floating point instruction" notice): > > # zpool import > ZFS NOTICE: KSTACK_PAGES is 2 which could result in stack overflow panic! > Please consider adding 'options KSTACK_PAGES=4' to your kernel config > panic: undefined floating point instruction in supervisor mode > cpuid = 2 > time = 1680784610 > KDB: stack backtrace: > db_trace_self() at db_trace_self > pc = 0xc05eb154 lr = 0xc007a688 (db_trace_self_wrapper+0x30) > sp = 0xdd25c480 fp = 0xdd25c598 > db_trace_self_wrapper() at db_trace_self_wrapper+0x30 > pc = 0xc007a688 lr = 0xc02eb1b4 (vpanic+0x140) > sp = 0xdd25c5a0 fp = 0xdd25c5c0 > r4 = 0x00000100 r5 = 0x00000000 > r6 = 0xc0736bfc r7 = 0xc0b1aea8 > vpanic() at vpanic+0x140 > pc = 0xc02eb1b4 lr = 0xc02eaf94 (doadump) > sp = 0xdd25c5c8 fp = 0xdd25c5cc > r4 = 0xc0b92210 r5 = 0x00000000 > r6 = 0xc0610ca0 r7 = 0xf4210a0d > r8 = 0xddf32e4c r9 = 0x00000013 > r10 = 0xdd25c6c0 > doadump() at doadump > pc = 0xc02eaf94 lr = 0xc0610eb0 (vfp_new_thread) > sp = 0xdd25c5d4 fp = 0xdd25c638 > r4 = 0xdd25c6c0 r5 = 0xdd25c5cc > r6 = 0xc02eaf94 r10 = 0xdd25c5d4 > vfp_new_thread() at vfp_new_thread > pc = 0xc0610eb0 lr = 0xc060ff84 (undefinedinstruction+0x178) > sp = 0xdd25c640 fp = 0xdd25c6b8 > undefinedinstruction() at undefinedinstruction+0x178 > pc = 0xc060ff84 lr = 0xc05edaa8 (exception_exit) > sp = 0xdd25c6c0 fp = 0xdd25c750 > r4 = 0x20000013 r5 = 0xde45e000 > r6 = 0xdd25c890 r7 = 0xdd25c8b0 > r8 = 0x00000000 r9 = 0x00000000 > r10 = 0xdd25c8c0 > exception_exit() at exception_exit > pc = 0xc05edaa8 lr = 0xddf31f20 (K256) > sp = 0xdd25c750 fp = 0xdd25c750 > r0 = 0xdd25c890 r1 = 0xde45e000 > r2 = 0xde45e400 r3 = 0xddf309fc > r4 = 0x00000400 r5 = 0xde45e000 > r6 = 0xdd25c890 r7 = 0xdd25c8b0 > r8 = 0x00000000 r9 = 0x00000000 > r10 = 0xdd25c8c0 r12 = 0xdd25c7a0 > zfs_sha256_block_neon() at zfs_sha256_block_neon+0x1c > pc = 0xddf32e4c lr = 0xc0946e8c (pcpup) > sp = 0xdd25c758 fp = 0xc0b0aeec > r4 = 0xc0919610 r5 = 0xc0919630 > r6 = 0xc0919618 r7 = 0x642ebce2 > r8 = 0xc0b1b0ec r9 = 0xc0915e88 > r10 = 0xc0b1b0dc > Fatal kernel mode data abort: 'Translation Fault (L1)' on read > trapframe: 0xdd25c330 > FSR=00000005, FAR=95e29398, spsr=200000d3 > r0 =dd25c424, r1 =81000000, r2 =95e29395, r3 =55555555 > r4 =c08ae93c, r5 =00004aa0, r6 =00004aa0, r7 =c08d3e3c > r8 =00000001, r9 =c079567a, r10=0000000b, r11=dd25c3e0 > r12=00000000, ssp=dd25c3c4, slr=00000001, pc =c0610308 > > panic: Fatal abort > . . . (repeats over and over) . . . > > === > Mark Millard > marklmi at yahoo.com > > > --0000000000009253ac05f9a414a4 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Fun...

I'= ;m also fighting aarch64 issues...

Warner

On Tue, Apr 18, 2023, 4:45 PM Mark Millard <marklmi@yahoo.com> wrote:
<= blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px= #ccc solid;padding-left:1ex">https://github.com/openzfs/zfs/commit/d0cbd9feaf5b82130f= 2e679256c71e0c7413aae9

does not seem to cover armv7, just aarch64. (FreeBSD disabled
floating point for both armv7 and aarch64 but that is a
different change than above.)

I used:

FreeBSD-14.0-CURRENT-arm-armv7-GENERICSD-20230406-f21faa67ab6b-262010.img.x= z

booted an RPi2B v1.1 and tried (note the KSTACK_PAGES notice and the
"undefined floating point instruction" notice):

# zpool import
ZFS NOTICE: KSTACK_PAGES is 2 which could result in stack overflow panic! Please consider adding 'options KSTACK_PAGES=3D4' to your kernel co= nfig
panic: undefined floating point instruction in supervisor mode
cpuid =3D 2
time =3D 1680784610
KDB: stack backtrace:
db_trace_self() at db_trace_self
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0pc =3D 0xc05eb154=C2=A0 lr =3D 0xc007a688= (db_trace_self_wrapper+0x30)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0sp =3D 0xdd25c480=C2=A0 fp =3D 0xdd25c598=
db_trace_self_wrapper() at db_trace_self_wrapper+0x30
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0pc =3D 0xc007a688=C2=A0 lr =3D 0xc02eb1b4= (vpanic+0x140)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0sp =3D 0xdd25c5a0=C2=A0 fp =3D 0xdd25c5c0=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0r4 =3D 0x00000100=C2=A0 r5 =3D 0x00000000=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0r6 =3D 0xc0736bfc=C2=A0 r7 =3D 0xc0b1aea8=
vpanic() at vpanic+0x140
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0pc =3D 0xc02eb1b4=C2=A0 lr =3D 0xc02eaf94= (doadump)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0sp =3D 0xdd25c5c8=C2=A0 fp =3D 0xdd25c5cc=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0r4 =3D 0xc0b92210=C2=A0 r5 =3D 0x00000000=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0r6 =3D 0xc0610ca0=C2=A0 r7 =3D 0xf4210a0d=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0r8 =3D 0xddf32e4c=C2=A0 r9 =3D 0x00000013=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 r10 =3D 0xdd25c6c0
doadump() at doadump
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0pc =3D 0xc02eaf94=C2=A0 lr =3D 0xc0610eb0= (vfp_new_thread)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0sp =3D 0xdd25c5d4=C2=A0 fp =3D 0xdd25c638=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0r4 =3D 0xdd25c6c0=C2=A0 r5 =3D 0xdd25c5cc=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0r6 =3D 0xc02eaf94 r10 =3D 0xdd25c5d4
vfp_new_thread() at vfp_new_thread
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0pc =3D 0xc0610eb0=C2=A0 lr =3D 0xc060ff84= (undefinedinstruction+0x178)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0sp =3D 0xdd25c640=C2=A0 fp =3D 0xdd25c6b8=
undefinedinstruction() at undefinedinstruction+0x178
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0pc =3D 0xc060ff84=C2=A0 lr =3D 0xc05edaa8= (exception_exit)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0sp =3D 0xdd25c6c0=C2=A0 fp =3D 0xdd25c750=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0r4 =3D 0x20000013=C2=A0 r5 =3D 0xde45e000=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0r6 =3D 0xdd25c890=C2=A0 r7 =3D 0xdd25c8b0=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0r8 =3D 0x00000000=C2=A0 r9 =3D 0x00000000=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 r10 =3D 0xdd25c8c0
exception_exit() at exception_exit
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0pc =3D 0xc05edaa8=C2=A0 lr =3D 0xddf31f20= (K256)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0sp =3D 0xdd25c750=C2=A0 fp =3D 0xdd25c750=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0r0 =3D 0xdd25c890=C2=A0 r1 =3D 0xde45e000=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0r2 =3D 0xde45e400=C2=A0 r3 =3D 0xddf309fc=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0r4 =3D 0x00000400=C2=A0 r5 =3D 0xde45e000=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0r6 =3D 0xdd25c890=C2=A0 r7 =3D 0xdd25c8b0=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0r8 =3D 0x00000000=C2=A0 r9 =3D 0x00000000=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 r10 =3D 0xdd25c8c0 r12 =3D 0xdd25c7a0
zfs_sha256_block_neon() at zfs_sha256_block_neon+0x1c
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0pc =3D 0xddf32e4c=C2=A0 lr =3D 0xc0946e8c= (pcpup)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0sp =3D 0xdd25c758=C2=A0 fp =3D 0xc0b0aeec=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0r4 =3D 0xc0919610=C2=A0 r5 =3D 0xc0919630=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0r6 =3D 0xc0919618=C2=A0 r7 =3D 0x642ebce2=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0r8 =3D 0xc0b1b0ec=C2=A0 r9 =3D 0xc0915e88=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 r10 =3D 0xc0b1b0dc
Fatal kernel mode data abort: 'Translation Fault (L1)' on read
trapframe: 0xdd25c330
FSR=3D00000005, FAR=3D95e29398, spsr=3D200000d3
r0 =3Ddd25c424, r1 =3D81000000, r2 =3D95e29395, r3 =3D55555555
r4 =3Dc08ae93c, r5 =3D00004aa0, r6 =3D00004aa0, r7 =3Dc08d3e3c
r8 =3D00000001, r9 =3Dc079567a, r10=3D0000000b, r11=3Ddd25c3e0
r12=3D00000000, ssp=3Ddd25c3c4, slr=3D00000001, pc =3Dc0610308

panic: Fatal abort
. . . (repeats over and over) . . .

=3D=3D=3D
Mark Millard
marklmi at yahoo.com


--0000000000009253ac05f9a414a4--