From nobody Sat Aug 05 06:11:54 2023 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RHsgG0QN1z4phgw for ; Sat, 5 Aug 2023 06:12:10 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic305-19.consmr.mail.gq1.yahoo.com (sonic305-19.consmr.mail.gq1.yahoo.com [98.137.64.82]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RHsgF2xKyz4ZlC for ; Sat, 5 Aug 2023 06:12:09 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1691215925; bh=SWQR1BKsKW4CgTizL4WB+Ys2F8WLEkQlPWF4CjWU0+8=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=PYTAkrglt36YjqU81uk0I6IsViVBF7FGJesufBL75WRE++9tdgViWVDof2PEwlm3aJtX6Y2tC9xz7ftyKVddhjTZSCHiJr+QMA4NtJZyQy0OE5h/AKIVtMAIPOQmUzYaHekgBb2+CeQX/C/jhYpu/ayFG8RzofSGVjSxAzs5xuKkwEbvuh1/hMjoEdSPLSDi8SantlhDVZ/0hXzRIfRf2lY6Dj+645763UFVVHjzqRazanKS6coWRqNLOs4GzH/9gI+87F89O6zKHl0gZrsrOepQFiVGiPvsU7gYpa9gxAoUEDjueDmMMezLIakn3/FLmd3kPupiyq82NeDLJMqcng== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1691215925; bh=VHa8pZjL55f6Q9miCSWZQgWZe0pMsZfAFYnpHj94yV0=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=AzsGcvS71RgL2+jgxDfgDSIH23DpcYsW+IEQiQYPUQrWKuhVTF2OaX98Ve3jIBoeomFz60E7iDMrdRDthBMzzf7X7ZJH6Sw9YkUdB1wsMhoe04TFlJp1jyq0Hz/9QAz+7DDHMixxDTB8dZ38NcoGu9zwxFztD7PXCQWeAzkZHW3zZf1cJs0jw42q1MqCRWjVOnSeNijl/vJpHxSVWMS03VLuvCUHGSh/hIk+D9giUvqhzN3uykwdn3gdJpbH04NhWEG5wu6oa6rkdPlGvnxPVZTvYYo1dEm83clTQpqowz70PGfvFrwq8Nd0Ju0+f9QiOxiCyG47BhII/i6Dhp61LA== X-YMail-OSG: DtJHXHsVM1lPuTPShjoziHlEsNypvQVSKxvmd.AdpB3.6Nb8C0hmBOxt04Aipxe 3.H._XJ3w2gKHMq9Fvmv4PZbqs39zj7LdFQMFhMMK0Ap9wjDskVQe6v..XyyvP8267wimIfCN38V 3EfVHOMa.y3Noy377jdHhYor.KTli_oUmN6cZcvnDGYf3VvZQp0UDFrrForHDeXKjn9t8HVMzams K3cZlyetS8ISl9sPyPVRJL9H3iSy1Zp9JSWckex82GzWa4PfDNXOENAKh6HpzShRBbmuA9kAcfNE eNTeTlHfBjpJWkqG0J4mDq6kPEdqfKZ5oWohVlBb8EXvXrPke8ndIQU98QIg.vd5eJKWA9iekNq5 _tzXOnKVVYXlxVRYrElGDjXryrFvD_p4rabNCXUSVya4gjr2.9AqTqvkETm4XNksi5ksdjX3sa7V BVGZa48NJh.BYQ34TWn3efEL2VuUvzMDfrBUmOxxmNmHBQX6hP_c9EDIZD0WgEBmVDFvmy7t6sNj MLnojQqHloyvJX0AE.FCuHEcHcd71NJFonqEH5DeXZSPKAS_yFGUi_BSVF6AEemj56pD8cTqW6WA 1vWcC0vPMd.W5fZoqNhTkeidpmfh8S1HivevoMMVOTMLtOK.DzFoOEk6tUUC4lcN8oBn87bq9ylo vXaAJ7re_ydGmSBoDeQCimJULy.OsgtJS.65KykquN9tE0uqy3ts2GE5w8pqCJj2rOl2L1C4dfvw 0D1MaDFBAuF4JeWyWupm85ATqbbKGs8lYCdER3yICQIk4C7VHJMMo502K36tfcuE6DXNGvxChSfT RpHdU9z6q_hzUHEViuw.fRyyN4h5Z4r91bXxkg68Gb2nquKpP1FFSiVGPaOC1itn1FDpjLP6jJE9 1QD48m_aO7FPQonl7ufufQiyQVn6vQGO0DJd6FyeLtCaw1yrXzwsqG8GBgSvtBImi0FePmxjVwWC rBY8BWcw_Idb23IhnYZt_N4SJh9LGufCZOlnXHOcgCnTW1RDfSyamaHWCIVbe_3EiYIaOREHUnvH qibt4B5_3ocVBwNTkfDJNyuuOZA15QAAOC5BeFlydo7fh9j_t.XeAZrDpqZmSkJ5qvBpmH1taAT8 n8KxLY81bR2MII1G9VRch2qcnTOY0cSeTL0o_uUpttkIRaf1.GuQftnZm4SM.oViKgW6wgFkGHDu aXfVAX3KArAt9POl5JjF2htvnr6NiRBdMkeNLDLXRld9UYDxHa_al3CpPsxUdEwONd.cnH6mQvlg LUmYUFb0UXl6z0WulQDTmUNrDyT80Pzxd0rmAyLhQg381dQjjwQR_y5r5cQ8MXi6hgvTHj5Q6Kmc r1jThXVYNIC_623v9fz_rpmO.bvquSk8VXBPvdXYGKfX0SxFr9Sz1XiVN9JyrPnSnO6dFjXgoMTt FdXAah4KlWLBwQLBqX3zYMPk87CXYeV6l46wpmp20HqqV_W1QFPazD17q9sRnY0h5BztZ_RTlnVr Kqxt95jt4.GW7ZtwPAgu7REgOrYunGPayyVzrlDnrFcMduaZr597CAlSfdcFa5pJYSDPphVLjsAx UrbekCLdGsbRdnZyMh50CGoCROtumUl955tQfLZxEQVZCf3VjGUtpjyS.Fjzta.o_kyb6.__PiMb BGt0nlq5efn3ucbJfiMJjdclKxwMpiwpS3VHWUqpwQIF0NPZZ5U_8yQTFruOwzEonNNreO35xg5I Adnd_s5wd.PfreRHDTE9BvR9656uEKc5VdVHN0Q3l_GEa7b91svK8mdXiGzXgY5AlQ5dWkc01fdz Etn.Yi_l5Ur43nvqkLGcI4Yuwqf48AqRi1kwCL6eoL_rue05sBl84miL8hGHGujHp1Hf1QxZFl86 xYYh8rTy_mJkeQZ7YWFnBaUq.hEId1N3j00gThubuT1WCDSgh7AQMk7ESQjH4UW_XeRyRYbGunN8 vAP7BKJojmkxY9MAtyOWpvVB8tT2ta6hESxGTzwelCXlq6d0lldfZs5bNzLtNlkDom1J6WPJqtNF Wn3WhlWtUYpsKj8bSogVfiDZmP4_dmkLlMZnNzeggP5vUqilxk5iX4JE3JsBLIuSPyLA3Q7Yox3_ S_CwdEi8kEfFg.WwsV2fEZ.jrvWPUxEw83ZosLwn6hftnzx7.hxKuUVXY.o7Qd_emGn0gyWlaBhF wPSiVlUBubetJv19zIcltn360qztjTGDQkfKR.k0WZagZW.TN0FYUsBfxrBHH.leOX5uUZT7Evyg fnC3941m3q03KCUtL4r9tuPBUGSOuaa8gWTcDJs75hVpMEy1dSWesSTwMJ30AjQl10NYfvuAhtt8 F X-Sonic-MF: X-Sonic-ID: 841b9743-540d-446b-8bb8-4ef92198e062 Received: from sonic.gate.mail.ne1.yahoo.com by sonic305.consmr.mail.gq1.yahoo.com with HTTP; Sat, 5 Aug 2023 06:12:05 +0000 Received: by hermes--production-gq1-7d844d8954-psjqr (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 68d446670156984f7b813f8ee2519236; Sat, 05 Aug 2023 06:12:05 +0000 (UTC) Content-Type: text/plain; charset=utf-8 List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: A native armv7 panic during kyua runs: sys/netinet6/exthdr:exthdr -> Fatal kernel mode data abort: 'Alignment Fault' on read From: Mark Millard In-Reply-To: Date: Fri, 4 Aug 2023 23:11:54 -0700 Cc: FreeBSD ARM List , Current FreeBSD Content-Transfer-Encoding: quoted-printable Message-Id: References: To: Warner Losh X-Mailer: Apple Mail (2.3731.700.6) X-Rspamd-Queue-Id: 4RHsgF2xKyz4ZlC X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] On Aug 4, 2023, at 20:58, Warner Losh wrote: > It might make sense to work up a patch that skips this test on armv7 = after filing a bug (the usual way).... >=20 > Warner Actually, looking at the backtrace, it seems I've previously listed the same sort of backtrace structure in: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D271759 comment 12. Hans Petter Selasky had been working on that bugzilla entry. I'll add a note that this time I got it with the built-in EtherNet instead of the dongle used previously --and that sys/netinet6/exthdr:exthdr is a way of producing the panic. [Done.] In /usr/main-src/tests/sys/netinet6/exthdr.sh , commenting out one line would disable the specific test (leading whitespace might not be preserved below): atf_init_test_cases() { # atf_add_test_case "exthdr" } [FYI: All my kyua activity has been for FreeBSD main, generally targeting contexts with some armv7 code involved. It is associated with my having been an tester of early lib32 drafts.] I already have another commented out line for an armv7 panic (leading whitespace might not be preserved): # git -C /usr/main-src/ diff tests/sys/net/ diff --git a/tests/sys/net/if_bridge_test.sh = b/tests/sys/net/if_bridge_test.sh index eb3a792df449..dcdac75103cd 100755 --- a/tests/sys/net/if_bridge_test.sh +++ b/tests/sys/net/if_bridge_test.sh @@ -675,7 +675,7 @@ atf_init_test_cases() atf_add_test_case "delete_with_members" atf_add_test_case "mac_conflict" atf_add_test_case "stp_validation" - atf_add_test_case "gif" +# atf_add_test_case "gif" atf_add_test_case "mtu" atf_add_test_case "vlan" } In the original discovery, having if_bridge.ko already loaded was important to getting the "gif" panic. But I've not yet put effort into isolating a cleaner/simpler test than I got the failure with. Nor have a done a range of comparisons of differing contexts yet. There are other armv7 related issues, one in particular being: A) All the long timeouts [300s+] are for *.py style tests. (Lots of these.) B) All the *.py style tests that do not have long timeout have one of: -> skipped: comment me to run the test -> skipped: Current architecture 'armv7' not supported __test_cases_list__ -> broken: Test program did not exit cleanly __test_cases_list__ -> broken: Test case list wrote to stderr The are about 10 of the "comment me" ones and 1 each of the other (B) ones, if I remember right. In other words, basically all the *.py based tests are broken or skipped as kyua classifies things. I've no clue yet if (A) is tied to the ports': cryptography/hazmat/bindings/_openssl.abi3.so openssl 3 incompatibility or not. But I've only seen the issue in armv7 contexts so far. I've spent time today on this issue but have made no progress on identifying what leads to the kdump/truss-output being as it is. If the *.py tests were working, I'd not be surprised to then find more armv7 panics than is now possible via the kyua tests. > On Fri, Aug 4, 2023 at 12:59=E2=80=AFAM Mark Millard = wrote: > While discovered via an attempted overall kyua run, the following is > sufficient to get the crash in my native armv7 context: >=20 > # /usr/bin/kyua test -k /usr/tests/Kyuafile sys/netinet6/exthdr:exthdr > sys/netinet6/exthdr:exthdr -> Fatal kernel mode data abort: = 'Alignment Fault' on read > trapframe: 0xdfb97aa0 > FSR=3D00000001, FAR=3Ddb43ab76, spsr=3D60000013 > r0 =3Ddfedd000, r1 =3Ddfb97b34, r2 =3D00000000, r3 =3D00000000 > r4 =3D00000000, r5 =3D00000000, r6 =3Ddb43ab76, r7 =3Ddb43ab66 > r8 =3Dc096383c, r9 =3D00000000, r10=3Ddb132400, r11=3Ddfb97b60 > r12=3D00000000, ssp=3Ddfb97b30, slr=3Dc0b4e2c0, pc =3Dc04e6b70 >=20 > panic: Fatal abort > cpuid =3D 0 > time =3D 1691131498 > KDB: stack backtrace: > db_trace_self() at db_trace_self > pc =3D 0xc065f414 lr =3D 0xc007db80 = (db_trace_self_wrapper+0x30) > sp =3D 0xdfb97858 fp =3D 0xdfb97970 > db_trace_self_wrapper() at db_trace_self_wrapper+0x30 > pc =3D 0xc007db80 lr =3D 0xc031a834 (vpanic+0x140) > sp =3D 0xdfb97978 fp =3D 0xdfb97998 > r4 =3D 0x00000100 r5 =3D 0x00000000 > r6 =3D 0xc07c369a r7 =3D 0xc0b32e58 > vpanic() at vpanic+0x140 > pc =3D 0xc031a834 lr =3D 0xc031a6f4 (vpanic) > sp =3D 0xdfb979a0 fp =3D 0xdfb979a4 > r4 =3D 0xdfb97aa0 r5 =3D 0x00000013 > r6 =3D 0xdb43ab76 r7 =3D 0x00000001 > r8 =3D 0x00000001 r9 =3D 0xdfedd000 > r10 =3D 0xdb43ab76 > vpanic() at vpanic > pc =3D 0xc031a6f4 lr =3D 0xc06849dc (abort_align) > sp =3D 0xdfb979ac fp =3D 0xdfb979d8 > r4 =3D 0x00000001 r5 =3D 0x00000001 > r6 =3D 0xdfedd000 r7 =3D 0xdb43ab76 > r8 =3D 0xdfb979a4 r9 =3D 0xc031a6f4 > r10 =3D 0xdfb979ac > abort_align() at abort_align > pc =3D 0xc06849dc lr =3D 0xc0684a50 (abort_align+0x74) > sp =3D 0xdfb979e0 fp =3D 0xdfb979f8 > r4 =3D 0x00000013 r10 =3D 0xdb43ab76 > abort_align() at abort_align+0x74 > pc =3D 0xc0684a50 lr =3D 0xc06846a8 (abort_handler+0x45c) > sp =3D 0xdfb97a00 fp =3D 0xdfb97a98 > r4 =3D 0x00000000 r10 =3D 0xdb43ab76 > abort_handler() at abort_handler+0x45c > pc =3D 0xc06846a8 lr =3D 0xc0661cc8 (exception_exit) > sp =3D 0xdfb97aa0 fp =3D 0xdfb97b60 > r4 =3D 0x00000000 r5 =3D 0x00000000 > r6 =3D 0xdb43ab76 r7 =3D 0xdb43ab66 > r8 =3D 0xc096383c r9 =3D 0x00000000 > r10 =3D 0xdb132400 > exception_exit() at exception_exit > pc =3D 0xc0661cc8 lr =3D 0xc0b4e2c0 (__pcpu) > sp =3D 0xdfb97b30 fp =3D 0xdfb97b60 > r0 =3D 0xdfedd000 r1 =3D 0xdfb97b34 > r2 =3D 0x00000000 r3 =3D 0x00000000 > r4 =3D 0x00000000 r5 =3D 0x00000000 > r6 =3D 0xdb43ab76 r7 =3D 0xdb43ab66 > r8 =3D 0xc096383c r9 =3D 0x00000000 > r10 =3D 0xdb132400 r12 =3D 0x00000000 > in6ifa_ifwithaddr() at in6ifa_ifwithaddr+0x30 > pc =3D 0xc04e6b70 lr =3D 0xc04f9030 (ip6_input+0xd38) > sp =3D 0xdfb97b68 fp =3D 0xdfb97c28 > r4 =3D 0xdb43ab76 r5 =3D 0xdb43ab5e > r6 =3D 0x00000000 r7 =3D 0xdb43ab66 > ip6_input() at ip6_input+0xd38 > pc =3D 0xc04f9030 lr =3D 0xc046d66c = (netisr_dispatch_src+0xf8) > sp =3D 0xdfb97c30 fp =3D 0xdfb97c58 > r4 =3D 0xdb43ab00 r5 =3D 0x00000006 > r6 =3D 0x00000007 r7 =3D 0xc0b49d50 > r8 =3D 0xdafea0c0 r9 =3D 0xdb43ab00 > r10 =3D 0x00000086 > netisr_dispatch_src() at netisr_dispatch_src+0xf8 > pc =3D 0xc046d66c lr =3D 0xc04641b0 (ether_demux+0x18c) > sp =3D 0xdfb97c60 fp =3D 0xdfb97c78 > r4 =3D 0x00000006 r5 =3D 0x00001201 > r6 =3D 0xdb132400 r7 =3D 0x000000ff > r8 =3D 0xdafea0c0 r9 =3D 0xdb43ab00 > r10 =3D 0x00000086 > ether_demux() at ether_demux+0x18c > pc =3D 0xc04641b0 lr =3D 0xc0465880 (ether_nh_input+0x490) > sp =3D 0xdfb97c80 fp =3D 0xdfb97ce0 > r4 =3D 0xdb132400 r5 =3D 0xdb43ab00 > r6 =3D 0xdb43ab50 r10 =3D 0x00000086 > ether_nh_input() at ether_nh_input+0x490 > pc =3D 0xc0465880 lr =3D 0xc046d66c = (netisr_dispatch_src+0xf8) > sp =3D 0xdfb97ce8 fp =3D 0xdfb97d10 > r4 =3D 0xdb43ab00 r5 =3D 0x00000005 > r6 =3D 0x0000000c r7 =3D 0xc0b49d30 > r8 =3D 0xdafea0c0 r9 =3D 0xdb43ab00 > r10 =3D 0xc098d18f > netisr_dispatch_src() at netisr_dispatch_src+0xf8 > pc =3D 0xc046d66c lr =3D 0xc04645c4 (ether_input+0x50) > sp =3D 0xdfb97d18 fp =3D 0xdfb97d48 > r4 =3D 0xdb43ab00 r5 =3D 0x00000000 > r6 =3D 0x00008803 r7 =3D 0x00000000 > r8 =3D 0xdafea0c0 r9 =3D 0xdb43ab00 > r10 =3D 0xc098d18f > ether_input() at ether_input+0x50 > pc =3D 0xc04645c4 lr =3D 0xdffb3f08 ($a.10+0x108) > sp =3D 0xdfb97d50 fp =3D 0xdfb97d78 > r4 =3D 0xdb132400 r5 =3D 0xdaff8b00 > r6 =3D 0xdaff8b10 r7 =3D 0x00000000 > r8 =3D 0x00000000 r10 =3D 0xc098d18f > $a.10() at $a.10+0x108 > pc =3D 0xdffb3f08 lr =3D 0xc038cb2c = (taskqueue_run_locked+0x1c4) > sp =3D 0xdfb97d80 fp =3D 0xdfb97dd8 > r4 =3D 0xe0145100 r5 =3D 0xdaff8b2c > r6 =3D 0xe0145150 r7 =3D 0x00000001 > r8 =3D 0x00000000 r9 =3D 0xdfb97d90 > r10 =3D 0x00000001 > taskqueue_run_locked() at taskqueue_run_locked+0x1c4 > pc =3D 0xc038cb2c lr =3D 0xc038e4e4 = (taskqueue_thread_loop+0x1b0) > sp =3D 0xdfb97de0 fp =3D 0xdfb97e10 > r4 =3D 0xe0145100 r5 =3D 0xe0145140 > r6 =3D 0xc07af4c4 r7 =3D 0x00000000 > r8 =3D 0xc098d18f r9 =3D 0x00000100 > r10 =3D 0xc0b228a0 > taskqueue_thread_loop() at taskqueue_thread_loop+0x1b0 > pc =3D 0xc038e4e4 lr =3D 0xc02cdf0c (fork_exit+0xc0) > sp =3D 0xdfb97e18 fp =3D 0xdfb97e38 > r4 =3D 0xdfedd000 r5 =3D 0xc0b224e0 > r6 =3D 0xc038e334 r7 =3D 0xdffc4f54 > r8 =3D 0xdfb97e40 r9 =3D 0xc098d191 > fork_exit() at fork_exit+0xc0 > pc =3D 0xc02cdf0c lr =3D 0xc0661c5c (swi_exit) > sp =3D 0xdfb97e40 fp =3D 0x00000000 > r4 =3D 0xc038e334 r5 =3D 0xdffc4f54 > r6 =3D 0xc0b45d84 r7 =3D 0xd73bcba0 > r8 =3D 0x00000001 r10 =3D 0xc0b228a0 > swi_exit() at swi_exit > pc =3D 0xc0661c5c lr =3D 0xc0661c5c (swi_exit) > sp =3D 0xdfb97e40 fp =3D 0x00000000 > KDB: enter: panic > [ thread pid 0 tid 100230 ] >=20 > For reference: >=20 > # uname -apKU > FreeBSD OPiP2E-RPi2v1p1 14.0-CURRENT FreeBSD 14.0-CURRENT armv7 = 1400093 #6 main-n264334-215bab7924f6-dirty: Tue Jul 25 23:11:39 PDT 2023 = = root@CA72-16Gp-ZFS:/usr/obj/BUILDs/main-CA7-nodbg-clang/usr/main-src/arm.a= rmv7/sys/GENERIC-NODBG-CA7 arm armv7 1400093 1400093 >=20 > The OrangePi+ 2Ed was the type of system booted and tested. >=20 =3D=3D=3D Mark Millard marklmi at yahoo.com