From nobody Mon Aug 07 18:29:27 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RKPx85Y76z4m6PN; Mon, 7 Aug 2023 18:29:32 +0000 (UTC) (envelope-from yaneurabeya@gmail.com) Received: from mail-pf1-x42b.google.com (mail-pf1-x42b.google.com [IPv6:2607:f8b0:4864:20::42b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RKPx75l6wz3NMT; Mon, 7 Aug 2023 18:29:31 +0000 (UTC) (envelope-from yaneurabeya@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20221208 header.b=nK6GJV3U; spf=pass (mx1.freebsd.org: domain of yaneurabeya@gmail.com designates 2607:f8b0:4864:20::42b as permitted sender) smtp.mailfrom=yaneurabeya@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-pf1-x42b.google.com with SMTP id d2e1a72fcca58-686efa1804eso3482489b3a.3; Mon, 07 Aug 2023 11:29:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1691432970; x=1692037770; h=to:references:message-id:cc:date:in-reply-to:from:subject :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=oYMqs0Uhe+xXOIoFJ1YijPkvCF82gLNDiV5S30CS+Oc=; b=nK6GJV3UKiKCgrwf3PPzZii0n46WPCZcjiQRbg34Sq4U90YLaFBd1MRH+HM+pKg8AA quIeJxDwWnRp0FfIIyHA5cedG1On5zGm50WoNteUJ4tPfbRdN/VylY+FRh1/gGAyA5KH GSuB9+iPLNdlKbxNrNgSsSKcNE+cVzgZG8s8xlAm8e2LJImA8bPfyJ62/lgd5fqWdiL8 u59bwEeUK2SOBZiYTKgKzLSb16a5LgutsWiLED2ghOwd97rTZN2lJ0cNCXIHyZud7mHf gnR5dxemgCog/s2J6Uzdh0pIG6ZOVlguhrR3TlB2arzNUlNqCAXVNrh/yB6XN13kUgsN j4ow== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1691432970; x=1692037770; h=to:references:message-id:cc:date:in-reply-to:from:subject :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=oYMqs0Uhe+xXOIoFJ1YijPkvCF82gLNDiV5S30CS+Oc=; b=InnwB9Nj4Gy5S5dtAcCiDD6W4f+D7+cc0pet2NqdvcAytv6garRirg12k9A7UMUcEs IWfPUgEnGzzFWFcSbY06FPioURWdxFQJ/swCpr8G7SlcJIGvv+tkyFxPGVr9wTqJ3vUZ hjpUbWfwQ/Q6YTGNa+mETVB3QFivx+uHlh1/ixR539QdTy+kZIH7ExiGT/tH632pLFtw 85xp7m82muEVHq61iBO/Own9Vr/bgtkEtPgsl3FdfjRLAqbErBSeT+5L95FyUv59ydJI E23syt8h+57GpD0JSTrrQsyPqvvv7m+AzZAY9D/lNG4hRDWUzKk2sKgNwul0+HHkNJpp 33CQ== X-Gm-Message-State: AOJu0Yx4GGo3ROTuLf3qGrkBXf6Oqr5phr2sMwj3QZITBkJW3m1xYkxG BTSx/Jm+Z7xmPVdXvna/0VeBFSNo8Qw= X-Google-Smtp-Source: AGHT+IHFvPF7dqVSIAC0yrZebBZsfH5ijuj+AEvaGCh+QaBGIY0yGk9lEnXOH/X+apOwLlMZ+AZwWg== X-Received: by 2002:a05:6a00:1816:b0:672:264c:e8cf with SMTP id y22-20020a056a00181600b00672264ce8cfmr12863913pfa.7.1691432970273; Mon, 07 Aug 2023 11:29:30 -0700 (PDT) Received: from smtpclient.apple (c-73-19-52-228.hsd1.wa.comcast.net. [73.19.52.228]) by smtp.gmail.com with ESMTPSA id c23-20020a62e817000000b0068783a2dfdasm6453792pfi.104.2023.08.07.11.29.29 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Mon, 07 Aug 2023 11:29:29 -0700 (PDT) Content-Type: multipart/signed; boundary="Apple-Mail=_F5EC6333-8803-4207-AA92-CFF70C7C72E7"; protocol="application/pgp-signature"; micalg=pgp-sha256 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3696.120.41.1.4\)) Subject: Re: armv7 kyua runs via chroot on aarch64: zfs tests leave behind processes from timed out tests From: Enji Cooper In-Reply-To: Date: Mon, 7 Aug 2023 11:29:27 -0700 Cc: Current FreeBSD , FreeBSD ARM List Message-Id: <96486101-14EF-4588-A078-26F85AF1FE34@gmail.com> References: <1BDD2369-BCC3-469B-8094-AEFE7FC3CE94@yahoo.com> To: Mark Millard X-Mailer: Apple Mail (2.3696.120.41.1.4) X-Spamd-Result: default: False [-5.57 / 15.00]; SIGNED_PGP(-2.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.97)[-0.974]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; MV_CASE(0.50)[]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20221208]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; RCPT_COUNT_THREE(0.00)[3]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::42b:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org,freebsd-arm@freebsd.org]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; HAS_ATTACHMENT(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_TO(0.00)[yahoo.com]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_COUNT_TWO(0.00)[2] X-Spamd-Bar: ----- X-Rspamd-Queue-Id: 4RKPx75l6wz3NMT --Apple-Mail=_F5EC6333-8803-4207-AA92-CFF70C7C72E7 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 > On Aug 3, 2023, at 10:20 AM, Mark Millard wrote: >=20 > On Aug 3, 2023, at 07:18, Mark Millard wrote: >=20 >> On Aug 3, 2023, at 00:19, Mark Millard wrote: >>=20 >>> This is after the patch (leading whitespace might >>> not have been preserved in what you see): >>>=20 >>> # git -C /usr/main-src/ diff sys/dev/md/ >>> diff --git a/sys/dev/md/md.c b/sys/dev/md/md.c >>> index a719dccb1955..365296ec4276 100644 >>> --- a/sys/dev/md/md.c >>> +++ b/sys/dev/md/md.c >>> @@ -147,8 +147,15 @@ struct md_ioctl32 { >>> int md_fwsectors; >>> uint32_t md_label; >>> int md_pad[MDNPAD]; >>> +#ifdef __aarch64__ >>> + uint32_t md_pad0; >>> +#endif >>> } __attribute__((__packed__)); >>> +#ifdef __aarch64__ >>> +CTASSERT((sizeof(struct md_ioctl32)) =3D=3D 440); >>> +#else >>> CTASSERT((sizeof(struct md_ioctl32)) =3D=3D 436); >>> +#endif >>>=20 >>> #define MDIOCATTACH_32 _IOC_NEWTYPE(MDIOCATTACH, struct = md_ioctl32) >>> #define MDIOCDETACH_32 _IOC_NEWTYPE(MDIOCDETACH, struct = md_ioctl32) >>>=20 >>>=20 >>> The kyua run is still in process, but at this point there is >>> the following accumulation from the zfs testing timouts: >>>=20 >>> # ps -alxdww >>> UID PID PPID C PRI NI VSZ RSS MWCHAN STAT TT TIME = COMMAND >>> . . . >>> 0 17491 1 6 20 0 36460 12324 - T - 0:24.71 |-- = fsync_integrity /testdir2316/testfile2316 >>> 0 17551 1 5 20 0 10600 7512 tx->tx_s D - 0:00.00 |-- = /sbin/zpool destroy -f testpool.2316 >>> 0 17739 1 7 20 0 10600 7308 zfs tear D - 0:00.00 |-- = /sbin/zpool destroy -f testpool.2316 >>> 0 17841 1 3 20 0 10600 7316 tx->tx_s D - 0:00.00 |-- = /sbin/zpool destroy -f testpool.2316 >>> 0 17860 1 0 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >>> 0 17888 1 3 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >>> 0 17907 1 6 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >>> 0 17928 1 7 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >>> 0 17955 1 0 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >>> 0 17976 1 4 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >>> 0 17995 1 2 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >>> 0 18023 1 2 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >>> 0 18043 1 2 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >>> 0 18064 1 3 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >>> 0 18085 1 0 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >>> 0 18114 1 7 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >>> 0 18135 1 2 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >>> 0 18157 1 6 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >>> 0 18177 1 6 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >>> 0 18205 1 4 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >>> 0 18224 1 1 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >>> 0 18255 1 3 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >>> 0 18275 1 1 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >>> 0 18296 1 5 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >>> 0 18317 1 4 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >>> 0 18345 1 4 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >>> 0 18365 1 2 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >>> 0 18386 1 3 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >>> 0 18412 1 1 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >>> 0 18447 1 5 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >>> 0 18466 1 5 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >>> 0 18516 1 6 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >>> 0 18535 1 2 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >>> 0 18632 1 0 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >>=20 >> It has added: >>=20 >> 0 18656 1 7 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >> 0 18748 1 0 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >> 0 18767 1 4 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >> 0 18858 1 5 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >> 0 18877 1 0 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >> 0 18907 1 7 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >> 0 18926 1 5 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >> 0 18956 1 7 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >> 0 18975 1 7 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >> 0 19005 1 4 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >> 0 19026 1 4 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >> 0 19298 1 6 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >> 0 19317 1 6 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >> 0 19408 1 7 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >> 0 19427 1 2 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >> 0 19518 1 4 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >> 0 19537 1 4 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >> 0 19635 1 5 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >=20 > 0 19654 1 5 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade > 0 19746 1 6 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade > 0 19767 1 6 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade > 0 19854 1 6 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade > 0 19873 1 0 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade > 0 19960 1 1 20 0 10080 6956 spa_name D - 0:00.00 |-- = /sbin/zfs upgrade >=20 >>> Lots of these are from 300s timeouts but some are from 1200s or >>> 1800s or 3600s timeouts. >>>=20 >>> For reference: >>>=20 >>> = sys/cddl/zfs/tests/txg_integrity/txg_integrity_test:fsync_integrity_001_po= s -> broken: Test case body timed out [1800.053s] >>> = sys/cddl/zfs/tests/txg_integrity/txg_integrity_test:txg_integrity_001_pos = -> passed [63.702s] >>> sys/cddl/zfs/tests/userquota/userquota_test:groupspace_001_pos -> = skipped: Required program 'runwattr' not found in PATH [0.003s] >>> sys/cddl/zfs/tests/userquota/userquota_test:groupspace_002_pos -> = skipped: Required program 'runwattr' not found in PATH [0.002s] >>> sys/cddl/zfs/tests/userquota/userquota_test:userquota_001_pos -> = skipped: Required program 'runwattr' not found in PATH [0.002s] >>> sys/cddl/zfs/tests/userquota/userquota_test:userquota_002_pos -> = broken: Test case cleanup timed out [0.148s] >>> sys/cddl/zfs/tests/userquota/userquota_test:userquota_003_pos -> = broken: Test case cleanup timed out [0.151s] >>> sys/cddl/zfs/tests/userquota/userquota_test:userquota_004_pos -> = skipped: Required program 'runwattr' not found in PATH [0.002s] >>> sys/cddl/zfs/tests/userquota/userquota_test:userquota_005_neg -> = broken: Test case body timed out [300.021s] >>> sys/cddl/zfs/tests/userquota/userquota_test:userquota_006_pos -> = broken: Test case body timed out [300.080s] >>> sys/cddl/zfs/tests/userquota/userquota_test:userquota_007_pos -> = skipped: Required program 'runwattr' not found in PATH [0.002s] >>> sys/cddl/zfs/tests/userquota/userquota_test:userquota_008_pos -> = broken: Test case body timed out [300.034s] >>> sys/cddl/zfs/tests/userquota/userquota_test:userquota_009_pos -> = broken: Test case body timed out [300.143s] >>> sys/cddl/zfs/tests/userquota/userquota_test:userquota_010_pos -> = skipped: Required program 'runwattr' not found in PATH [0.002s] >>> sys/cddl/zfs/tests/userquota/userquota_test:userquota_011_pos -> = broken: Test case body timed out [300.003s] >>> sys/cddl/zfs/tests/userquota/userquota_test:userquota_012_neg -> = broken: Test case body timed out [300.019s] >>> sys/cddl/zfs/tests/userquota/userquota_test:userspace_001_pos -> = skipped: Required program 'runwattr' not found in PATH [0.002s] >>> sys/cddl/zfs/tests/userquota/userquota_test:userspace_002_pos -> = skipped: Required program 'runwattr' not found in PATH [0.002s] >>> sys/cddl/zfs/tests/utils_test/utils_test_test:utils_test_001_pos -> = broken: Test case body timed out [300.052s] >>> sys/cddl/zfs/tests/utils_test/utils_test_test:utils_test_002_pos -> = skipped: Required program 'labelit' not found in PATH [0.002s] >>> sys/cddl/zfs/tests/utils_test/utils_test_test:utils_test_003_pos -> = broken: Test case body timed out [300.076s] >>> sys/cddl/zfs/tests/utils_test/utils_test_test:utils_test_004_pos -> = broken: Test case body timed out [300.106s] >>> sys/cddl/zfs/tests/utils_test/utils_test_test:utils_test_005_pos -> = skipped: Required program 'ff' not found in PATH [0.002s] >>> sys/cddl/zfs/tests/utils_test/utils_test_test:utils_test_006_pos -> = broken: Test case body timed out [300.015s] >>> sys/cddl/zfs/tests/utils_test/utils_test_test:utils_test_007_pos -> = broken: Test case body timed out [300.005s] >>> sys/cddl/zfs/tests/utils_test/utils_test_test:utils_test_008_pos -> = skipped: Required program 'ncheck' not found in PATH [0.002s] >>> sys/cddl/zfs/tests/utils_test/utils_test_test:utils_test_009_pos -> = broken: Test case body timed out [300.051s] >>> sys/cddl/zfs/tests/write_dirs/write_dirs_test:write_dirs_001_pos -> = broken: Test case body timed out [1200.056s] >>> sys/cddl/zfs/tests/write_dirs/write_dirs_test:write_dirs_002_pos -> = broken: Test case body timed out [1200.046s] >>> sys/cddl/zfs/tests/zfsd/zfsd_test:zfsd_autoreplace_001_neg -> = broken: Test case body timed out [3600.055s] >>=20 >> And added: >>=20 >> sys/cddl/zfs/tests/zfsd/zfsd_test:zfsd_autoreplace_002_pos -> = broken: Test case body timed out [3600.028s] >> sys/cddl/zfs/tests/zfsd/zfsd_test:zfsd_autoreplace_003_pos -> = broken: Test case body timed out [3600.146s] >> sys/cddl/zfs/tests/zfsd/zfsd_test:zfsd_degrade_001_pos -> broken: = Test case body timed out [600.067s] >> sys/cddl/zfs/tests/zfsd/zfsd_test:zfsd_degrade_002_pos -> broken: = Test case body timed out [600.015s] >> sys/cddl/zfs/tests/zfsd/zfsd_test:zfsd_fault_001_pos -> broken: = Test case body timed out [300.061s] >> sys/cddl/zfs/tests/zfsd/zfsd_test:zfsd_hotspare_001_pos -> broken: = Test case body timed out [3600.042s] >> sys/cddl/zfs/tests/zfsd/zfsd_test:zfsd_hotspare_002_pos -> broken: = Test case body timed out [3600.161s] >> sys/cddl/zfs/tests/zfsd/zfsd_test:zfsd_hotspare_003_pos -> broken: = Test case body timed out [3600.033s] >> sys/cddl/zfs/tests/zfsd/zfsd_test:zfsd_hotspare_004_pos -> broken: = Test case body timed out [3600.007s] >=20 > sys/cddl/zfs/tests/zfsd/zfsd_test:zfsd_hotspare_005_pos -> broken: = Test case body timed out [3600.065s] > sys/cddl/zfs/tests/zfsd/zfsd_test:zfsd_hotspare_006_pos -> broken: = Test case body timed out [3600.014s] > sys/cddl/zfs/tests/zfsd/zfsd_test:zfsd_hotspare_007_pos -> broken: = Test case body timed out [3600.066s] >=20 >>> Other timeouts not from zfs tests have not had an accumulation >>> of processes left behind. But these may be the set of tests >>> that use ksh93 for scripting. I make no claim of knowing the >>> zfs vs. ksh93 vs. both vs. ??? for what is contributing. >>>=20 >>>=20 >>> I'll note that the system was booted via a bectl BE environment >>> on the only FreeBSD media enabled, so is a zfs-root boot context. >>>=20 >>> For reference: >>>=20 >>> # uname -apKU >>> FreeBSD CA78C-WDK23-ZFS 14.0-CURRENT FreeBSD 14.0-CURRENT aarch64 = 1400093 #6 main-n264334-215bab7924f6-dirty: Wed Aug 2 14:12:14 PDT 2023 = = root@CA78C-WDK23-ZFS:/usr/obj/BUILDs/main-CA78C-nodbg-clang/usr/main-src/a= rm64.aarch64/sys/GENERIC-NODBG-CA78C arm64 aarch64 1400093 1400093 >>>=20 >>> I preload various modules (6 are commented out [not preloaded] >>> and some listed may be actually built into the kernel): >>>=20 >>> # grep kldload ~/prekyua-kldloads.sh >>> kldload -v -n zfs.ko >>> kldload -v -n cryptodev.ko >>> kldload -v -n nullfs.ko >>> kldload -v -n fdescfs.ko >>> kldload -v -n filemon.ko >>> kldload -v -n nfsd.ko >>> kldload -v -n tarfs.ko >>> kldload -v -n xz.ko >>> kldload -v -n geom_concat.ko >>> kldload -v -n geom_eli.ko >>> kldload -v -n geom_nop.ko >>> kldload -v -n geom_gate.ko >>> kldload -v -n geom_mirror.ko >>> kldload -v -n geom_multipath.ko >>> kldload -v -n sdt.ko >>> kldload -v -n dtrace.ko >>> kldload -v -n opensolaris.ko >>> kldload -v -n geom_raid3.ko >>> kldload -v -n geom_shsec.ko >>> kldload -v -n geom_stripe.ko >>> kldload -v -n geom_uzip.ko >>> kldload -v -n if_epair.ko >>> kldload -v -n if_gif.ko >>> kldload -v -n if_tuntap.ko >>> kldload -v -n if_lagg.ko >>> kldload -v -n if_infiniband.ko >>> kldload -v -n if_wg.ko >>> kldload -v -n ng_socket.ko >>> kldload -v -n netgraph.ko >>> kldload -v -n ng_hub.ko >>> kldload -v -n ng_bridge.ko >>> kldload -v -n ng_ether.ko >>> kldload -v -n ng_vlan_rotate.ko >>> kldload -v -n ipdivert.ko >>> kldload -v -n pf.ko >>> kldload -v -n if_bridge.ko >>> kldload -v -n bridgestp.ko >>> kldload -v -n mqueuefs.ko >>> kldload -v -n tcpmd5.ko >>> kldload -v -n carp.ko >>> kldload -v -n sctp.ko >>> kldload -v -n if_stf.ko >>> kldload -v -n if_ovpn.ko >>> kldload -v -n ipsec.ko >>> #kldload -v -n ipfw.ko >>> #kldload -v -n pflog.ko >>> #kldload -v -n pfsync.ko >>> kldload -v -n dummynet.ko >>> #kldload -v -n mac_bsdextended.ko >>> #kldload -v -n mac_ipacl.ko >>> #kldload -v -n mac_portacl.ko >>>=20 >>> armv7 ports built and installed in the armv7 chroot >>> area include: >>>=20 >>> # more ~/origins/kyua-origins.txt >>> archivers/gtar >>> devel/gdb >>> devel/py-pytest >>> devel/py-pytest-twisted >>> devel/py-twisted >>> lang/perl5.32 >>> lang/python >>> net/scapy >>> security/nist-kat >>> security/openvpn >>> security/sudo >>> shells/ksh93 >>> shells/bash >>> sysutils/coreutils >>> sysutils/sg3_utils >>> textproc/jq >>>=20 >>> (Those cause others to also be installed.) >>=20 >> I tried gdb -p PID against a couple of the processes. >> Each got stuck, not reaching the gdb prompt. I also >> show a Control-T output: >>=20 >> Attaching to process 17491 >> load: 0.24 cmd: gdb131 19693 [uwait] 32.27r 0.02u 0.06s 0% 32152k >> #0 0xffff00000049fe20 at mi_switch+0xe0 >> #1 0xffff0000004f3658 at sleepq_catch_signals+0x318 >> #2 0xffff0000004f3318 at sleepq_wait_sig+0x8 >> #3 0xffff00000049f410 at _sleep+0x1d0 >> #4 0xffff0000004b52dc at umtxq_sleep+0x27c >> #5 0xffff0000004bab7c at do_wait+0x25c >> #6 0xffff0000004b8cdc at __umtx_op_wait_uint_private+0x5c >> #7 0xffff0000004b6e64 at sys__umtx_op+0x84 >> #8 0xffff0000008267d4 at do_el0_sync+0x9b4 >> #9 0xffff000000805910 at handle_el0_sync+0x44 >>=20 >> and: >>=20 >> Attaching to process 17860 >> load: 0.23 cmd: gdb131 19697 [uwait] 13.14r 0.06u 0.01s 0% 32184k >> #0 0xffff00000049fe20 at mi_switch+0xe0 >> #1 0xffff0000004f3658 at sleepq_catch_signals+0x318 >> #2 0xffff0000004f3318 at sleepq_wait_sig+0x8 >> #3 0xffff00000049f410 at _sleep+0x1d0 >> #4 0xffff0000004b52dc at umtxq_sleep+0x27c >> #5 0xffff0000004bab7c at do_wait+0x25c >> #6 0xffff0000004b8cdc at __umtx_op_wait_uint_private+0x5c >> #7 0xffff0000004b6e64 at sys__umtx_op+0x84 >> #8 0xffff0000008267d4 at do_el0_sync+0x9b4 >> #9 0xffff000000805910 at handle_el0_sync+0x44 >>=20 >> I was unable to Control-C the gdb's to gain control >> but was able to put them in the background (Control-Z >> then bg). >=20 > Looks like I'm going to have to reboot instead of letting > the kyua run go to completion. The periodic daily is stuck > as well. >=20 > 0 19064 1657 1 20 0 12980 2484 piperd I - 0:00.00 | `-- = cron: running job (cron) > 0 19066 19064 3 40 0 13436 2928 wait Is - 0:00.00 | = `-- /bin/sh - /usr/sbin/periodic daily > . . . > 0 19237 19235 0 68 0 13436 2936 wait I - 0:00.00 | = | | `-- /bin/sh - /etc/periodic/security/100.chksetuid > 0 19242 19237 6 68 0 21912 10292 zfs D - 0:10.21 | = | | |-- / /var/mail . . . /dev/null (find) > 0 19243 19237 7 68 0 13436 2932 wait I - 0:00.00 | = | | `-- /bin/sh - /etc/periodic/security/100.chksetuid > 0 19245 19243 1 68 0 15204 2212 piperd I - 0:00.00 | = | | `-- cat >=20 > is also stuck. So the problems are now not limited to > the kyua run. Hi Mark, Could you please submit bugs and CC freebsd-testing or another = appropriate mailing list? It looks like there are some Arm64 = architecture specific issues that need to be addressed based on the = limited information I have from these emails. Do you have DEADLKRES/INVARIANTS/WITNESS compiled into your = kernel? If not, could you please do that? If that doesn=E2=80=99t give any helpful hints, could you please = panic the kernel and dump some debug info from ddb, e.g., 1. alltrace 2. show allchains 3. show alllocks Thank you, -Enji --Apple-Mail=_F5EC6333-8803-4207-AA92-CFF70C7C72E7 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEtvtxN6kOllEF3nmX5JFNMZeDGN4FAmTROAgACgkQ5JFNMZeD GN5QAw/+IqlWuplK0ydmi9VkiyaR3JegMrRHZijYuQZVdUFarbSvT5WD+Lsdfgqw 42jiR+Ff4Yw7S3ab+g3mAGMFmYtgmkDCWp5G4Lyfd2AFdMRzt0lodbDOUmbvwBFP 3t+qkMUMM1AeM/aiKu1tD09mHkwGeUM3LvCYKOh1fwDuo0u+tY3JuF1y+5su529u Cu8w4NoTBhfJ/GPBB/oRe3MdaFx0J1PFVN4HebPonViaQ8EohchKiaBnkqTfzLLH XKVL7gkdG2VLG1tvsPK4hcDkRXFtpvKxfKklt4arq18N0oAl4oh3ez0My+dD1tOJ 2TConrKMsnY5NTZdrPd31o5f58CLNZk1WhumQbCNXVB0UiJgV7vSM840wggYKH1f XdA5/CiYV+H8lqkWrTWQbQXVUhhexmo19DoizMtTeIr+TjxBzF85SCJiNMv4Kz4k PvZkCBKZHrBbAIRqA0umcTwczsZl6K/w/HyzXjyrRlMq1DPABUOJnwZkSO6Yk5AC mgH90M2YkLP+la2u+BenW6JoQ9N00xJ7FV1/28cSP2HkIgF5MlA7t8Mgwlv5oaZ2 HxGuEulaR8x/x+jsb6OhL5ji6j8v0rRuAg+KQAHPaxXUejgNcrJVnSgsTPuG2+nn WMNiEBzbcZul+4uE5l8nZU1LpzeXOXw394sQgmhEaNal9Hj0tiU= =NfUI -----END PGP SIGNATURE----- --Apple-Mail=_F5EC6333-8803-4207-AA92-CFF70C7C72E7--