From nobody Mon Jul 15 00:20:55 2024 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4WMjXx42wGz5Q2Ks for ; Mon, 15 Jul 2024 00:21:05 +0000 (UTC) (envelope-from philip@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4WMjXx1BrSz44tN; Mon, 15 Jul 2024 00:21:05 +0000 (UTC) (envelope-from philip@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1721002865; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=LSPotmti7dJxLawN7Y864gcSlOTRDKwxYVioDVf9DUg=; b=MdKa/EIXuFh4I1S74V1uowTAdABarl/JEx0HeM1ugQYovTA5Nw/Q8OZtEwEhuDvcCtidF7 QJAYKpmBMSVqngAbp3TiFSrYOo1sfxEc/pTi3C/+x9H1B8XAySNED8SLtX2RVE6ILk6JpL wTRTUsmkk7Elkd4L+Y4ymqbsrz2X6XCDoK9Rx0EY/bqnVMd67l1Tl0dxfu8hfcgb2ga2Rh 4z7i8HvysSxfWAmtL46bkK/w+KWiPP7dEREAt9Ai1cr2KOYZ3AJac+7Zrt+/zxRSeTgI9J xge4hb+mYfLrRp1ESJk4yHweQAHWQBD3Ny/FmAuQL3hRCSDMZSK2UN6NkLdooQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1721002865; a=rsa-sha256; cv=none; b=FiaOmVed/dYx5x3WnCibXw5b/JLHYY5DB6VmEWmguNLZNr17ihdYUl6+bW9weeWqD34FMr 6CEZAGus2LJFmbHKqgtwptQJknliT7h5X1gMFxfsb6DiJxY2Yu59M55JcgI7ku5943iHyg CszugGkpiyXrC/0ZoD0lSN5kDAtU/ntC8TisQHey9OQBa+ayUPgI1pnOCuTBlWS1MTxjgM AzWG3l66WLw/EEqGkGHbpaagl8lhvnU13Z0CR7pVVmZE9eQG25T48C/1Px8jvGG5h5MJue hz89qTL/WC5nnypdS3B+/lrj4O5I5TNNQEOOVrO4DtYSSokeIK0nzUa2OM+kXw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1721002865; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=LSPotmti7dJxLawN7Y864gcSlOTRDKwxYVioDVf9DUg=; b=eEj1UxK+M526rI6yGEYX/S4hSB0VQqp0XbQbshUKKQjmWoG68Nv/kZ/IOlmhfR+AGfGPTa VrkwB1wpmoeTQyDEkeaz48Iy/SORZgToKBtDG8WA11mdZZdc0y8E+sH9O7KVO5piTyyUMm 9I4cMpFgOFHsLuA82L8R9wzDryFts3icJhXTYlch8BU5hfuimRUrC25gSOKI+dqYNEIsuH cqlxUDWpDWoMkw9e9HlCCxgnQ67PaBECu6K7Ugs7ZechYlO2kF+X5QIpSTGcJ6ofMc0H7X qnaNgBaTRmRxv9EpAfD1UHOiznyv0tGhWg8wPLhg3sd7raznSaDfXkCBzCRsVw== Received: from fauth1-smtp.messagingengine.com (fauth1-smtp.messagingengine.com [103.168.172.200]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: philip/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4WMjXx0TR2z1297; Mon, 15 Jul 2024 00:21:05 +0000 (UTC) (envelope-from philip@freebsd.org) Received: from compute7.internal (compute7.nyi.internal [10.202.2.48]) by mailfauth.nyi.internal (Postfix) with ESMTP id EBA69120006D; Sun, 14 Jul 2024 20:21:03 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute7.internal (MEProxy); Sun, 14 Jul 2024 20:21:03 -0400 X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeeftddrgedugdefhecutefuodetggdotefrodftvf curfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfghnecu uegrihhlohhuthemuceftddtnecusecvtfgvtghiphhivghnthhsucdlqddutddtmdenuc fjughrpefhvfevufffoffkjghfgggtsehmtdhmreertddtnecuhfhrohhmpefrhhhilhhi phcurfgrvghpshcuoehphhhilhhiphesfhhrvggvsghsugdrohhrgheqnecuggftrfgrth htvghrnhepleehieehteelieeitdegvefhveefleehffdtuefhleelvdfhveehtdefffef vdelnecuffhomhgrihhnpehfrhgvvggsshgurdhorhhgnecuvehluhhsthgvrhfuihiivg eptdenucfrrghrrghmpehmrghilhhfrhhomhepphhhihhlihhpodhmvghsmhhtphgruhht hhhpvghrshhonhgrlhhithihqdduudeiiedviedvgeekqddvfeehudektddtkedqphhhih hlihhppeepfhhrvggvsghsugdrohhrghesthhrohhusghlvgdrihhs X-ME-Proxy: Feedback-ID: ia691475d:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA; Sun, 14 Jul 2024 20:21:01 -0400 (EDT) From: Philip Paeps To: Mark Millard Cc: mmel@freebsd.org, freebsd-arm@freebsd.org Subject: Re: A better alternative to having builds of main-armv7-default fully disabled and last-built be months out of date Date: Mon, 15 Jul 2024 08:20:55 +0800 X-Mailer: MailMate (1.14r6052) Message-ID: <016A1875-EE40-4815-964D-9762597206B7@freebsd.org> In-Reply-To: <274FAB06-4204-415D-941F-69F623E11266@yahoo.com> References: <91287D15-F0A9-4425-A265-B07418B8714D.ref@yahoo.com> <91287D15-F0A9-4425-A265-B07418B8714D@yahoo.com> <816ef6c9-836f-48bb-9f89-b46898431c87@freebsd.org> <274FAB06-4204-415D-941F-69F623E11266@yahoo.com> List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@FreeBSD.org MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="=_MailMate_7F94123E-2EFD-4CA3-BB5C-C097F28827B0_=" --=_MailMate_7F94123E-2EFD-4CA3-BB5C-C097F28827B0_= Content-Type: text/plain; format=flowed Sorry for not following up to this thread earlier. I've been occupied elsewhere in the cluster. On 2024-07-07 16:25:32 (+0800), Mark Millard wrote: > On Jul 6, 2024, at 21:35, Michal Meloun > wrote: >> On 07.07.2024 5:42, Mark Millard wrote: >>> main's armv7 packages that are distributed are getting to be months >>> behind because of the build hangups preventing the builds on >>> ampere2. It's worth reinforcing that this only affects main (15-CURRENT). Our stable/13 and stable/14 packages for armv7 are reasonably up to date. Reasonably for a tier-2 architecture anyway. Whatever is causing this, it's only in main. > The only known failures are on ampere2 as far as I know. > As far as I know there is no known way to configure to > match the formal build procedures used on ampere2. According to the current schedule, armv7 builds happen on ampere3, not ampere2: ampere1: - quarterly arm64.aarch64 13.3-RELEASE 133arm64 -a ampere1: - quarterly arm.armv7 releng/13.3 133releng-armv7 -a ampere1: - quarterly arm64.aarch64 14.0-RELEASE 140arm64 -a ampere1: - quarterly arm.armv7 releng/14.0 140releng-armv7 -a ampere2: - default arm64.aarch64 main main-arm64 -a ampere3: - default arm64.aarch64 13.3-RELEASE 133arm64 -a ampere3: - default arm.armv7 releng/13.3 133releng-armv7 -a ampere3: - default arm64.aarch64 14.0-RELEASE 140arm64 -a ampere3: - default arm.armv7 releng/14.0 140releng-armv7 -a I've attached the poudriere.conf from that machine. It's the same one we have on all the builders. >> I've seen some strange live lockups in arm32 jail, but never managed >> to reproduce it. > > On what kind(s) of hardware? > Any kind of relevant context known? In case it helps: ref15-aarch64.freebsd.org (available to all developers) is an identical configuration as ampereX.nyi.freebsd.org. The former has a newer BIOS (for some reason) but that hopefully should not make a difference. If we reach the point where we think the BIOS version matters, I can try to upgrade the BIOS on the ampereXen. smbios.bios.reldate="06/25/2020" smbios.bios.revision="1.14" smbios.bios.vendor="LENOVO" smbios.bios.version="hve104q-1.14" smbios.bios.reldate="05/30/2019" smbios.bios.revision="1.8" smbios.bios.vendor="LENOVO" smbios.bios.version="HVE104J-1.08" Philip --=_MailMate_7F94123E-2EFD-4CA3-BB5C-C097F28827B0_= Content-Disposition: attachment; filename=poudriere.conf Content-Type: text/plain; name=poudriere.conf Content-Transfer-Encoding: quoted-printable # !!!! DO NOT EDIT THIS FILE, IT IS TRACKED IN SVN (https://pm-svn.freebs= d.org/cluster) !!!! # vim: set filetype=3Dsh: ZPOOL=3Dzroot ZROOTFS=3D/poudriere RESOLV_CONF=3D/etc/resolv.conf BASEFS=3D/usr/local/poudriere USE_PORTLINT=3Dno USE_TMPFS=3Dall DISTFILES_CACHE=3D/usr/ports/distfiles SVN_HOST=3Dsvn0.us-east.FreeBSD.org GIT_BASEURL=3Dgit.freebsd.org/src.git GIT_PORTSURL=3Dgit.freebsd.org/ports.git CHECK_CHANGED_OPTIONS=3Dyes CHECK_CHANGED_DEPS=3Dyes NO_RESTRICTED=3Dyes NO_FORCE_PACKAGE=3Dyes URL_BASE=3D"https://pkg-status.freebsd.org/$(hostname -s)" #MAX_MEMORY=3D8 ATOMIC_PACKAGE_REPOSITORY=3Dno PKG_REPO_FROM_HOST=3Dyes SIGNING_COMMAND=3D"ssh pkg-sign" PRIORITY_BOOST=3D"iridium-browser ungoogled-chromium" PRIORITY_BOOST_VALUE=3D20 ALLOW_MAKE_JOBS_PACKAGES=3D"pkg chromium electron29 iridium-browser llvm-= devel qt5-webengine qt6-webengine ungoogled-chromium" TMPFS_BLACKLIST=3D"chromium electron29 iridium-browser ungoogled-chromium= " TMPFS_BLACKLIST_TMPDIR=3D${BASEFS}/data/wrkdirs HTML_JSON_UPDATE_INTERVAL=3D10 USE_PTSORT=3Dno DETERMINE_BUILD_FAILURE_REASON=3Dno # 48 hours for chromium based browsers MAX_EXECUTION_TIME=3D172800 # 2 hours for chromium based browsers = MAX_EXECUTION_TIME_EXTRACT=3D7200 MAX_FILES_RStudio=3D4096 MAX_FILES_RStudio_server=3D4096 MAX_FILES_atom_ide=3D4096 MAX_FILES_traefik=3D2048 MAX_FILES_gatk=3D2048 MAX_FILES_screego=3D8192 MAX_FILES_vscode=3D8192 BUILD_AS_NON_ROOT=3Dno # Use jail src for native-xtools builds XDEV_SRC_JAIL=3Dyes #CCACHE_DIR=3D/ccache calc_builders() { local GB_PER_BUILDER ncpu arcsize physmem swap vmem emem GB_PER_BUILDER=3D12 ncpu=3D$(/sbin/sysctl -n hw.ncpu) PREPARE_PARALLEL_JOBS=3D$((ncpu + 5)) # Tune BUILD_PARALLEL_JOBS based on amount of VM. physmem=3D$(($(/sbin/sysctl -n hw.physmem) / 1024 / 1024 / 1024)) arcsize=3D$(($(/sbin/sysctl -n vfs.zfs.arc_max) / 1024 / 1024 / 1024)) swap=3D$(($(/sbin/sysctl -n vm.swap_total) / 1024 / 1024 / 1024)) vmem=3D$((physmem + swap)) # Calculate "effective" memory; Ignore greedy ARC. emem=3D$((vmem - arcsize)) if [ ${emem} -lt 0 ]; then # The ARC is probably too big. emem=3D$((emem + arcsize)) fi # Give each builder GB_PER_BUILDER BUILD_PARALLEL_JOBS=3D$((emem / GB_PER_BUILDER)) if [ ${BUILD_PARALLEL_JOBS} -gt ${ncpu} ]; then BUILD_PARALLEL_JOBS=3D${ncpu} elif [ ${ncpu} -ge $((2 * BUILD_PARALLEL_JOBS)) ]; then ALLOW_MAKE_JOBS=3Dyes fi if [ $# -gt 0 ]; then echo "calc_builders(): ncpu=3D${ncpu} physmem=3D${physmem} arcsize=3D${= arcsize} JOBS=3D${BUILD_PARALLEL_JOBS}" >&2 fi } calc_builders "$@" #case "$(hostname -s)" in # foul2) # BUILD_PARALLEL_JOBS=3D20 # ;; #esac --=_MailMate_7F94123E-2EFD-4CA3-BB5C-C097F28827B0_=--