From nobody Fri Jan 17 18:30:44 2025 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4YZSwZ4X30z5lJLX for ; Fri, 17 Jan 2025 18:30:54 +0000 (UTC) (envelope-from dclarke@blastwave.org) Received: from mail.oetec.com (mail.oetec.com [108.160.241.186]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (prime256v1) client-digest SHA256) (Client CN "mail.oetec.com", Issuer "E5" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4YZSwY1Pkyz3hST for ; Fri, 17 Jan 2025 18:30:53 +0000 (UTC) (envelope-from dclarke@blastwave.org) Authentication-Results: mx1.freebsd.org; dkim=fail ("headers rsa verify failed") header.d=blastwave.org header.s=default header.b=PrkJ3IP2; spf=pass (mx1.freebsd.org: domain of dclarke@blastwave.org designates 108.160.241.186 as permitted sender) smtp.mailfrom=dclarke@blastwave.org; dmarc=pass (policy=quarantine) header.from=blastwave.org Received: from [172.16.35.3] (pool-99-253-118-250.cpe.net.cable.rogers.com [99.253.118.250]) (authenticated bits=0) by mail.oetec.com (8.17.1/8.17.1) with ESMTPSA id 50HIUjgJ091090 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NOT); Fri, 17 Jan 2025 13:30:46 -0500 (EST) (envelope-from dclarke@blastwave.org) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=blastwave.org; s=default; t=1737138647; bh=/dREGveCOh165HmkpxaxmrU4xcr48zfM4tjHyhHhhVY=; h=Date:Subject:To:References:From:In-Reply-To; b=PrkJ3IP2DWBYTbW5IkmbXueemzn5oMHbEN7zLWJLtp2v3OjnmGE4D3T8KiI8OVFAI NB3WGwbgNGeX9M0XYTG12Qmp4WknWYHCws4iwyxj7jk89aD2uN6TfySwfOa4o9bQ0K dOh/0f+dtgv2daCF/Ss6E8LJS0/2rptpA8VHTSB8tx9BCwL8paOH0tZ3uZXX0B5bNU 669yXiHNOAHHjEu1y1hHBOG9eBEo3JEYNd+LxNj4p6jsiUCdtlPYT0gaEujWpqWvLA FX41d2vDdWkhnRmuKmdEatBMAqTaR+KebUmJ5YtSZLNVljhHmxWszLwnXDebD/vkzA GoG1uAeW7SgXA== Message-ID: Date: Fri, 17 Jan 2025 13:30:44 -0500 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: poudriere and the user ... is it mostly a lost idea? Content-Language: en-CA To: Mark Millard , FreeBSD Current References: From: Dennis Clarke Organization: GENUNIX In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-oetec-MailScanner-Information: Please contact the ISP for more information X-oetec-MailScanner-ID: 50HIUjgJ091090 X-oetec-MailScanner: Found to be clean X-oetec-MailScanner-From: dclarke@blastwave.org X-Spam-Status: No X-Spamd-Result: default: False [-2.97 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.97)[-0.970]; DMARC_POLICY_ALLOW_WITH_FAILURES(-0.50)[]; R_SPF_ALLOW(-0.20)[+mx]; RCVD_IN_DNSWL_MED(-0.20)[108.160.241.186:from]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; DMARC_POLICY_ALLOW(0.00)[blastwave.org,quarantine]; R_DKIM_REJECT(0.00)[blastwave.org:s=default]; RCPT_COUNT_TWO(0.00)[2]; FREEMAIL_TO(0.00)[yahoo.com,freebsd.org]; TO_DN_ALL(0.00)[]; ARC_NA(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; HAS_ORG_HEADER(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[blastwave.org:-]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:812, ipnet:108.160.240.0/20, country:CA]; MIME_TRACE(0.00)[0:+] X-Spamd-Bar: -- X-Rspamd-Queue-Id: 4YZSwY1Pkyz3hST On 1/15/25 21:20, Mark Millard wrote: > Dennis Clarke wrote on > Date: Wed, 15 Jan 2025 15:16:58 UTC : > >> Over the past month or so I see endless fails in builds for the big >> three user facing window manager things. This means that a simple user >> type person can not get a desktop. Really? Yes really. For at least a >> month or more you can not build KDE5 nor LXDE nor XFCE desktop. . . . > > Here you seem to have leaped from your context's bulk build > problems to most everyone else's bulk builds of similar > software having similar bulk build problems. > I apologize for the rant. Clearly a rant. Pure frustration as I try to do some testing of the big RELEASE stuff from 13.4 up to 15-CURRENT. It was a hand waving rant wherein I have seens build failures for weeks and weeks and it really feels like a hit or miss throw a dart good luck and spin the wheel maybe you are a winner today situation. > (Since Jan-7 I'm I'm temporarily without access to the FreeBSD > systems that I normally do. Also, I do not normally build those > specific ports. So I do not have evidence about those from my > own activities.) > I have plenty of logs. Piles of them. Perhaps the problem is that I am building on a 15-CURRENT machine which has poudriere jails like so : titan# poudriere jails -l JAILNAME VERSION ARCH METHOD TIMESTAMP PATH 134amd64 13.4-RELEASE-p2 1304000 3f40d5821eca amd64 git+https 2025-01-10 10:42:08 /poudriere/jails/134amd64 142amd64 14.2-RELEASE 1402000 c8918d6c7412 amd64 git+https 2024-12-03 12:50:29 /poudriere/jails/142amd64 140amd64 14.2-STABLE 1402501 e6de39be80e2 amd64 git+https 2025-01-13 21:36:43 /poudriere/jails/140amd64 150amd64 15.0-CURRENT 1500030 amd64 src=/usr/src 2025-01-12 07:44:29 /poudriere/jails/150amd64 titan# The one called 140stable is a bit strange given that I built it with the branch called "releng" for 14 and what I get is 14.2-STABLE. Whatever that is. I had the silly notion that something called "STABLE" is a good place to build packages. A stable is where one may keep horses. Maybe goats. Other than that I really do not know if building packages in that jail would be of any value compared to the 142amd64 jail. Who knows? I surely do not. I tend to kick off something like this : titan# ls -lApbtr /poudriere/data/packages/ total 60 drwxr-xr-x 3 root wheel 15 Jan 15 21:40 134amd64-latest/ drwxr-xr-x 3 root wheel 15 Jan 16 07:20 150amd64-2025Q1/ drwxr-xr-x 3 root wheel 15 Jan 16 07:23 140amd64-2025Q1/ drwxr-xr-x 3 root wheel 15 Jan 16 10:15 142amd64-latest/ drwxr-xr-x 3 root wheel 15 Jan 16 10:36 142amd64-2025Q1/ drwxr-xr-x 3 root wheel 15 Jan 16 14:00 150amd64-latest/ drwxr-xr-x 3 root wheel 15 Jan 16 14:09 134amd64-2025Q1/ titan# titan# /usr/bin/time -p idprio 0 poudriere bulk -r -j 140amd64 -p 2025Q1 -f /root/pkg.list [00:00:00] Creating the reference jail... done [00:00:00] Mounting system devices for 140amd64-2025Q1 [00:00:01] Stashing existing package repository [00:00:01] Mounting ccache from: /var/cache/ccache [00:00:01] Mounting ports from: /poudriere/ports/2025Q1 [00:00:01] Mounting packages from: /poudriere/data/packages/140amd64-2025Q1 [00:00:01] Mounting distfiles from: /poudriere/distfiles /etc/resolv.conf -> /poudriere/data/.m/140amd64-2025Q1/ref/etc/resolv.conf [00:00:01] Starting jail 140amd64-2025Q1 Updating /var/run/os-release done. [00:00:01] Will build as nobody:nobody (65534:65534) [00:00:01] Logs: /poudriere/data/logs/bulk/140amd64-2025Q1/2025-01-16_14h18m02s [00:00:01] Loading MOVED for /poudriere/data/.m/140amd64-2025Q1/ref/usr/ports [00:00:02] Ports supports: FLAVORS SUBPACKAGES SELECTED_OPTIONS [00:00:02] Inspecting ports tree for modifications to git checkout... no [00:00:03] Ports top-level git hash: 1bbe39c25 [00:00:03] Gathering ports metadata [00:00:08] Calculating ports order and dependencies [00:00:10] Trimming IGNORED and blacklisted ports [00:00:10] Sanity checking the repository [00:00:10] Checking packages for incremental rebuild needs [00:00:13] Deleting rsync-3.4.0.pkg: new version: 3.4.1 [00:00:14] Deleting mariadb1011-server-10.11.10_1.pkg: missing dependency: rsync-3.4.0 [00:00:14] Deleting mariadb114-server-11.4.4.pkg: missing dependency: rsync-3.4.0 [00:00:15] Deleting stale symlinks... done [00:00:15] Deleting empty directories... done [00:00:15] Unqueueing existing packages [00:00:16] Unqueueing orphaned build dependencies [00:00:16] Sanity checking build queue [00:00:16] Processing PRIORITY_BOOST [00:00:16] Balancing pool [140amd64-2025Q1] [2025-01-16_14h18m02s] [balancing_pool] Queued: 13 Built: 0 Failed: 0 Skipped: 0 Ignored: 0 Fetched: 0 Tobuild: 13 T ime: 00:00:15 [00:00:16] Recording filesystem state for prepkg... done [00:00:16] Building 13 packages using up to 13 builders [00:00:16] Hit CTRL+t at any time to see build progress and stats [00:00:16] [01] [00:00:00] Builder starting [00:00:16] [02] [00:00:00] Builder starting [00:00:16] [01] [00:00:00] Builder started [00:00:16] [01] [00:00:00] Building x11-toolkits/libwnck3 | libwnck3-3.36.0_2 [00:00:16] [02] [00:00:00] Builder started [00:00:16] [02] [00:00:00] Building net/rsync | rsync-3.4.1 [00:00:26] [02] [00:00:10] Finished net/rsync | rsync-3.4.1: Success [00:00:26] [02] [00:00:00] Building databases/mariadb114-server | mariadb114-server-11.4.4 [00:00:26] [03] [00:00:00] Builder starting [00:00:27] [03] [00:00:01] Builder started [00:00:27] [03] [00:00:00] Building databases/mariadb1011-server | mariadb1011-server-10.11.10_1 [00:00:36] [01] [00:00:20] Finished x11-toolkits/libwnck3 | libwnck3-3.36.0_2: Failed: build [00:00:36] [01] [00:00:20] Skipping x11/libxfce4windowing | libxfce4windowing-4.20.0: Dependent port x11-toolkits/libwnck3 | libwnck3-3.36.0 _2 failed [00:00:36] [01] [00:00:20] Skipping x11-fm/thunar | thunar-4.20.1: Dependent port x11-toolkits/libwnck3 | libwnck3-3.36.0_2 failed [00:00:36] [01] [00:00:20] Skipping x11-wm/xfce4 | xfce-4.20: Dependent port x11-toolkits/libwnck3 | libwnck3-3.36.0_2 failed [00:00:36] [01] [00:00:20] Skipping x11-wm/xfce4-desktop | xfce4-desktop-4.20.0: Dependent port x11-toolkits/libwnck3 | libwnck3-3.36.0_2 fa iled [00:00:36] [01] [00:00:20] Skipping deskutils/xfce4-notifyd | xfce4-notifyd-0.9.6_1: Dependent port x11-toolkits/libwnck3 | libwnck3-3.36.0_ 2 failed [00:00:36] [01] [00:00:20] Skipping x11-wm/xfce4-panel | xfce4-panel-4.20.0: Dependent port x11-toolkits/libwnck3 | libwnck3-3.36.0_2 failed [00:00:36] [01] [00:00:20] Skipping sysutils/xfce4-power-manager | xfce4-power-manager-4.20.0: Dependent port x11-toolkits/libwnck3 | libwnc k3-3.36.0_2 failed [00:00:36] [01] [00:00:20] Skipping x11-wm/xfce4-session | xfce4-session-4.20.0: Dependent port x11-toolkits/libwnck3 | libwnck3-3.36.0_2 fa iled [00:00:36] [01] [00:00:20] Skipping x11-wm/xfce4-wm | xfce4-wm-4.20.0: Dependent port x11-toolkits/libwnck3 | libwnck3-3.36.0_2 failed [00:02:51] [02] [00:02:25] Finished databases/mariadb114-server | mariadb114-server-11.4.4: Success [00:02:52] [03] [00:02:25] Finished databases/mariadb1011-server | mariadb1011-server-10.11.10_1: Success [00:02:53] Stopping 13 builders [00:02:54] Creating pkg repository Creating repository in /tmp/packages: 100% Packing files for repository: 100% [00:03:12] Committing packages to repository: /poudriere/data/packages/140amd64-2025Q1/.real_1737037274 via .latest symlink [00:03:12] Removing old packages [00:03:12] Built ports: net/rsync databases/mariadb114-server databases/mariadb1011-server [00:03:12] Failed ports: x11-toolkits/libwnck3:build [00:03:12] Skipped ports: deskutils/xfce4-notifyd sysutils/xfce4-power-manager x11-fm/thunar x11-wm/xfce4 x11-wm/xfce4-desktop x11-wm/xfce4- panel x11-wm/xfce4-session x11-wm/xfce4-wm x11/libxfce4windowing [140amd64-2025Q1] [2025-01-16_14h18m02s] [committing] Queued: 13 Built: 3 Failed: 1 Skipped: 9 Ignored: 0 Fetched: 0 Tobuild: 0 Time: 00:03:11 [00:03:12] Logs: /poudriere/data/logs/bulk/140amd64-2025Q1/2025-01-16_14h18m02s [00:03:12] Cleaning up [00:03:12] Unmounting file systems real 192.36 user 518.74 sys 219.50 titan# Then straight away after that : titan# /usr/bin/time -p idprio 0 poudriere bulk -r -j 140amd64 -p 2025Q1 -f /root/pkg.list [00:00:00] Updating portstree "2025Q1" with git+https... done [00:00:00] Creating the reference jail... done [00:00:00] Mounting system devices for 140amd64-2025Q1 [00:00:00] Stashing existing package repository [00:00:00] Mounting ccache from: /var/cache/ccache [00:00:00] Mounting ports from: /poudriere/ports/2025Q1 [00:00:00] Mounting packages from: /poudriere/data/packages/140amd64-2025Q1 [00:00:00] Mounting distfiles from: /poudriere/distfiles /etc/resolv.conf -> /poudriere/data/.m/140amd64-2025Q1/ref/etc/resolv.conf [00:00:00] Starting jail 140amd64-2025Q1 Updating /var/run/os-release done. [00:00:00] Will build as nobody:nobody (65534:65534) [00:00:00] Logs: /poudriere/data/logs/bulk/140amd64-2025Q1/2025-01-17_07h00m48s [00:00:00] Loading MOVED for /poudriere/data/.m/140amd64-2025Q1/ref/usr/ports [00:00:01] Ports supports: FLAVORS SUBPACKAGES SELECTED_OPTIONS [00:00:01] Inspecting ports tree for modifications to git checkout... no [00:00:02] Ports top-level git hash: ea08b2ed7 [00:00:02] Gathering ports metadata [00:00:07] Calculating ports order and dependencies [00:00:09] Trimming IGNORED and blacklisted ports [00:00:10] Sanity checking the repository [00:00:10] Checking packages for incremental rebuild needs [00:00:13] Deleting stale symlinks... done [00:00:13] Deleting empty directories... done [00:00:13] Unqueueing existing packages [00:00:14] Unqueueing orphaned build dependencies [00:00:14] Sanity checking build queue [00:00:14] Processing PRIORITY_BOOST [00:00:15] Balancing pool [140amd64-2025Q1] [2025-01-17_07h00m48s] [balancing_pool] Queued: 10 Built: 0 Failed: 0 Skipped: 0 Ignored: 0 Fetched: 0 Tobuild: 10 Time: 00:00:14 [00:00:15] Recording filesystem state for prepkg... done [00:00:15] Building 10 packages using up to 10 builders [00:00:15] Hit CTRL+t at any time to see build progress and stats [00:00:15] [01] [00:00:00] Builder starting [00:00:15] [01] [00:00:00] Builder started [00:00:15] [01] [00:00:00] Building x11-toolkits/libwnck3 | libwnck3-3.36.0_2 [00:00:33] [01] [00:00:18] Finished x11-toolkits/libwnck3 | libwnck3-3.36.0_2: Failed: build [00:00:33] [01] [00:00:18] Skipping x11/libxfce4windowing | libxfce4windowing-4.20.0: Dependent port x11-toolkits/libwnck3 | libwnck3-3.36.0_2 failed [00:00:33] [01] [00:00:18] Skipping x11-fm/thunar | thunar-4.20.1: Dependent port x11-toolkits/libwnck3 | libwnck3-3.36.0_2 failed [00:00:33] [01] [00:00:18] Skipping x11-wm/xfce4 | xfce-4.20: Dependent port x11-toolkits/libwnck3 | libwnck3-3.36.0_2 failed [00:00:33] [01] [00:00:18] Skipping x11-wm/xfce4-desktop | xfce4-desktop-4.20.0: Dependent port x11-toolkits/libwnck3 | libwnck3-3.36.0_2 failed [00:00:33] [01] [00:00:18] Skipping deskutils/xfce4-notifyd | xfce4-notifyd-0.9.6_1: Dependent port x11-toolkits/libwnck3 | libwnck3-3.36.0_2 failed [00:00:33] [01] [00:00:18] Skipping x11-wm/xfce4-panel | xfce4-panel-4.20.0: Dependent port x11-toolkits/libwnck3 | libwnck3-3.36.0_2 failed [00:00:33] [01] [00:00:18] Skipping sysutils/xfce4-power-manager | xfce4-power-manager-4.20.0: Dependent port x11-toolkits/libwnck3 | libwnck3-3.36.0_2 failed [00:00:33] [01] [00:00:18] Skipping x11-wm/xfce4-session | xfce4-session-4.20.0: Dependent port x11-toolkits/libwnck3 | libwnck3-3.36.0_2 failed [00:00:33] [01] [00:00:18] Skipping x11-wm/xfce4-wm | xfce4-wm-4.20.0: Dependent port x11-toolkits/libwnck3 | libwnck3-3.36.0_2 failed [00:00:33] Stopping 10 builders [00:00:33] Creating pkg repository Creating repository in /tmp/packages: 100% Packing files for repository: 100% [00:00:52] Committing packages to repository: /poudriere/data/packages/140amd64-2025Q1/.real_1737097300 via .latest symlink [00:00:52] Removing old packages [00:00:52] Failed ports: x11-toolkits/libwnck3:build [00:00:52] Skipped ports: deskutils/xfce4-notifyd sysutils/xfce4-power-manager x11-fm/thunar x11-wm/xfce4 x11-wm/xfce4-desktop x11-wm/xfce4-panel x11-wm/xfce4-session x11-wm/xfce4-wm x11/libxfce4windowing [140amd64-2025Q1] [2025-01-17_07h00m48s] [committing] Queued: 10 Built: 0 Failed: 1 Skipped: 9 Ignored: 0 Fetched: 0 Tobuild: 0 Time: 00:00:51 [00:00:52] Logs: /poudriere/data/logs/bulk/140amd64-2025Q1/2025-01-17_07h00m48s [00:00:52] Cleaning up [00:00:52] Unmounting file systems real 52.84 user 183.75 sys 123.83 titan# I see things like that ALL the time. Daily. >> . . . >> >> Why do I always see things like this : > > Just rhetorical? (See more later.) > Sort of. Yes. I think the specifics are just pine needles on the little trees in a big big forest. Some are going to be dead and fall away. Some will need a bit of trimming on some of the trees. That is the nature of the forest. However I have been looking at poudriere build failures for weeks. Right, it is the holidays and so I do not expect much and really should not. I don't. > > I've not seen anything presented that might allow someone to help > improve what happens in your context --or even to test if they can > specifically reproduce any of your builds' specific failures, not > even if they can match which ports blocked the potentially more > overall builds. > > The note reads more as an expression of furstation than anything > else, no attempt at getting help. Or, maybe, an attempt, in part, > to see how many "me too" responses show up. I was mostly dipping my toes in the water and waiting for the usual flames. I have been doing something or other related to software package stuff for a while now. I am not surprised when things go sideways a bit. I am, yes, frustrated when building the big three window manager bits and some database tools falls over. Daily. Weekly. > > The note was sent to freebsd-current. I'm not sure if I should > read someting into that or not. Well, not sure else what/where to do what? I figure a 15.0-CURRENT machine is what one would need to build with. Certainly for every reasonable version from 13.4 upwards. Just a guess but I think that is what would need. > > Nothing hints at the platform(s) used vs. not or that fail > vs. not. > > Prior to my FreeBSD use stopping on 2025-Jan-7, bulk builds that > I had done worked fine. But it is likely to be a rather different > workload vs. yours. Yep likely. I have a package list of stuff and it usually rounds out to a grand whopping 1500+ things. Never more than 1600. Not ever. > > Looking at the FreeBD package builders, I do see latest for > main armv7 having: > > x11/kde5 being blocked by libfido2-1.15.0 > x11-wm/xfce being blocked by vte3-0.70.2_5 > x11/xfce4-goodies being blocked by vte3-0.70.2_5 > x11/xfce4-terminal being blocked by vte3-0.70.2_5 Well, that is armv7? I am looking at AMD64 on a Xeon machine. More or less AMD64 or x86_64 depending on whose church we sit in. > > But I did not see LXDE being blocked. > > I did not see such blocks for amd64 or arm64. > > Where I do see all of KDE5, LXDE, and XFCE blocked > is by rust-1.81.0 in: > Funny. I have rust built on RISC-V : enceladus$ uname -apKU FreeBSD enceladus 15.0-CURRENT FreeBSD 15.0-CURRENT #2 main-n274434-2e09cef8dc6f: Sun Dec 29 05:26:22 GMT 2024 root@enceladus:/usr/obj/usr/src/riscv.riscv64/sys/SIFIVE-COMPAT11 riscv riscv64 1500029 1500029 enceladus$ enceladus$ rustc --version rustc 1.83.0 (90b35a623 2024-11-26) (built from a source tarball) enceladus$ However that is a wild red herring. Pay no attention to that. > But I've no clue if any of this matches your example > build failures. > I am thankful for the reply. I am curious. Given a hundred users of FreeBSD the question would be how many build stuff themselves? The numbers may be shockingly low. I have no idea. I am just guessing. -- -- Dennis Clarke RISC-V/SPARC/PPC/ARM/CISC UNIX and Linux spoken