From nobody Wed Jan 29 16:19:56 2025 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4YjnS22yKKz5lVX6; Wed, 29 Jan 2025 16:20:02 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-io1-xd2c.google.com (mail-io1-xd2c.google.com [IPv6:2607:f8b0:4864:20::d2c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4YjnS14yTJz3g5R; Wed, 29 Jan 2025 16:20:01 +0000 (UTC) (envelope-from markjdb@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-io1-xd2c.google.com with SMTP id ca18e2360f4ac-844eac51429so537999539f.2; Wed, 29 Jan 2025 08:20:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1738167601; x=1738772401; darn=freebsd.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:sender:from:to:cc:subject:date:message-id :reply-to; bh=/kGQZrH8Upv6hR0bfSH4wv2rmA2CCppqDwEvrWtS34g=; b=XyRgeUXPYmEb6v4+W1jf9T5jkO77PnM4xX4RpQPoUaK5tTHFaTm2uG80xLFbDil+Ab MCEwDrGLUCtSQRuzXHEr4h0PBNSEWfpT8F8TqnBGJcqJIwrWqMAe01YyKbNw3TFuwHfL R2KdUuENWkrPBUhom1mRNVaT6A+taY2npmtXD0m/pMHk9Db8nW2ml96T3M0NBoDJdGbN qabgyM1TB7khp8VmPgn4Yvav2VtbLDQG4hBz7fQh661o0/rZmyT7UEAWB0FMW5Yhq1Qc SdGt7UxIS/kNRJyloW38y+gPYAoIARytEOWF4EW5iUvZwOI59VLmiE0VxeN54lojZyQT 6kZQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1738167601; x=1738772401; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:sender:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=/kGQZrH8Upv6hR0bfSH4wv2rmA2CCppqDwEvrWtS34g=; b=UJNuymUg0Yh/jIKN9RpmutLbq7PZJQb1YPivuMdXCInneefSlB8O2YQD8sWQYr8a5+ n1VRcubgbCOfocanZ0ZDhVBZdo2AzaRKdjtui+ms+QbXo7qdqTmJK0VfAD90G97Rfqgt jrNFObxOlBHSwNV+U3f/uukiE/w1ipH14LhT3vmIQiUVl3QeFovbBybSgiryQl76QbxL biQp8Pt1OL0KW5jdp+EYi6cIbystbJBreeY7dYtE5Hvullx6gGOiFZbOCiFc2Z71KvUQ qSkezJiaYcEzjyCPhOeEmyWzhL4XZIP6TAdxA/YEA5Dd94TU0/MZ3eyhjw91edVMorS6 DBfQ== X-Forwarded-Encrypted: i=1; AJvYcCVFJZd259MZkbbq/eh+7fqf4+lSwaNgtf39OXHkQx15UsbFkzmqcLkN1w+rY3SW8yFGV11VIeF6@freebsd.org, AJvYcCVsDu1JRI92doxDGAyAEbDk5YTyjPvfHcH3DzpJD0teCF/Eq5mzdLxuZAwG0yMtJA1EsRwMp4UTHA==@freebsd.org, AJvYcCW1lP1GYLX6DSXTAOWA2m0gpR1kIGHcEyvofcL5osiuOp8K6U9C25zuPIoq+TUrX5x8Ev3QwAU=@freebsd.org, AJvYcCXCYpewecWwvLca5DiLRK5+T4uHlPfbuc8fTRleOeAzoNmI6GJJLdt6KLYsVEmAtXgUnhLE4d+S@freebsd.org X-Gm-Message-State: AOJu0Yx2haV3waeZKoDmatsS2C3V4GwfNFbOfSUGQcAoqJ9U0d8OMgaJ d9BR6lprTRO+ZuGV7hw9s1m4ushKfylqcV1fo4oz6AtiWpSuO5HlvEwI6g== X-Gm-Gg: ASbGnctxKUiA0nn5D66X3zgM5JrWpslUC7Gl4oehGjccipXPwblc/xTdKq+NDfU2Q+y u+HDs+/sdkKlOSpT5LBhL1bb/Okn2Mg2QL3MwBRocx/NoY+UxhXr1qRHOvAvrVcOaLCAlVlq38x Fig6piEwm+D+9UUhgu83P5rjR4Iz51q6K/lbNCSl8O5gZMdtg6u7AbWFiKbZD1tkZh3IcTjTwHO GxLfNjngRN76aVQMbGC2eQRxbOQsYhXQscYrGZe0t1QQo6PHhB5Z7fIH649jL+ym4vRGTXxzyi2 yZKriCBe1/UlCLxDLxjgNdd0SUF+LQ== X-Google-Smtp-Source: AGHT+IGzjsk8bLZ8La0NiL4eX1tnDzPskOXzDrWExgTjsjUfUU8ErpLubbFFvFc2KOYbMgQCHZXz3w== X-Received: by 2002:a05:6602:360d:b0:83a:b500:3513 with SMTP id ca18e2360f4ac-85427e400cbmr371860339f.8.1738167600675; Wed, 29 Jan 2025 08:20:00 -0800 (PST) Received: from nuc (192-0-220-237.cpe.teksavvy.com. [192.0.220.237]) by smtp.gmail.com with ESMTPSA id ca18e2360f4ac-8521dde9f65sm401182439f.5.2025.01.29.08.19.58 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 29 Jan 2025 08:19:59 -0800 (PST) Date: Wed, 29 Jan 2025 11:19:56 -0500 From: Mark Johnston To: Konstantin Belousov Cc: jenkins-admin@freebsd.org, dev-ci@freebsd.org, current@freebsd.org, emaste@freebsd.org, brooks@freebsd.org Subject: Re: FreeBSD-main-amd64-test - Build #25976 - Still unstable Message-ID: References: <836411994.1827.1738118680596@jenkins.ci.freebsd.org> <1216833277.1845.1738128576212@jenkins.ci.freebsd.org> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4YjnS14yTJz3g5R X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] On Wed, Jan 29, 2025 at 05:16:50PM +0200, Konstantin Belousov wrote: > On Wed, Jan 29, 2025 at 05:29:35AM +0000, jenkins-admin@FreeBSD.org wrote: > > FreeBSD-main-amd64-test - Build #25976 (4da070ce6c015a994ec4ecf3d31ee94810ea19f1) - Still unstable > > > > Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/25976/ > > Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/25976/changes > > Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/25976/console > > > > Status explanation: > > "Unstable" - some tests are suspected being broken by the following changes > > "Still Unstable" - the failing test cases have not been fixed by these > > following changes and this is a notification to note that > > these changes have not been fully tested by the CI system > > > > Change summaries: > > (Those commits are likely but not certainly responsible) > > > > 6ee34bca48a9e0867d46b24a78855e225d46ddda by kib: > > crtbegin: accurately check for the end of .dtors > > > > 21502f9a926c7e0c24ce230bb029fde4bf570a14 by kib: > > crtend: accurately check for the start of .ctors > > > > 51688136b161089b317edc34c3a3e9b40d54a18a by markj: > > libdtrace: Use designators to initialize the opcode array > > > > 70c067062217a5295ed321427b91cfd857c18b77 by markj: > > dtrace/arm64: Simplify dtrace_getarg() slightly > > > > 4da070ce6c015a994ec4ecf3d31ee94810ea19f1 by markj: > > dtrace/arm64: Fix enumeration of FBT return probes > > > > > > > > The failed test cases: > > > > 4 tests failed. > > FAILED: lib.csu.dynamiclib.cxx_constructors.__test_cases_list__ > > > > Error Message: > > Test program did not exit cleanly > > > > FAILED: lib.csu.dynamiclib.fini_test.__test_cases_list__ > > > > Error Message: > > Test program did not exit cleanly > > > > FAILED: lib.csu.dynamiclib.init_test.__test_cases_list__ > > > > Error Message: > > Test program did not exit cleanly > > Could anybody explain what does break there? > I run the 'kyua test -k /usr/tests/lib/csu/Kyuafile' command locally after > my recent changes to lib/csu/crtbegin/end.c, and it succeeds. > > I believe I saw the sporadic mails with the similar failures before. The logs from the test suite run are useless, and I cannot reproduce the problem locally either. I just remembered that one can fetch the test VM images from artifact.ci.freebsd.org. So, I tried that. The problem is that /usr/tests/lib/csu/dynamiclib/libh_csu.so is missing, and the test programs under /usr/tests/lib/csu/dynamiclib link against it, so they refuse to start. It looks like the CI scripts build the VM image using artifacts from "make packagesystem", which I'm unfamiliar with. It looks like the tests.txz snapshots are also missing libh_csu.so, so this is some bug in the release scripts and/or the csu test makefiles. The failures apparently started with commit 41adc5f29ba6955e09f46e4d2c25da6fcd263ba2, so maybe Ed or Brooks have some idea where the problem is.