Re: FreeBSD-main-amd64-test - Build #22804 - Still Unstable

These same 6 tests have been failing for a while now and are completely unrelated to my changes.  It looks like Jenkins is mailing committers on each build for these same 6 tests -- can these tests be disabled or fixed to stop the false positives?


On Tue, Jan 17, 2023 at 05:49:03AM +0000, jenkins-admin@FreeBSD.org wrote:
> FreeBSD-main-amd64-test - Build #22804 (f97a19ecb98541455c6c940f4bab2dc7dc425468) - Still Unstable
> 
> Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/22804/
> Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/22804/changes
> Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/22804/console
> 
> Status explanation:
> "Unstable" - some tests are suspected being broken by the following changes
> "Still Unstable" - the failing test cases have not been fixed by these
>                    following changes and this is a notification to note that
>                    these changes have not been fully tested by the CI system
> 
> Change summaries:
> (Those commits are likely but not certainly responsible)
> 
> 0694dcb04b81dfbd70ffe7384816863170a48b3e by gshapiro:
> Bring in fix from upstream that allows libsm to compile against FreeBSD
> 
> 28fbd2825d216dafca4d991ad96d05b312f4f9a3 by gshapiro:
> Import sendmail 8.17.1
> 
> d89513ed20502ddb320474a721d872ef32b31402 by gshapiro:
> Update for new library files in sendmail 8.17.1
> 
> 3413ee88c39dbfedfa7d00db536a8e8dc073a562 by gshapiro:
> Add -DSTARTTLS CFLAG in order to enable DANE in sendmail builds
> 
> f97a19ecb98541455c6c940f4bab2dc7dc425468 by gshapiro:
> sendmail 8.17.1 included this fix, though in a different location so
> 
> 
> 
> The failed test cases:
> 
> 6 tests failed.
> FAILED:  lib.libc.time.mktime_test.timegm_epoch
> 
> Error Message:
> /usr/src/contrib/netbsd-tests/lib/libc/time/t_mktime.c:98: Expected errno 0, got 84, in t == (time_t)0
> 
> FAILED:  sys.net.if_tun_test.235704
> 
> Error Message:
> atf-check failed; see the output of the test for details
> 
> FAILED:  usr.sbin.etcupdate.preworld_test.main
> 
> Error Message:
> Returned non-success exit status 1
> 
> FAILED:  sys.aio.aio_test.aio_socket_blocking_short_write
> 
> Error Message:
> Test case body timed out
> 
> FAILED:  sys.aio.aio_test.aio_socket_blocking_short_write_vectored
> 
> Error Message:
> Test case body timed out
> 
> FAILED:  sys.aio.aio_test.aio_socket_short_write_cancel
> 
> Error Message:
> /usr/src/tests/sys/aio/aio_test.c:1396: aio_error(&iocb) == EINPROGRESS not met