Re: armv7 (on aarch64) 13 GByte+ poudriere build logs (and growing) for devel/cargo-c and for devel/rust-cbindgen (build stage over 15 Hr each so far)

From: Mark Millard via freebsd-arm <freebsd-arm_at_freebsd.org>
Date: Sat, 11 Sep 2021 23:32:42 UTC
On 2021-Sep-11, at 15:48, Mark Millard <marklmi at @yahoo.com> wrote:
> 
> On 2021-Sep-11, at 15:17, Mark Millard <marklmi at yahoo.com> wrote:
> 
>> The following is from an on-going attempt at a poudreire bulk -a build targeting
>> armv7 on an aarch64 system (Cortext-A72's).
>> 
>> From ps -auxd :
>> 
>> root   32585  0.0  0.0   15540    6708  1  I    23:16       0:00.20 |             |-- sh: poudriere[main-CA7-default][15]: build_pkg (cargo-c-0.9.2_1) (sh)
>> root   58437  0.0  0.0   15540    6700  1  I    23:22       0:00.00 |             | `-- sh: poudriere[main-CA7-default][15]: build_pkg (cargo-c-0.9.2_1) (sh)
>> root   58440  0.0  0.0    6760    4232  1  IJ   23:22       0:00.15 |             |   `-- /usr/bin/make -C /usr/ports/devel/cargo-c build
>> root   58459 41.3  0.1  203760   80560  1  SJ   23:22     342:31.37 |             |     `-- /usr/local/bin/cargo build --manifest-path /wrkdirs/usr/ports/devel/cargo-c/work/cargo-c-0.9.2+cargo-0.55/C
>> root   61396  0.0  3.0 2078828 1995664  1  IJ   23:23      33:21.39 |             |       `-- /usr/local/bin/rustc --crate-name im_rc --edition=2018 /wrkdirs/usr/ports/devel/cargo-c/work/cargo-c-0.9.
>> 
>> # ls -Tld /usr/local/poudriere/data/logs/bulk/main-CA7-default/2021-09-10_17h13m49s/logs/cargo-c-0.9.2_1.log
>> -rw-r--r--  3 root  wheel  13355735461 Sep 11 14:35:46 2021 /usr/local/poudriere/data/logs/bulk/main-CA7-default/2021-09-10_17h13m49s/logs/cargo-c-0.9.2_1.log
>> 
>> thread 'rustc' panicked at 'capacity overflow', library/alloc/src/raw_vec.rs:560:5
>> stack backtrace:
>> note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
>> 
>> error: internal compiler error: unexpected panic
>> 
>> note: the compiler unexpectedly panicked. this is a bug.
>> 
>> note: we would appreciate a bug report: https://github.com/rust-lang/rust/issues/new?labels=C-bug%2C+I-ICE%2C+T-compiler&template=ice.md
>> 
>> note: rustc 1.54.0 running on armv7-unknown-freebsd
>> 
>> note: compiler flags: -C opt-level=2 -C embed-bitcode=no -C target-cpu=cortex-a7 -C linker=cc -C link-arg=-fstack-protector-strong --crate-type lib
>> 
>> note: some of the compiler flags provided by cargo are hidden
>> 
>> query stack during panic:
>> #0 [trimmed_def_paths] calculating trimmed def paths
>> #1 [lint_mod] linting module `vector`
>> #2 [analysis] running analysis passes on this crate
>> end of query stack
>> thread 'rustc' panicked at 'cannot panic during the backtrace function', library/std/src/../../backtrace/src/lib.rs:147:13
>> stack backtrace:
>>  0: 0x4704a088 - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::h62ff206af4f307a3
>>  1: 0x47113174 - core::fmt::write::h1cff52b8c9dac53e
>>  2: 0x47039e34 - <unknown>
>> 
>> . . .
>> 
>> 54: 0x41ec94e4 - <unknown>
>> 55: 0x4703fbd0 - <unknown>
>> 56: 0x401361bc - <unknown>
>> 57: 0x40135cd8 - pthread_create
>> 58: 0x40138b64 - pthread_peekjoin_np
>> 59: 0x40138b64 - pthread_peekjoin_np
>> 60: 0x40138b64 - pthread_peekjoin_np
>> 61: 0x40138b64 - pthread_peekjoin_np
>> . . .
>> 305514048: 0x40138b64 - pthread_peekjoin_np
>> 305514049: 0x40138b64 - pthread_peekjoin_np
>> 305514050: 0x40138b64 - pthread_peekjoin_np
>> 305514051: 0x40138b64 - pthread_peekjoin_np
>> 305514052: 0x40138b64 - pthread_peekjoin_np
>> 305514053: 0x40138b64 - pthread_peekjoin_np
>> 305514054: 0x40138b64 - pthread_peekjoin_np
>> 305514055: 0x40138b64 - pthread_peekjoin_np
>> . . .
>> 
>> 
>> root   84847   0.0  0.0   15540    6704  1  I    23:09       0:00.14 |             |-- sh: poudriere[main-CA7-default][16]: build_pkg (rust-cbindgen-0.20.0_1) (sh)
>> root     680   0.0  0.0   15540    6696  1  I    23:11       0:00.00 |             | `-- sh: poudriere[main-CA7-default][16]: build_pkg (rust-cbindgen-0.20.0_1) (sh)
>> root     683   0.0  0.0    6120    3512  1  IJ   23:11       0:00.08 |             |   `-- /usr/bin/make -C /usr/ports/devel/rust-cbindgen build
>> root     709  80.8  0.1  116812   54448  1  RJ   23:11     362:50.69 |             |     `-- /usr/local/bin/cargo build --manifest-path /wrkdirs/usr/ports/devel/rust-cbindgen/work/cbindgen-0.20.0/Car
>> root    1882  12.9  3.0 2045144 1970100  1  IJ   23:11      35:48.21 |             |       `-- /usr/local/bin/rustc --crate-name tempfile --edition=2018 /wrkdirs/usr/ports/devel/rust-cbindgen/work/cb
>> 
>> # ls -TldtL /usr/local/poudriere/data/logs/bulk/main-CA7-default/2021-09-10_17h13m49s/logs/rust-cbindgen-0.20.0_1.log
>> -rw-r--r--  3 root  wheel  13910063729 Sep 11 14:36:43 2021 /usr/local/poudriere/data/logs/bulk/main-CA7-default/2021-09-10_17h13m49s/logs/rust-cbindgen-0.20.0_1.log
>> 
>> thread 'rustc' panicked at 'capacity overflow', library/alloc/src/raw_vec.rs:560:5
>> stack backtrace:
>> note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
>> 
>> error: internal compiler error: unexpected panic
>> 
>> note: the compiler unexpectedly panicked. this is a bug.
>> 
>> note: we would appreciate a bug report: https://github.com/rust-lang/rust/issues/new?labels=C-bug%2C+I-ICE%2C+T-compiler&template=ice.md
>> 
>> note: rustc 1.54.0 running on armv7-unknown-freebsd
>> 
>> note: compiler flags: -C opt-level=2 -C embed-bitcode=no -C target-cpu=cortex-a7 -C linker=cc -C link-arg=-fstack-protector-strong --crate-type lib
>> 
>> note: some of the compiler flags provided by cargo are hidden
>> 
>> query stack during panic:
>> #0 [trimmed_def_paths] calculating trimmed def paths
>> #1 [lint_mod] linting module `file`
>> #2 [analysis] running analysis passes on this crate
>> end of query stack
>> thread 'rustc' panicked at 'cannot panic during the backtrace function', library/std/src/../../backtrace/src/lib.rs:147:13
>> stack backtrace:
>>  0: 0x4704a088 - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::h62ff206af4f307a3
>>  1: 0x47113174 - core::fmt::write::h1cff52b8c9dac53e
>>  2: 0x47039e34 - <unknown>
>>  3: 0x470443fc - <unknown>
>> . . .
>> 51: 0x4703fbd0 - <unknown>
>> 52: 0x401361bc - <unknown>
>> 53: 0x40135cd8 - pthread_create
>> 54: 0x40138b64 - pthread_peekjoin_np
>> 55: 0x40138b64 - pthread_peekjoin_np
>> 56: 0x40138b64 - pthread_peekjoin_np
>> 57: 0x40138b64 - pthread_peekjoin_np
>> 58: 0x40138b64 - pthread_peekjoin_np
>> . . .
>> 320127389: 0x40138b64 - pthread_peekjoin_np
>> 320127390: 0x40138b64 - pthread_peekjoin_np
>> 320127391: 0x40138b64 - pthread_peekjoin_np
>> 320127392: 0x40138b64 - pthread_peekjoin_np
>> 320127393: 0x40138b64 - pthread_peekjoin_np
>> 320127394: 0x40138b64 - pthread_peekjoin_np
>> 320127395: 0x40138b64 - pthread_peekjoin_np
>> . . .
>> 
>> For reference:
>> 
>> I have higer timeout figures set for poudriere than the
>> defaults.
>> 
>> I have since forced the two builders to stop by killing
>> processes.
>> 
>> I will be deleteing the log files because of their size.
>> 
>> The system is a HoneyComb (16 core Cortext-A72).
>> 
>> # uname -apKU
>> FreeBSD CA72_16Gp_ZFS 14.0-CURRENT FreeBSD 14.0-CURRENT #12 main-n249019-0637070b5bca-dirty: Tue Aug 31 02:24:20 PDT 2021     root@CA72_16Gp_ZFS:/usr/obj/BUILDs/main-CA72-nodbg-clang/usr/main-src/arm64.aarch64/sys/GENERIC-NODBG-CA72  arm64 aarch64 1400032 1400032
>> 
>> # poudriere jail -i -jmain-CA7
>> Jail name:         main-CA7
>> Jail version:      14.0-CURRENT
>> Jail arch:         arm.armv7
>> Jail method:       null
>> Jail mount:        /usr/obj/DESTDIRs/main-CA7-poud
>> Jail fs:           
>> Jail updated:      2021-06-27 17:58:33
>> Jail pkgbase:      disabled
>> 
>> # cd /usr/ports/
>> # ~/fbsd-based-on-what-commit.sh 
>> branch: main
>> merge-base: b0c4eaac2a3aa9bc422c21b9d398e4dbfea18736
>> merge-base: CommitDate: 2021-09-07 21:55:24 +0000
>> b0c4eaac2a3a (HEAD -> main, freebsd/main, freebsd/HEAD) security/suricata: Add patch for upstream locking fix
>> n557269 (--first-parent --count for merge-base)
>> 
>> There are other ports that fail to build in various ways,
>> but so far these two have the only system-wide nasty
>> consequences for their failure mode.
>> 
> 
> Another one: sysutils/potnet
> 
> # ls -Tld /usr/local/poudriere/data/logs/bulk/main-CA7-default/2021-09-10_17h13m49s/logs/potnet-0.4.4_14.log 
> -rw-r--r--  3 root  wheel  8463393229 Sep 11 15:39:44 2021 /usr/local/poudriere/data/logs/bulk/main-CA7-default/2021-09-10_17h13m49s/logs/potnet-0.4.4_14.log
> 
> thread 'rustc' panicked at 'capacity overflow', library/alloc/src/raw_vec.rs:560:5
> stack backtrace:
> note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
> 
> error: internal compiler error: unexpected panic
> 
> note: the compiler unexpectedly panicked. this is a bug.
> 
> note: we would appreciate a bug report: https://github.com/rust-lang/rust/issues/new?labels=C-bug%2C+I-ICE%2C+T-compiler&template=ice.md
> 
> note: rustc 1.54.0 running on armv7-unknown-freebsd
> 
> note: compiler flags: -C embed-bitcode=no -C debug-assertions=off -C target-cpu=cortex-a7 -C linker=cc -C link-arg=-fstack-protector-strong --crate-type lib
> 
> note: some of the compiler flags provided by cargo are hidden
> 
> query stack during panic:
> #0 [trimmed_def_paths] calculating trimmed def paths
> #1 [typeck] type-checking `<impl at /wrkdirs/usr/ports/sysutils/potnet/work/potnet-0.4.4/cargo-crates/error-chain-0.12.1/src/lib.rs:638:1: 655:2>::fmt`
> #2 [typeck_item_bodies] type-checking all item bodies
> #3 [analysis] running analysis passes on this crate
> end of query stack
> thread 'rustc' panicked at 'cannot panic during the backtrace function', library/std/src/../../backtrace/src/lib.rs:147:13
> stack backtrace:
>   0: 0x4704a088 - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::h62ff206af4f307a3
>   1: 0x47113174 - core::fmt::write::h1cff52b8c9dac53e
>   2: 0x47039e34 - <unknown>
>   3: 0x470443fc - <unknown>  65: 0x401361bc - <unknown>
> . . .
>  66: 0x40135cd8 - pthread_create
>  67: 0x40138b64 - pthread_peekjoin_np
>  68: 0x40138b64 - pthread_peekjoin_np
> . . .
> 196328992: 0x40138b64 - pthread_peekjoin_np
> 196328993: 0x40138b64 - pthread_peekjoin_np
> 196328994: 0x40138b64 - pthread_peekjoin_np
> 196328995: 0x40138b64 - pthread_peekjoin_np
> 196328996: 0x40138b64 - pthread_peekjoin_np
> . . .
> 

More ports that have builds that use what is failing:

net-im/libsignal-client
textproc/mdbook

It may be that the poudriere bulk -a attempt requires more
hand manipulation than I'll be willing to put in.

===
Mark Millard
marklmi at yahoo.com
( dsl-only.net went
away in early 2018-Mar)