Re: armv7 (on aarch64) 13 GByte+ poudriere build logs (and growing) for devel/cargo-c and for devel/rust-cbindgen (build stage over 15 Hr each so far)

Go to: [ bottom of page ] [ top of archives ] [ this month ]
From: Robert Clausecker <fuz_at_fuz.su>
Date: Sat, 11 Sep 2021 23:43:55 UTC
Hi Mark,

Please read the relevant PR.  I have enumerated all ports that fail with this
kind of error by painstakingly compiling them all and watching the logs for
unexpected growth.  No need to do it again.

Yours,
Robert Clausecker

Am Sat, Sep 11, 2021 at 04:32:42PM -0700 schrieb Mark Millard via freebsd-arm:
> On 2021-Sep-11, at 15:48, Mark Millard <marklmi at @yahoo.com> wrote:
> > 
> > On 2021-Sep-11, at 15:17, Mark Millard <marklmi at yahoo.com> wrote:
> > 
> >> The following is from an on-going attempt at a poudreire bulk -a build targeting
> >> armv7 on an aarch64 system (Cortext-A72's).
> >> 
> >> From ps -auxd :
> >> 
> >> root   32585  0.0  0.0   15540    6708  1  I    23:16       0:00.20 |             |-- sh: poudriere[main-CA7-default][15]: build_pkg (cargo-c-0.9.2_1) (sh)
> >> root   58437  0.0  0.0   15540    6700  1  I    23:22       0:00.00 |             | `-- sh: poudriere[main-CA7-default][15]: build_pkg (cargo-c-0.9.2_1) (sh)
> >> root   58440  0.0  0.0    6760    4232  1  IJ   23:22       0:00.15 |             |   `-- /usr/bin/make -C /usr/ports/devel/cargo-c build
> >> root   58459 41.3  0.1  203760   80560  1  SJ   23:22     342:31.37 |             |     `-- /usr/local/bin/cargo build --manifest-path /wrkdirs/usr/ports/devel/cargo-c/work/cargo-c-0.9.2+cargo-0.55/C
> >> root   61396  0.0  3.0 2078828 1995664  1  IJ   23:23      33:21.39 |             |       `-- /usr/local/bin/rustc --crate-name im_rc --edition=2018 /wrkdirs/usr/ports/devel/cargo-c/work/cargo-c-0.9.
> >> 
> >> # ls -Tld /usr/local/poudriere/data/logs/bulk/main-CA7-default/2021-09-10_17h13m49s/logs/cargo-c-0.9.2_1.log
> >> -rw-r--r--  3 root  wheel  13355735461 Sep 11 14:35:46 2021 /usr/local/poudriere/data/logs/bulk/main-CA7-default/2021-09-10_17h13m49s/logs/cargo-c-0.9.2_1.log
> >> 
> >> thread 'rustc' panicked at 'capacity overflow', library/alloc/src/raw_vec.rs:560:5
> >> stack backtrace:
> >> note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
> >> 
> >> error: internal compiler error: unexpected panic
> >> 
> >> note: the compiler unexpectedly panicked. this is a bug.
> >> 
> >> note: we would appreciate a bug report: https://github.com/rust-lang/rust/issues/new?labels=C-bug%2C+I-ICE%2C+T-compiler&template=ice.md
> >> 
> >> note: rustc 1.54.0 running on armv7-unknown-freebsd
> >> 
> >> note: compiler flags: -C opt-level=2 -C embed-bitcode=no -C target-cpu=cortex-a7 -C linker=cc -C link-arg=-fstack-protector-strong --crate-type lib
> >> 
> >> note: some of the compiler flags provided by cargo are hidden
> >> 
> >> query stack during panic:
> >> #0 [trimmed_def_paths] calculating trimmed def paths
> >> #1 [lint_mod] linting module `vector`
> >> #2 [analysis] running analysis passes on this crate
> >> end of query stack
> >> thread 'rustc' panicked at 'cannot panic during the backtrace function', library/std/src/../../backtrace/src/lib.rs:147:13
> >> stack backtrace:
> >>  0: 0x4704a088 - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::h62ff206af4f307a3
> >>  1: 0x47113174 - core::fmt::write::h1cff52b8c9dac53e
> >>  2: 0x47039e34 - <unknown>
> >> 
> >> . . .
> >> 
> >> 54: 0x41ec94e4 - <unknown>
> >> 55: 0x4703fbd0 - <unknown>
> >> 56: 0x401361bc - <unknown>
> >> 57: 0x40135cd8 - pthread_create
> >> 58: 0x40138b64 - pthread_peekjoin_np
> >> 59: 0x40138b64 - pthread_peekjoin_np
> >> 60: 0x40138b64 - pthread_peekjoin_np
> >> 61: 0x40138b64 - pthread_peekjoin_np
> >> . . .
> >> 305514048: 0x40138b64 - pthread_peekjoin_np
> >> 305514049: 0x40138b64 - pthread_peekjoin_np
> >> 305514050: 0x40138b64 - pthread_peekjoin_np
> >> 305514051: 0x40138b64 - pthread_peekjoin_np
> >> 305514052: 0x40138b64 - pthread_peekjoin_np
> >> 305514053: 0x40138b64 - pthread_peekjoin_np
> >> 305514054: 0x40138b64 - pthread_peekjoin_np
> >> 305514055: 0x40138b64 - pthread_peekjoin_np
> >> . . .
> >> 
> >> 
> >> root   84847   0.0  0.0   15540    6704  1  I    23:09       0:00.14 |             |-- sh: poudriere[main-CA7-default][16]: build_pkg (rust-cbindgen-0.20.0_1) (sh)
> >> root     680   0.0  0.0   15540    6696  1  I    23:11       0:00.00 |             | `-- sh: poudriere[main-CA7-default][16]: build_pkg (rust-cbindgen-0.20.0_1) (sh)
> >> root     683   0.0  0.0    6120    3512  1  IJ   23:11       0:00.08 |             |   `-- /usr/bin/make -C /usr/ports/devel/rust-cbindgen build
> >> root     709  80.8  0.1  116812   54448  1  RJ   23:11     362:50.69 |             |     `-- /usr/local/bin/cargo build --manifest-path /wrkdirs/usr/ports/devel/rust-cbindgen/work/cbindgen-0.20.0/Car
> >> root    1882  12.9  3.0 2045144 1970100  1  IJ   23:11      35:48.21 |             |       `-- /usr/local/bin/rustc --crate-name tempfile --edition=2018 /wrkdirs/usr/ports/devel/rust-cbindgen/work/cb
> >> 
> >> # ls -TldtL /usr/local/poudriere/data/logs/bulk/main-CA7-default/2021-09-10_17h13m49s/logs/rust-cbindgen-0.20.0_1.log
> >> -rw-r--r--  3 root  wheel  13910063729 Sep 11 14:36:43 2021 /usr/local/poudriere/data/logs/bulk/main-CA7-default/2021-09-10_17h13m49s/logs/rust-cbindgen-0.20.0_1.log
> >> 
> >> thread 'rustc' panicked at 'capacity overflow', library/alloc/src/raw_vec.rs:560:5
> >> stack backtrace:
> >> note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
> >> 
> >> error: internal compiler error: unexpected panic
> >> 
> >> note: the compiler unexpectedly panicked. this is a bug.
> >> 
> >> note: we would appreciate a bug report: https://github.com/rust-lang/rust/issues/new?labels=C-bug%2C+I-ICE%2C+T-compiler&template=ice.md
> >> 
> >> note: rustc 1.54.0 running on armv7-unknown-freebsd
> >> 
> >> note: compiler flags: -C opt-level=2 -C embed-bitcode=no -C target-cpu=cortex-a7 -C linker=cc -C link-arg=-fstack-protector-strong --crate-type lib
> >> 
> >> note: some of the compiler flags provided by cargo are hidden
> >> 
> >> query stack during panic:
> >> #0 [trimmed_def_paths] calculating trimmed def paths
> >> #1 [lint_mod] linting module `file`
> >> #2 [analysis] running analysis passes on this crate
> >> end of query stack
> >> thread 'rustc' panicked at 'cannot panic during the backtrace function', library/std/src/../../backtrace/src/lib.rs:147:13
> >> stack backtrace:
> >>  0: 0x4704a088 - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::h62ff206af4f307a3
> >>  1: 0x47113174 - core::fmt::write::h1cff52b8c9dac53e
> >>  2: 0x47039e34 - <unknown>
> >>  3: 0x470443fc - <unknown>
> >> . . .
> >> 51: 0x4703fbd0 - <unknown>
> >> 52: 0x401361bc - <unknown>
> >> 53: 0x40135cd8 - pthread_create
> >> 54: 0x40138b64 - pthread_peekjoin_np
> >> 55: 0x40138b64 - pthread_peekjoin_np
> >> 56: 0x40138b64 - pthread_peekjoin_np
> >> 57: 0x40138b64 - pthread_peekjoin_np
> >> 58: 0x40138b64 - pthread_peekjoin_np
> >> . . .
> >> 320127389: 0x40138b64 - pthread_peekjoin_np
> >> 320127390: 0x40138b64 - pthread_peekjoin_np
> >> 320127391: 0x40138b64 - pthread_peekjoin_np
> >> 320127392: 0x40138b64 - pthread_peekjoin_np
> >> 320127393: 0x40138b64 - pthread_peekjoin_np
> >> 320127394: 0x40138b64 - pthread_peekjoin_np
> >> 320127395: 0x40138b64 - pthread_peekjoin_np
> >> . . .
> >> 
> >> For reference:
> >> 
> >> I have higer timeout figures set for poudriere than the
> >> defaults.
> >> 
> >> I have since forced the two builders to stop by killing
> >> processes.
> >> 
> >> I will be deleteing the log files because of their size.
> >> 
> >> The system is a HoneyComb (16 core Cortext-A72).
> >> 
> >> # uname -apKU
> >> FreeBSD CA72_16Gp_ZFS 14.0-CURRENT FreeBSD 14.0-CURRENT #12 main-n249019-0637070b5bca-dirty: Tue Aug 31 02:24:20 PDT 2021     root@CA72_16Gp_ZFS:/usr/obj/BUILDs/main-CA72-nodbg-clang/usr/main-src/arm64.aarch64/sys/GENERIC-NODBG-CA72  arm64 aarch64 1400032 1400032
> >> 
> >> # poudriere jail -i -jmain-CA7
> >> Jail name:         main-CA7
> >> Jail version:      14.0-CURRENT
> >> Jail arch:         arm.armv7
> >> Jail method:       null
> >> Jail mount:        /usr/obj/DESTDIRs/main-CA7-poud
> >> Jail fs:           
> >> Jail updated:      2021-06-27 17:58:33
> >> Jail pkgbase:      disabled
> >> 
> >> # cd /usr/ports/
> >> # ~/fbsd-based-on-what-commit.sh 
> >> branch: main
> >> merge-base: b0c4eaac2a3aa9bc422c21b9d398e4dbfea18736
> >> merge-base: CommitDate: 2021-09-07 21:55:24 +0000
> >> b0c4eaac2a3a (HEAD -> main, freebsd/main, freebsd/HEAD) security/suricata: Add patch for upstream locking fix
> >> n557269 (--first-parent --count for merge-base)
> >> 
> >> There are other ports that fail to build in various ways,
> >> but so far these two have the only system-wide nasty
> >> consequences for their failure mode.
> >> 
> > 
> > Another one: sysutils/potnet
> > 
> > # ls -Tld /usr/local/poudriere/data/logs/bulk/main-CA7-default/2021-09-10_17h13m49s/logs/potnet-0.4.4_14.log 
> > -rw-r--r--  3 root  wheel  8463393229 Sep 11 15:39:44 2021 /usr/local/poudriere/data/logs/bulk/main-CA7-default/2021-09-10_17h13m49s/logs/potnet-0.4.4_14.log
> > 
> > thread 'rustc' panicked at 'capacity overflow', library/alloc/src/raw_vec.rs:560:5
> > stack backtrace:
> > note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
> > 
> > error: internal compiler error: unexpected panic
> > 
> > note: the compiler unexpectedly panicked. this is a bug.
> > 
> > note: we would appreciate a bug report: https://github.com/rust-lang/rust/issues/new?labels=C-bug%2C+I-ICE%2C+T-compiler&template=ice.md
> > 
> > note: rustc 1.54.0 running on armv7-unknown-freebsd
> > 
> > note: compiler flags: -C embed-bitcode=no -C debug-assertions=off -C target-cpu=cortex-a7 -C linker=cc -C link-arg=-fstack-protector-strong --crate-type lib
> > 
> > note: some of the compiler flags provided by cargo are hidden
> > 
> > query stack during panic:
> > #0 [trimmed_def_paths] calculating trimmed def paths
> > #1 [typeck] type-checking `<impl at /wrkdirs/usr/ports/sysutils/potnet/work/potnet-0.4.4/cargo-crates/error-chain-0.12.1/src/lib.rs:638:1: 655:2>::fmt`
> > #2 [typeck_item_bodies] type-checking all item bodies
> > #3 [analysis] running analysis passes on this crate
> > end of query stack
> > thread 'rustc' panicked at 'cannot panic during the backtrace function', library/std/src/../../backtrace/src/lib.rs:147:13
> > stack backtrace:
> >   0: 0x4704a088 - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::h62ff206af4f307a3
> >   1: 0x47113174 - core::fmt::write::h1cff52b8c9dac53e
> >   2: 0x47039e34 - <unknown>
> >   3: 0x470443fc - <unknown>  65: 0x401361bc - <unknown>
> > . . .
> >  66: 0x40135cd8 - pthread_create
> >  67: 0x40138b64 - pthread_peekjoin_np
> >  68: 0x40138b64 - pthread_peekjoin_np
> > . . .
> > 196328992: 0x40138b64 - pthread_peekjoin_np
> > 196328993: 0x40138b64 - pthread_peekjoin_np
> > 196328994: 0x40138b64 - pthread_peekjoin_np
> > 196328995: 0x40138b64 - pthread_peekjoin_np
> > 196328996: 0x40138b64 - pthread_peekjoin_np
> > . . .
> > 
> 
> More ports that have builds that use what is failing:
> 
> net-im/libsignal-client
> textproc/mdbook
> 
> It may be that the poudriere bulk -a attempt requires more
> hand manipulation than I'll be willing to put in.
> 
> ===
> Mark Millard
> marklmi at yahoo.com
> ( dsl-only.net went
> away in early 2018-Mar)
> 
> 
> 

-- 
()  ascii ribbon campaign - for an 8-bit clean world 
/\  - against html email  - against proprietary attachments