From nobody Thu Oct 07 21:14:48 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 339A312BD2EC for ; Thu, 7 Oct 2021 21:15:07 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-lf1-f52.google.com (mail-lf1-f52.google.com [209.85.167.52]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4HQPGz0pG9z53rk; Thu, 7 Oct 2021 21:15:07 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: by mail-lf1-f52.google.com with SMTP id x27so30476562lfu.5; Thu, 07 Oct 2021 14:15:07 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=801Lpop6JQJpdIQnn2AfvSvNyfNLM7W4tnz15tP2K+A=; b=Wns5/TmWMYGVVJ3/AqTfonf5AiymFlEZmFYim8+aseDgxF6DAbiL4+km9Gzez6SNoS QD+jn3HWumuNDkQ1bVcSY1h0fg3bqJHNyQmp4yIO+BTowZNbrBlAlKaX2g7nIoHb8vf1 6lkAU+4yth36P4MrzENAmvB9U4FmGO76mr0a9RAwoPdrFlveO3EHZfAdWBa5kmcZpAcb Ywk/nLDoQYoqkAax7NABMBaX6qYo2nAhaz+IGWhQKJHPq+b0Hs7O09Re3nS3yOVVQ9QA xAfrJC6v0x6N8nPtc1GC6tAjdsXK1s1mKNdVXxqm6Ez0WLldIH4vTAyUnkfcBIA1P0/1 3h1A== X-Gm-Message-State: AOAM530jvte3GkcHsUDOrQbbQlxCtMYNv0CS8lttq02/Wos21BBfLT9u brBXtb+GtKz0VtLcUZfzXf1Er4KaN1wJAjKRtBc= X-Google-Smtp-Source: ABdhPJx5tVLvBsN67yyBLifIK0qcVaZI86w6t9OeEjcbtv341jBUQSnsAtsmIWfweuaTQkXKECQHq1fZO6aGYCzvYyM= X-Received: by 2002:a2e:3c04:: with SMTP id j4mr7237005lja.271.1633641299776; Thu, 07 Oct 2021 14:14:59 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 References: <2908d747-8606-84d6-60b5-249c0d396b6b@protected-networks.net> <31be6e3a-f303-ce78-4dab-5dcc77ed0464@protected-networks.net> In-Reply-To: From: Mark Johnston Date: Thu, 7 Oct 2021 17:14:48 -0400 Message-ID: Subject: Re: intermittent bsdtar/jemalloc failures To: Konstantin Belousov Cc: Mark Johnston , Michael Butler , freebsd-current Content-Type: multipart/alternative; boundary="0000000000005d179005cdc9c195" X-Rspamd-Queue-Id: 4HQPGz0pG9z53rk X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: Y --0000000000005d179005cdc9c195 Content-Type: text/plain; charset="UTF-8" On Thu., Oct. 7, 2021, 17:11 Konstantin Belousov, wrote: > On Thu, Oct 07, 2021 at 04:52:52PM -0400, Mark Johnston wrote: > > On Thu, Oct 07, 2021 at 04:18:28PM -0400, Michael Butler via > freebsd-current wrote: > > > On 10/7/21 15:39, Konstantin Belousov wrote: > > > > On Thu, Oct 07, 2021 at 03:28:44PM -0400, Michael Butler via > freebsd-current wrote: > > > >> While building a local release bundle, I sometimes get bsdtar > failing (and > > > >> dumping core) as follows below. Worse, as can be seen below, it > doesn't stop > > > >> the build unless I happen to notice and it yields an incomplete > package. > > > >> > > > >> a usr/src/sys/netgraph/ng_checksum.h > > > >> a usr/src/sys/netgraph/ng_message.h > > > >> a usr/src/sys/netgraph/ng_echo.c > > > >> a usr/src/sys/netgraph/ng_gif.h > > > >> : jemalloc_arena.c:747: Failed assertion: > > > >> "nstime_compare(&decay->epoch, &time) <= 0" > > > >> Abort trap (core dumped) > > > >> sh /usr/src/release/scripts/make-manifest.sh *.txz > MANIFEST > > > >> > > > >> What causes this? Build machine is a 2x4-core Intel box with ZFS > > > >> file-systems all around. I tried stopping NTPD temporarily but the > failures > > > >> persist .. sometimes :-( > > > >> > > > >> I've seen this at different points in the archiving process so it > doesn't > > > >> seem specific to building kernel.txz. > > > > > > > > What timecounter do you use? Perhaps show the whole output from > > > > sysctl kern.timecounter. > > > > > > imb@vm01:/home/imb> sysctl kern.timecounter > > > kern.timecounter.tsc_shift: 1 > > > kern.timecounter.smp_tsc_adjust: 0 > > > kern.timecounter.smp_tsc: 1 > > > kern.timecounter.invariant_tsc: 1 > > > kern.timecounter.fast_gettime: 1 > > > kern.timecounter.tick: 1 > > > kern.timecounter.choice: ACPI-fast(900) HPET(950) i8254(0) > TSC-low(1000) > > > dummy(-1000000) > > > kern.timecounter.hardware: HPET > > > kern.timecounter.alloweddeviation: 5 > > > kern.timecounter.timehands_count: 2 > > > kern.timecounter.stepwarnings: 0 > > > kern.timecounter.tc.ACPI-fast.quality: 900 > > > kern.timecounter.tc.ACPI-fast.frequency: 3579545 > > > kern.timecounter.tc.ACPI-fast.counter: 16124892 > > > kern.timecounter.tc.ACPI-fast.mask: 16777215 > > > kern.timecounter.tc.HPET.quality: 950 > > > kern.timecounter.tc.HPET.frequency: 14318180 > > > kern.timecounter.tc.HPET.counter: 1883995229 > > > kern.timecounter.tc.HPET.mask: 4294967295 > > > kern.timecounter.tc.i8254.quality: 0 > > > kern.timecounter.tc.i8254.frequency: 1193182 > > > kern.timecounter.tc.i8254.counter: 57 > > > kern.timecounter.tc.i8254.mask: 65535 > > > kern.timecounter.tc.TSC-low.quality: 1000 > > > kern.timecounter.tc.TSC-low.frequency: 1413153007 > > > kern.timecounter.tc.TSC-low.counter: 2352002295 > > > kern.timecounter.tc.TSC-low.mask: 4294967295 > > > > > > I overrode the default selection of counter-type as NTPD drifted so > > > badly as to require stepping almost hourly :-( > > > > Could you show output from > > > > # kldload cpuctl > > # cpucontrol -i 0x15 /dev/cpuctl0 > > # cpucontrol -i 0x16 /dev/cpuctl0 > > > > as well as a copy of the dmesg after a boot? I am looking at a similar > > problem currently. > > Do you have the issue with jemalloc(3), or the problem with imprecise TSC > frequency as reported by CPUID leaf? > Only the latter, but I did not try overriding the time counter selection. > --0000000000005d179005cdc9c195--