From nobody Fri Mar 29 17:13:39 2024 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4V5n7D4K3wz5FGLJ for ; Fri, 29 Mar 2024 17:13:44 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-oi1-x232.google.com (mail-oi1-x232.google.com [IPv6:2607:f8b0:4864:20::232]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4V5n7D2SnMz4Xmh; Fri, 29 Mar 2024 17:13:44 +0000 (UTC) (envelope-from markjdb@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-oi1-x232.google.com with SMTP id 5614622812f47-3c396fec63aso830152b6e.0; Fri, 29 Mar 2024 10:13:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1711732422; x=1712337222; darn=freebsd.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:sender:from:to:cc:subject:date:message-id :reply-to; bh=iEAJvbul+GSsKRL8coz6NxLrYCNn7hgnYbfpUbWYW48=; b=MR8EWNKUKyJn1y73PAfFI9Izfqu24/90QTsynC/Y2NoQF+WVv9ow+0JRFCQkrQ0BFk iWpGOT+tK+yfg1c3JsYDAp6C+MtbDoLZhxVT/SZ6M62J1UzQfWHiblrE1YyS6c6gJabF zVsnsLw46sD1jypWmlui0TJi5DV0GFQMHfUyQl3LS/kzBN3fxMMfFscaV0FFTUCm9Mfp Ji7CkKrgG/hWsmRRzFR4qu1ZEtp/2s0KMO9sEr78uWqi1mwLAoe+p6U8iJ/73KMhnWh1 FSVkm+8RQuyi5PzzHya8JFbe2PVlkdGoYgtt2AiB+7qMGsl/0q1vD0vcK3xKGtZ0Z4dD LI9g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1711732422; x=1712337222; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:sender:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=iEAJvbul+GSsKRL8coz6NxLrYCNn7hgnYbfpUbWYW48=; b=cjJ+mD9dWf5lBw2eLccLl+frbc0mzQpG21tFmn7ZRTm3mz9GhxBJ2cDz4VFNkjdhEX YDqozdfw25D4RUZAh5St0a0TZgftRyaTUnB/7PrFG8yHYjhk8BaIQW4gltX327MBjgbg iwWYesEkJpwuo4GpRVojZm/DUtr7Ob28M5bzfDCRGJ1E819kc/jw0XkYyo7DGzuVE5cx Av2Ee78lLFWDoF7b4Rj2d5UCMXJgu8h1blzmgBuglQkFTD+GwFw5WCMziUaJ01XK7W91 9mlCdp3VQ/mUGg2T2DjT4k/O8UAebot7wVqRgeemMmu53d1G3NPGmnrmRTnDMQkSxhKn IDiA== X-Forwarded-Encrypted: i=1; AJvYcCWni72l7RMq/nq0+SM8iVSxfemOnQkyE5Pbkl3kL0MX0/a2KWsptvwIHTIiqQRD9AybYqNntjbqQPPh/Ohj0Vd6t2mo X-Gm-Message-State: AOJu0Yx4kmPeTCTX0k39cyzu92wOA5XG7Tt+CGwsjc9d/WEnYeO/OSWZ IRhVTuKqFca7c2x1MXw0LAaijo0RTjmcUdEJ8ezVDQtxUH8HnX/qMqyKG/AI X-Google-Smtp-Source: AGHT+IGhh+r4Jok/XSiFeUUmUoTimoc328yRFxe9jAwn5QVgWBVtNpDbCi0lWB7/kAPzl0Sf3Jr0Vg== X-Received: by 2002:a05:6808:2907:b0:3c3:e0c9:e5ef with SMTP id ev7-20020a056808290700b003c3e0c9e5efmr2305860oib.59.1711732422607; Fri, 29 Mar 2024 10:13:42 -0700 (PDT) Received: from nuc (192-0-220-237.cpe.teksavvy.com. [192.0.220.237]) by smtp.gmail.com with ESMTPSA id jt12-20020a05621427ec00b00696766401adsm1819723qvb.38.2024.03.29.10.13.41 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 29 Mar 2024 10:13:42 -0700 (PDT) Date: Fri, 29 Mar 2024 13:13:39 -0400 From: Mark Johnston To: Alexander Leidinger Cc: Current , bnovkov@freebsd.org Subject: Re: Multiple issues with current (kldload failures, missing CTF stuff, pty issues, ...) Message-ID: References: <09ef22679b76cb2dbeace8e78bf9f80e@Leidinger.net> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <09ef22679b76cb2dbeace8e78bf9f80e@Leidinger.net> X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4V5n7D2SnMz4Xmh On Fri, Mar 29, 2024 at 04:52:55PM +0100, Alexander Leidinger wrote: > Hi, > > sources from 2024-03-11 work. Sources from 2024-03-25 and today don't work > (see below for the issue). As the monthly stabilisation pass didn't find > obvious issues, it is something related to my setup: > - not a generic kernel > - very modular kernel (as much as possible as a module) > - bind_now (a build without fails too, tested with clean /usr/obj) > - ccache (a build without fails too, tested with clean /usr/obj) > - kernel retpoline (build without in progress) > - userland retpoline (build without in progress) > - kernel build with WITH_CTF / DDB_CTF (next one to test if it isn't > retpoline) > - -fno-builtin > - CPUFLAGS=native (except for stuff in /usr/src/sys/boot) > - malloc production > - COPTFLAGS= -O2 -pipe > > The issue is, that kernel modules load OK from loader, but once it starts > init any module fails to load (e.g. via autodetection of hardware or rc.conf > kld_list) with the message that the kernel and module versions are out of > sync and the module refuses to load. What is the exact revision you're running? There were some unrelated changes to the kernel linker around the same time. > I tried the workaround to load the modules from the loader, which works, but > then I can't login remotely as ssh fails to allocate a pty. By loading > modules via the loader, I can see messages about missing CTF info when the > nvidia modules (from ports = not yet rebuild = in /boot/modules/...ko > instead of /boot/kernel/...ko) try to get initialised... and it looks like > they are failing to get initialised because of this missing CTF stuff (I'm > back to the previous boot env to be able to login remotely and send mails, I > don't have a copy of the failure message at hand). > > I assume the missing CTF stuff is due to the CTF based pretty printing (https://cgit.freebsd.org/src/commit/?id=c21bc6f3c2425de74141bfee07b609bf65b5a6b3). > Is this supposed to fail to load modules which are compiled without CTF > data? Shouldn't this work gracefully (e.g. spit out a warning that pretty > printing is not available for module X and have the module working)? From my reading of linker_ctf_load_file(), this is exactly how it already works. > Next steps: > - try a world without retpoline (bind_now and ccache active) > - try a kernel without CTF (bind now, ccache, retpoline active) > - try a world without bind_now, retpoline, CTF, CPUFLAGS, COPTFLAGS > > If anyone has an idea how to debug this in some other way... > > Bye, > Alexander. > > -- > http://www.Leidinger.net Alexander@Leidinger.net: PGP 0x8F31830F9F2772BF > http://www.FreeBSD.org netchild@FreeBSD.org : PGP 0x8F31830F9F2772BF