From nobody Tue May 24 18:58:44 2022 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 99E3B1AEC2D6 for ; Tue, 24 May 2022 18:58:50 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L73Q169twz3vdb for ; Tue, 24 May 2022 18:58:49 +0000 (UTC) (envelope-from mike@sentex.net) Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19]) by smarthost1.sentex.ca (8.16.1/8.16.1) with ESMTPS id 24OIwh00014364 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Tue, 24 May 2022 14:58:43 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [IPV6:2607:f3e0:0:4:a4e9:541f:6818:4d58] ([IPv6:2607:f3e0:0:4:a4e9:541f:6818:4d58]) by pyroxene2a.sentex.ca (8.16.1/8.15.2) with ESMTPS id 24OIwgMj004651 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO) for ; Tue, 24 May 2022 14:58:43 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <1cd6bcff-92d5-f155-9b19-b3a16d75fe19@sentex.net> Date: Tue, 24 May 2022 14:58:44 -0400 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Thunderbird/91.9.0 Content-Language: en-US To: freebsd-current From: mike tancsa Subject: make install[kernel|world] from read only /usr/obj possible ? Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.84 X-Rspamd-Queue-Id: 4L73Q169twz3vdb X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of mike@sentex.net designates 2607:f3e0:0:1::12 as permitted sender) smtp.mailfrom=mike@sentex.net X-Spamd-Result: default: False [-2.39 / 15.00]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[mike]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f3e0::/32]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; DMARC_NA(0.00)[sentex.net]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_COUNT_THREE(0.00)[3]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.99)[-0.991]; MLMMJ_DEST(0.00)[freebsd-current]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA]; SUBJECT_ENDS_QUESTION(1.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[199.212.134.19:received] X-ThisMailContainsUnwantedMimeParts: N On RELENG_12, I was able to mount via NFS /usr/obj and src and do an installworld on read only mounts. However, with RELENG_13 and above, I get permission denied errors. The install seems to continue just fine, but I am not sure if something subtle is being missed. Looking at what gets installed, the kernel modules get installed just fine.  However, it seems installworld has some problems with static libs (.a files). They dont seem to get re-installed. However, not sure if thats by design as doing a quick checksum, there is no difference on the build server and target of the ~ 700 .a files I checked in /usr/lib32 and /usr/lib. So despite the time stamps being off, maybe it just does not bother to update the target if they have not changed? e.g. make KERNCONF=vtnet installkernel make warning: /usr/obj/usr/src: Permission denied. make[1] warning: /usr/src/: Permission denied. make[2] warning: /usr/obj/usr/src/amd64.amd64: Permission denied. -------------------------------------------------------------- >>> Install check kernel -------------------------------------------------------------- -------------------------------------------------------------- >>> Installing kernel vtnet on Tue May 24 13:50:52 EDT 2022 -------------------------------------------------------------- cd /usr/obj/usr/src/amd64.amd64/sys/vtnet;  MACHINE_ARCH=amd64 MACHINE=amd64  CPUTYPE= CC="cc -target x86_64-unknown-freebsd13.1 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin" CXX="c++  -target x86_64-unknown-freebsd13.1 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin"  CPP="cpp -target x86_64-unknown-freebsd13.1 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin"  AS="as" AR="ar" ELFCTL="elfctl" LD="ld"  LLVM_LINK="" NM=nm OBJCOPY="objcopy" RANLIB=ranlib STRINGS=  SIZE="size" STRIPBIN="strip" PATH=/usr/obj/usr/src/amd64.amd64/tmp/bin:/usr/obj/usr/src/amd64.amd64/tmp/usr/sbin:/usr/obj/usr/src/amd64.amd64/tmp/usr/bin:/usr/obj/usr/src/amd64.amd64/tmp/legacy/usr/sbin:/usr/obj/usr/src/amd64.amd64/tmp/legacy/usr/bin:/usr/obj/usr/src/amd64.amd64/tmp/legacy/bin:/usr/obj/usr/src/amd64.amd64/tmp/legacy/usr/libexec::/sbin:/bin:/usr/sbin:/usr/bin make  KERNEL=kernel install make[2] warning: /usr/obj/usr/src/amd64.amd64/sys/vtnet: Permission denied. thiskernel=`sysctl -n kern.bootfile || echo /boot/kernel/kernel` ;  if [ ! "`dirname "$thiskernel"`" -ef /boot/kernel ] ; then chflags -R noschg /boot/kernel ;  rm -rf /boot/kernel ;  rm -rf /usr/lib/debug/boot/kernel ;  else  if [ -d /boot/kernel.old ] ; then  chflags -R noschg /boot/kernel.old ;  rm -rf /boot/kernel.old ;  fi ;  mv /boot/kernel /boot/kernel.old ;  if [ -n "/usr/lib/debug" -a  -d /usr/lib/debug/boot/kernel ]; then  rm -rf /usr/lib/debug/boot/kernel.old ;  mv /usr/lib/debug/boot/kernel /usr/lib/debug/boot/kernel.old ;  fi ; sysctl kern.bootfile=/boot/kernel.old/"`basename "$thiskernel"`" ;  fi kern.bootfile: /boot/kernel/kernel -> /boot/kernel.old/kernel mkdir -p /boot/kernel install -p -m 555 -o root -g wheel kernel /boot/kernel/ mkdir -p /usr/lib/debug/boot/kernel install -p -m 555 -o root -g wheel kernel.debug /usr/lib/debug/boot/kernel/ cd /usr/src/sys/modules; MAKEOBJDIRPREFIX=/usr/obj/usr/src/amd64.amd64/sys/vtnet/modules KMODDIR=/boot/kernel MACHINE_CPUARCH=amd64 MACHINE=amd64 MACHINE_ARCH=amd64 MODULES_EXTRA="" WITHOUT_MODULES="" ARCH_FLAGS="" DEBUG_FLAGS="-g" __MPATH="" KERNBUILDDIR="/usr/obj/usr/src/amd64.amd64/sys/vtnet" SYSDIR="/usr/src/sys" MODULE_TIED=yes WITH_CTF="1" KCSAN_ENABLED="yes" COMPAT_FREEBSD32_ENABLED="yes" make  install make[3] warning: /usr/obj/usr/src/amd64.amd64/sys/vtnet/modules/usr/src/sys/modules: Permission denied. ===> aac (install) make[4] warning: /usr/obj/usr/src/amd64.amd64/sys/vtnet/modules/usr/src/sys/modules/aac: Permission denied. install -T release -o root -g wheel -m 555   aac.ko /boot/kernel/ install -T dbg -o root -g wheel -m 555   aac.ko.debug /usr/lib/debug/boot/kernel/ ===> aacraid (install) make[4] warning: /usr/obj/usr/src/amd64.amd64/sys/vtnet/modules/usr/src/sys/modules/aacraid: Permission denied. install -T release -o root -g wheel -m 555   aacraid.ko /boot/kernel/ install -T dbg -o root -g wheel -m 555   aacraid.ko.debug /usr/lib/debug/boot/kernel/ ===> accf_data (install) make[4] warning: /usr/obj/usr/src/amd64.amd64/sys/vtnet/modules/usr/src/sys/modules/accf_data: Permission denied. eg. 0{git}% ls -l /usr/lib32/libhei* -r--r--r--  1 root  wheel  - 53622 Mar 17 20:02 /usr/lib32/libheimbase.a lrwxr-xr-x  1 root  wheel  -    17 May 24 17:11 /usr/lib32/libheimbase.so -> libheimbase.so.11 -r--r--r--  1 root  wheel  - 13224 May 24 17:11 /usr/lib32/libheimbase.so.11 -r--r--r--  1 root  wheel  - 54966 Mar 17 20:02 /usr/lib32/libheimbase_p.a -r--r--r--  1 root  wheel  - 67598 Mar 17 20:02 /usr/lib32/libheimntlm.a lrwxr-xr-x  1 root  wheel  -    17 May 24 17:11 /usr/lib32/libheimntlm.so -> libheimntlm.so.11 -r--r--r--  1 root  wheel  - 23840 May 24 17:11 /usr/lib32/libheimntlm.so.11 -r--r--r--  1 root  wheel  - 68746 Mar 17 20:02 /usr/lib32/libheimntlm_p.a 0{git}% Looking at the pcap, nothing stands out as to what the problem might be. Looking at the replies, the ERROR is just "ERROR: No such file or directory" and doesnt correlate to the permission denied errors reading from file nfs.pcap, link-type EN10MB (Ethernet)    2 xid  reply ok 3371 xid  reply ok getattr CHR 11734062556 ids  951 xid  reply ok getattr CHR 12231260544 ids  626 xid  reply ok getattr ERROR: No such    2 xid  reply ok getattr FIFO 10432271160 ids 6758 xid  reply ok getattr FIFO 10731272141 ids  165 xid  reply ok getattr FIFO 11433667553 ids  214 xid  reply ok getattr FIFO 12231260544 ids 3373 xid  reply ok getattr LNK 10333067563 ids    2 xid  reply ok getattr LNK 12231267145 ids    2 xid  reply ok getattr unk-ft 10 10536061550    2 xid  reply ok getattr unk-ft 13 10334462541    2 xid  reply ok getattr unk-ft 15 12231261554  673 xid  reply ok getattr unk-ft 6 10130661545  879 xid  reply ok getattr unk-ft 6 11433667553  126 xid  reply ok getattr unk-ft 8 12231260544    2 xid  reply ok null