From nobody Tue May 24 19:50:05 2022 X-Original-To: bugs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id CD9D01B40754 for ; Tue, 24 May 2022 19:50:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4L74Y94CdGz4YQF for ; Tue, 24 May 2022 19:50:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 6BC332D0D for ; Tue, 24 May 2022 19:50:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 24OJo5c2012944 for ; Tue, 24 May 2022 19:50:05 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 24OJo58u012943 for bugs@FreeBSD.org; Tue, 24 May 2022 19:50:05 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: bugs@FreeBSD.org Subject: [Bug 264208] make install[kernel|world] from read only /usr/obj throws permission denied warnings. Date: Tue, 24 May 2022 19:50:05 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 13.1-STABLE X-Bugzilla-Keywords: toolchain X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mike@sentex.net X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status keywords bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Bug reports List-Archive: https://lists.freebsd.org/archives/freebsd-bugs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-bugs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1653421805; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=PoA5Kzte24nfprQAPz2C4YG4GCKi7xDXk6QB2wrVazg=; b=NW60hRjIce2qrdL1pT5y7ko67NDrkAX9/XOZTbiUii90hfHMbhgcPiQht5t9fqzbLY0O34 Bs6G6vK9/U9poaZEOkMS755zzqoB9gz4qHEc/JfWf5J0ywmg7We4Okry4N9UZM4M5IW7Ii cyiY0hXgSz9DQACWsS4raWlHsP+7zPXVBOyL7N2/Flm4J1ku6lit+i8Fd3ayuzHEvVWI7e dGrRz+HPN7TCHvYuIUD/OEc1WXNXyHJfc+eNQ8c+6Q6oIgPY4bWf6kCrXx4GkaxfrtFS0k 1fALiMw5ekBTwjBRf4YHqZE99fBU9ppkWJLoA8nkqbzUN1SCSWxqRBb//9Vl3A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1653421805; a=rsa-sha256; cv=none; b=I1uiA8GxXcGYL3xQdE8SSB+BjnKOlRr0yzvJEOSi8Y8iBhqXzx88duxeujzlYHZBNNVhnl DduIbgLLVFlVaKg4UJ58+KjiGYPD9dyfzoWdJmPj6J+vkRibN1kXNJE64csdz53P8wOylu iREpKkb73gJXnywwW4qMaUm1rZ/XaFA6wFspSp/9cvtW92umJQNTyOUX8lr2jx+N5H+qBr tNRigDE/JZLBCSfDujfsfsayrwYkcAovfHzM5Z30z59aNkXvZjkgiGRnXNR9R2b7lUEBbC qfuxdMwHRBfJ5E8X54A7fQfdVj+AcqT6t0vegC/oObqq71Y+Vm8ErcSTZ4hm8g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D264208 Bug ID: 264208 Summary: make install[kernel|world] from read only /usr/obj throws permission denied warnings. Product: Base System Version: 13.1-STABLE Hardware: Any OS: Any Status: New Keywords: toolchain Severity: Affects Some People Priority: --- Component: bin Assignee: bugs@FreeBSD.org Reporter: mike@sentex.net On RELENG_13 I am no longer able to build on one server, and then mount /usr/src and /usr/obj via nfs thats read-only and installkernel/world witho= ut seeing errors. It *seems* to work in the end, but not sure if something is being missed. The server exports on the server V4:/ /nfs/usr/src -maproot=3Droot -ro -network 192.168.0.0/16 /nfs/usr/obj -maproot=3Droot -ro -network 192.168.0.0/16 % cat /etc/fstab=20 # Custom /etc/fstab for FreeBSD VM images /dev/gpt/rootfs / ufs rw 1 1 /dev/gpt/swapfs none swap sw 0 0 /dev/gpt/efiesp /boot/efi msdosfs rw 2 2 /usr/obj /nfs/usr/obj nullfs rw 0 0=20 /usr/src /nfs/usr/src nullfs rw 0 0=20 I use nullfs so I dont have to export / since this is ufs if the export is rw it works as expected without throwing errors.=20 On RELENG_12, I was able to mount via NFS /usr/obj and src and do an installworld on read only mounts. However, with RELENG_13 and above, I get permission denied errors. The install seems to continue just fine, but I am= not sure if something subtle is being missed. Looking at what gets installed, t= he kernel modules get installed just fine. However, it seems installworld has some problems with static libs (.a files). They dont seem to get re-install= ed. However, not sure if thats by design as doing a quick checksum, there is no difference on the build server and target of the ~ 700 .a files I checked in /usr/lib32 and /usr/lib. So despite the time stamps being off, maybe it just does not bother to update the target if they have not changed? e.g. make KERNCONF=3Dvtnet installkernel make warning: /usr/obj/usr/src: Permission denied. make[1] warning: /usr/src/: Permission denied. make[2] warning: /usr/obj/usr/src/amd64.amd64: Permission denied. -------------------------------------------------------------- >>> Install check kernel -------------------------------------------------------------- -------------------------------------------------------------- >>> Installing kernel vtnet on Tue May 24 13:50:52 EDT 2022 -------------------------------------------------------------- cd /usr/obj/usr/src/amd64.amd64/sys/vtnet; MACHINE_ARCH=3Damd64 MACHINE=3D= amd64=20 CPUTYPE=3D CC=3D"cc -target x86_64-unknown-freebsd13.1 --sysroot=3D/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin" CXX=3D"c++ -target x86_64-unknown-freebsd13.1 --sysroot=3D/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin" CPP=3D"cpp -target x86_64-unknown-freebsd13.1 --sysroot=3D/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin" AS=3D"as" AR=3D"ar" ELFCTL=3D"= elfctl" LD=3D"ld" LLVM_LINK=3D"" NM=3Dnm OBJCOPY=3D"objcopy" RANLIB=3Dranlib STRIN= GS=3D=20 SIZE=3D"size" STRIPBIN=3D"strip" PATH=3D/usr/obj/usr/src/amd64.amd64/tmp/bin:/usr/obj/usr/src/amd64.amd64/tm= p/usr/sbin:/usr/obj/usr/src/amd64.amd64/tmp/usr/bin:/usr/obj/usr/src/amd64.= amd64/tmp/legacy/usr/sbin:/usr/obj/usr/src/amd64.amd64/tmp/legacy/usr/bin:/= usr/obj/usr/src/amd64.amd64/tmp/legacy/bin:/usr/obj/usr/src/amd64.amd64/tmp= /legacy/usr/libexec::/sbin:/bin:/usr/sbin:/usr/bin make KERNEL=3Dkernel install make[2] warning: /usr/obj/usr/src/amd64.amd64/sys/vtnet: Permission denied. thiskernel=3D`sysctl -n kern.bootfile || echo /boot/kernel/kernel` ; if [ ! "`dirname "$thiskernel"`" -ef /boot/kernel ] ; then chflags -R noschg /boot/kernel ; rm -rf /boot/kernel ; rm -rf /usr/lib/debug/boot/kernel ;= =20 else if [ -d /boot/kernel.old ] ; then chflags -R noschg /boot/kernel.old= ;=20 rm -rf /boot/kernel.old ; fi ; mv /boot/kernel /boot/kernel.old ; if [ -n "/usr/lib/debug" -a -d /usr/lib/debug/boot/kernel ]; then rm -rf /usr/lib/debug/boot/kernel.old ; mv /usr/lib/debug/boot/kernel /usr/lib/debug/boot/kernel.old ; fi ; sysctl kern.bootfile=3D/boot/kernel.old/"`basename "$thiskernel"`" ; fi kern.bootfile: /boot/kernel/kernel -> /boot/kernel.old/kernel mkdir -p /boot/kernel install -p -m 555 -o root -g wheel kernel /boot/kernel/ mkdir -p /usr/lib/debug/boot/kernel install -p -m 555 -o root -g wheel kernel.debug /usr/lib/debug/boot/kernel/ cd /usr/src/sys/modules; MAKEOBJDIRPREFIX=3D/usr/obj/usr/src/amd64.amd64/sys/vtnet/modules KMODDIR=3D/boot/kernel MACHINE_CPUARCH=3Damd64 MACHINE=3Damd64 MACHINE_ARCH= =3Damd64 MODULES_EXTRA=3D"" WITHOUT_MODULES=3D"" ARCH_FLAGS=3D"" DEBUG_FLAGS=3D"-g" = __MPATH=3D"" KERNBUILDDIR=3D"/usr/obj/usr/src/amd64.amd64/sys/vtnet" SYSDIR=3D"/usr/src/= sys" MODULE_TIED=3Dyes WITH_CTF=3D"1" KCSAN_ENABLED=3D"yes" COMPAT_FREEBSD32_ENA= BLED=3D"yes" make install make[3] warning: /usr/obj/usr/src/amd64.amd64/sys/vtnet/modules/usr/src/sys/modules: Permiss= ion denied. =3D=3D=3D> aac (install) make[4] warning: /usr/obj/usr/src/amd64.amd64/sys/vtnet/modules/usr/src/sys/modules/aac: Permission denied. install -T release -o root -g wheel -m 555 aac.ko /boot/kernel/ install -T dbg -o root -g wheel -m 555 aac.ko.debug /usr/lib/debug/boot/kernel/ =3D=3D=3D> aacraid (install) make[4] warning: /usr/obj/usr/src/amd64.amd64/sys/vtnet/modules/usr/src/sys/modules/aacraid: Permission denied. install -T release -o root -g wheel -m 555 aacraid.ko /boot/kernel/ install -T dbg -o root -g wheel -m 555 aacraid.ko.debug /usr/lib/debug/boot/kernel/ =3D=3D=3D> accf_data (install) make[4] warning: /usr/obj/usr/src/amd64.amd64/sys/vtnet/modules/usr/src/sys/modules/accf_dat= a: Permission denied. eg. 0{git}% ls -l /usr/lib32/libhei* -r--r--r-- 1 root wheel - 53622 Mar 17 20:02 /usr/lib32/libheimbase.a lrwxr-xr-x 1 root wheel - 17 May 24 17:11 /usr/lib32/libheimbase.so -> libheimbase.so.11 -r--r--r-- 1 root wheel - 13224 May 24 17:11 /usr/lib32/libheimbase.so.11 -r--r--r-- 1 root wheel - 54966 Mar 17 20:02 /usr/lib32/libheimbase_p.a -r--r--r-- 1 root wheel - 67598 Mar 17 20:02 /usr/lib32/libheimntlm.a lrwxr-xr-x 1 root wheel - 17 May 24 17:11 /usr/lib32/libheimntlm.so -> libheimntlm.so.11 -r--r--r-- 1 root wheel - 23840 May 24 17:11 /usr/lib32/libheimntlm.so.11 -r--r--r-- 1 root wheel - 68746 Mar 17 20:02 /usr/lib32/libheimntlm_p.a 0{git}% Looking at the pcap, nothing stands out as to what the problem might be. Looking at the replies, the ERROR is just "ERROR: No such file or directory" and doesnt correlate to the permission denied errors reading from file nfs.pcap, link-type EN10MB (Ethernet) 2 xid reply ok 3371 xid reply ok getattr CHR 11734062556 ids 951 xid reply ok getattr CHR 12231260544 ids 626 xid reply ok getattr ERROR: No such 2 xid reply ok getattr FIFO 10432271160 ids 6758 xid reply ok getattr FIFO 10731272141 ids 165 xid reply ok getattr FIFO 11433667553 ids 214 xid reply ok getattr FIFO 12231260544 ids 3373 xid reply ok getattr LNK 10333067563 ids 2 xid reply ok getattr LNK 12231267145 ids 2 xid reply ok getattr unk-ft 10 10536061550 2 xid reply ok getattr unk-ft 13 10334462541 2 xid reply ok getattr unk-ft 15 12231261554 673 xid reply ok getattr unk-ft 6 10130661545 879 xid reply ok getattr unk-ft 6 11433667553 126 xid reply ok getattr unk-ft 8 12231260544 2 xid reply ok null --=20 You are receiving this mail because: You are the assignee for the bug.=