From nobody Sun Jun 16 09:15:52 2024 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4W26nm11snz5NdkY for ; Sun, 16 Jun 2024 09:16:12 +0000 (UTC) (envelope-from thor@irk.ru) Received: from mail.irk.ru (relay2.dsi.ru [195.206.40.175]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4W26nk1Cjbz4dMH for ; Sun, 16 Jun 2024 09:16:10 +0000 (UTC) (envelope-from thor@irk.ru) Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of thor@irk.ru designates 195.206.40.175 as permitted sender) smtp.mailfrom=thor@irk.ru Received: from [94.154.80.101] (port=49369 helo=[192.168.1.245]) by mail.irk.ru with esmtpa (Exim 4.86 (FreeBSD)) (envelope-from ) id 1sIlzV-0007Gs-4S for questions@freebsd.org; Sun, 16 Jun 2024 17:16:01 +0800 Message-ID: <22e86a26-e2d5-47b3-8a28-26fde5c4d730@irk.ru> Date: Sun, 16 Jun 2024 17:15:52 +0800 List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-questions@freebsd.org Sender: owner-freebsd-questions@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.7.1 To: questions Content-Language: en-US From: Thor Ablestar Subject: /usr/ports/distfiles/go insanely oversized Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.98 / 15.00]; NEURAL_HAM_LONG(-0.99)[-0.994]; NEURAL_HAM_SHORT(-0.91)[-0.915]; NEURAL_HAM_MEDIUM(-0.87)[-0.869]; R_SPF_ALLOW(-0.20)[+mx]; ONCE_RECEIVED(0.10)[]; MIME_GOOD(-0.10)[text/plain]; RCVD_VIA_SMTP_AUTH(0.00)[]; ASN(0.00)[asn:8345, ipnet:195.206.32.0/19, country:RU]; RCVD_COUNT_ONE(0.00)[1]; RCPT_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+]; FROM_HAS_DN(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; MLMMJ_DEST(0.00)[questions@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; TO_DN_ALL(0.00)[]; DMARC_NA(0.00)[irk.ru]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[] X-Rspamd-Queue-Id: 4W26nk1Cjbz4dMH Hello! I have a habit to keep /usr/ports/distfiles on separate SSD in order to build packages on many different computers and OSes (12, 13 and now 14.2). Usually i do the following: # cd /usr/ports/sometheme/somepackage # make checksum # make install so that I supervise the download of source files and then have some rest while the port compiles. SSD became full, and I decided to copy data to the different HDD. Then I have found that the /usr/ports/distfiles/go has an insane number of subdirectories (some hundreds of thousands). I spent a full day in attempts to copy them (successfully at last) and only some minutes to copy the rest. Then I decided to find a total size of the distfiles with du. Now du spent 5 minutes of machine time (top listing) and has shown 288 GB in go subdir and 469 GB total. Then I have tried to compare some subdirectories in go directory, and it seems that each subdirectory contains subdirectories of all their dependencies (I am not sure). For instance, go/archivers_nfpm/pkg/mod/cache/download/github.com/!masterminds/goutils/@v contains the same files (name and size) as go/audio_gonic/pkg/mod/cache/download/github.com/!masterminds/goutils/@v What to do? How to manage it? If the problem cannot be solved I am going just to ban the /usr/ports/distfiles/go dependent ports completely and try to live without them. I had the same problem 2 years ago but it was not so severe as now. Sincerely yours, Anatoly