From nobody Fri Dec 13 21:15:45 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Y92FC4rbSz5g7ll for ; Fri, 13 Dec 2024 21:15:59 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: from mail-io1-f46.google.com (mail-io1-f46.google.com [209.85.166.46]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Y92FB4RWLz4YD1 for ; Fri, 13 Dec 2024 21:15:58 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of carpeddiem@gmail.com designates 209.85.166.46 as permitted sender) smtp.mailfrom=carpeddiem@gmail.com; dmarc=fail reason="SPF not aligned (relaxed), No valid DKIM" header.from=freebsd.org (policy=none) Received: by mail-io1-f46.google.com with SMTP id ca18e2360f4ac-844d67eb693so152303139f.3 for ; Fri, 13 Dec 2024 13:15:58 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1734124557; x=1734729357; h=content-transfer-encoding:to:subject:message-id:date:from :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=lxAyzWImpAsfQKnTmjz1DM8LFLAfFYCZDKv0TeKQa+s=; b=hLnkL35Ew8HDDRlZiGSfViP1Ln2QyJ59aW4cwu1XK6fm6f2xPuKAWlSxPETmF+X+hC Hw2K9WGepERBpVkbmUDt8tqeDZcfVTZvg+r1khK+oqtyNpIHPsgd5PYWxsYkCwwFTbgz Yqw503w1Oh/aPNCMwpG3mmITIIgGJEbsnEJl6JXQrek6mHhIyb8+PZPiPi1CZWda9Q78 9wav+VfnIERGzF8vR8VPH0KvXWFTTVQFhmqUv/0PeKZjdTbmoaB8dXwL5OIB0EAtWrqs ch4IjP6c7iBZV+sb/kDTGkXlfGYCqwTzOPeD25VVuXntzA2c/B6UheqfML3+69Toluzx npPA== X-Gm-Message-State: AOJu0YxagyoHE0DwDh+ntFu0urwA2I6/6vYID5Et8HpIMQCrLCQ2zFLI gfe/5t4a0zyl3b5PudWp931+4efq+SSz2zePnIvjGvNNlc1XY7UEyzemMGX711gwvkvVSPpp/PD spUspmIO+P30/aFx6omkGl5KE2n1l1Oua X-Gm-Gg: ASbGncuGNAf38J/dlhE1fiEg6DybR9QCSQ2ttTUduNyBrsW94499caslutac2zxJ2R/ sjMqkzXWGIty8ZUhFsdYPZovMAoIbcACNfnWepS12o+w/6RQYk5zbDq5FXpL2zL8LM/IsIb4= X-Google-Smtp-Source: AGHT+IEfiJPFu1LE9hHIITiq9PYUwwHpn54/6KyDV4tpbd8UJtt4rBm4hnDIRaPKzQWMlK042bnA/vNQqSowK0pZh9Y= X-Received: by 2002:a05:6e02:1a07:b0:3a7:1f72:ad3c with SMTP id e9e14a558f8ab-3aff0961e22mr53735385ab.19.1734124556950; Fri, 13 Dec 2024 13:15:56 -0800 (PST) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 From: Ed Maste Date: Fri, 13 Dec 2024 16:15:45 -0500 Message-ID: Subject: Switching release media dist sets to .tzst (tar + zstd)? To: FreeBSD Current Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spamd-Result: default: False [-1.88 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.98)[-0.983]; FORGED_SENDER(0.30)[emaste@freebsd.org,carpeddiem@gmail.com]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; DMARC_POLICY_SOFTFAIL(0.10)[freebsd.org : SPF not aligned (relaxed), No valid DKIM,none]; MIME_GOOD(-0.10)[text/plain]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; RCPT_COUNT_ONE(0.00)[1]; MISSING_XM_UA(0.00)[]; FREEFALL_USER(0.00)[carpeddiem]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; FROM_NEQ_ENVFROM(0.00)[emaste@freebsd.org,carpeddiem@gmail.com]; RCVD_COUNT_ONE(0.00)[1]; R_DKIM_NA(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.166.46:from]; TO_DOM_EQ_FROM_DOM(0.00)[]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; RCVD_IN_DNSWL_NONE(0.00)[209.85.166.46:from] X-Rspamd-Queue-Id: 4Y92FB4RWLz4YD1 X-Spamd-Bar: - I have been reviewing parts of the release artifact build process, including ISO and memstick images, and came across the distribution sets (e.g., base.txz, src.txz) used by the installer to populate new file systems. I=E2=80=99d like to discuss switching these to .tzst (tar + zstd) compression. While I haven=E2=80=99t yet conducted detailed benchmarks comparing zstd an= d xz specifically for this use case, here are some initial considerations: Pros of zstd: - Faster compression and decompression speeds. - Aligns with the compression method used for FreeBSD packages. Cons of zstd: - Somewhat larger compressed file sizes. - Requires updates to tools that interact with distribution sets. - May have limited availability on some other operating systems (?). I have a review open to demonstrate the extent of the change in the build system & installer: https://reviews.freebsd.org/D48042 It might be that this is not worth pursuing, as dist sets will most likely go away with the migration to pkgbase, but I would like to discuss and make an explicit decision. We can separately consider compression on the release media images themselves. Feedback Requested: Is there support for this idea? Are there objections to pursuing this? Are there other factors I should consider, especially compatibility concern= s?