From nobody Fri Nov 24 21:50:55 2023 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4ScTFP4VcDz51NdH for ; Fri, 24 Nov 2023 21:51:05 +0000 (UTC) (envelope-from mirror176@hotmail.com) Received: from NAM10-MW2-obe.outbound.protection.outlook.com (mail-mw2nam10olkn2081b.outbound.protection.outlook.com [IPv6:2a01:111:f400:7e89::81b]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4ScTFN4DKXz4Y7f for ; Fri, 24 Nov 2023 21:51:04 +0000 (UTC) (envelope-from mirror176@hotmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=hotmail.com header.s=selector1 header.b=u+d9pTfx; arc=pass ("microsoft.com:s=arcselector9901:i=1"); spf=pass (mx1.freebsd.org: domain of mirror176@hotmail.com designates 2a01:111:f400:7e89::81b as permitted sender) smtp.mailfrom=mirror176@hotmail.com; dmarc=pass (policy=none) header.from=hotmail.com ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=bURxoAqgpXbtN9JWvk2uxxV/17WuUUHia86g+EqkakT8P15GRQZG64LQ7YguS851sta8aERlwadTLlwJE1NiQj1kVXoz9wQfnu2lSBpcL8y89dksKGwzRNDblXxfFMUqcwNNCg5SW17WhZZZ16t+ijNvzt8qwuWuSuSRvMl6j6Z7edIXdGy55m11aBUDEAnQqbIfI3ooloT7oyKUaCDJzsvfODddLKADUhQB9wofzf/6XR2Nn814iO9JlrzEH4RdAZe7avZcnumm1Ni/h8Vrzx5VeO/v9yGE7vMuv3XTLeGzHQVGKLp71evq0e5c2zrYrqrcN/SSvZuxgxvrZKGqDQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=NI8bbBQF5ChA7TxUP+Agd62YCOuZeO9cJI+VU6ymkFc=; b=lfWgBVrzrdZmq4oOrYSH7zDW+kDC+X29hkrRQf/lkEiYvB/nS8VfLOm/MwbBhWot3Z0xBT/Mkq7dlx/sTRRbQJKNMe6+/p092c2Vgkp9HpcWO0yyvN2BBJAP/LTjvUOvkssBHgTMFmAZwhMR9hqwLcryZP+EZD1DCHbqhXnI4tWnNlJ6M3IW+pC6APPFMMAlNJ6GEAZ21rPS6I64MX3iYF3Git0Xvz2sRu4KOl2sraFAOcjPhHz1ts2VjytYEjdVX2xzkcHJVrHLJL5zTwiqM3ScnRcU+EmtpMnetLyemsht68AsWCt86qUpBXt9bmAG5O4V1uXoPFWg8VgAg/iQkg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hotmail.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=NI8bbBQF5ChA7TxUP+Agd62YCOuZeO9cJI+VU6ymkFc=; b=u+d9pTfxUE1MuHP1V3J7cZHtPuWZ2zOSDXdkvUWbxauEeQMy50S+9Ds6NoohZ2daWvCOGP/jAMX0mg7wuIdtk+CfU32rQZkQols8P8ZcNVwtuGxPcFibBuWr74I4IrdywDlXnq/hbjuSRfXNjat/MQinB8tTqL5Lcs5Kb7Q/NMK8OPln02LYGJF/nniHuYUMWM+ByMFH5iro7VcIF3uv0yQ718G5Svv99KgDIy+6ztNdO7T+Q5p6RZDy3zSHp9gX3uDkJIOSdK6oxrBF8MTb4cmMuwFa+rqAmMyWCGHrIH5gcPF5JYUK05fArTzkFnq+sVKDL4pBFSZIahdfA0u8Xw== Received: from CO1PR11MB4770.namprd11.prod.outlook.com (2603:10b6:303:94::19) by MN0PR11MB5963.namprd11.prod.outlook.com (2603:10b6:208:372::10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7025.20; Fri, 24 Nov 2023 21:51:01 +0000 Received: from CO1PR11MB4770.namprd11.prod.outlook.com ([fe80::10a1:33d7:1d06:31ea]) by CO1PR11MB4770.namprd11.prod.outlook.com ([fe80::10a1:33d7:1d06:31ea%4]) with mapi id 15.20.7025.021; Fri, 24 Nov 2023 21:51:00 +0000 Message-ID: Date: Fri, 24 Nov 2023 14:50:55 -0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.14.0 Subject: Re: Upgrade form 13.2-RELEASE-p5 to 14.0-RELEASE took almost 24hours Content-Language: en-US To: questions@freebsd.org References: <93C2E7DA-5E04-454B-9532-318292EEAE9A@tellme3times.com> From: "Edward Sanford Sutton, III" In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-TMN: [uTeHJ4fDkbjnvIMWZB/ga8fIa+9V7yhO] X-ClientProxiedBy: MN2PR01CA0038.prod.exchangelabs.com (2603:10b6:208:23f::7) To CO1PR11MB4770.namprd11.prod.outlook.com (2603:10b6:303:94::19) X-Microsoft-Original-Message-ID: <78470ca5-450b-0028-8991-e89ba2d4307a@hotmail.com> List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: CO1PR11MB4770:EE_|MN0PR11MB5963:EE_ X-MS-Office365-Filtering-Correlation-Id: 158fc005-6b96-42d9-e2fa-08dbed37728f X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: Fsg2aVCdjai4znzuA2kBjWlg9DY+BY1d+8kLXQTcsUrrZePV++7vlJsdoxxtp1+iaNA43ORX8TbvZomA5cPb+or9Nn6m4oHWsyaStWTryzkKRCFz+FaZUGwe9XXz5EwzF2X6TtdqDhAT3rPqa9HSVrIHzCkNhceB3ehdSK/lG8RxG/hbCvt1VsDqDppIQVX/qUO1x6eRUhrqV+5BjoPUW1g631tMGXh0nSLc0PCBNch45jvQlRFxdi95LoEjHt5qJXUtaWmtH82p7Q8LdClcycvmpZXuIwJosOPm6Jjl7TTO+7bUndXuPZMiw+NG3+UUqNa2TQrzO+quOuO8bwkET4EWP9zV+ZYUKvN8gtMPnnlbunxW01nAyrAxDvVOiCnGZ1rjfPe50KbrffdQI7wRHCdOyW/BBGr1/ceb1Sw/GQezayMbIP7Kd+sF24cDZJZitRensJHN+/LeDIDKA9EODXS6/T5MtKZo9ZJRFXiT9Br+1Udv+B5DolP7+pnhBbglMUqG8aAobYXigCK8eJDtmyRQXhCMLhUpZtBIXIOWYPQ= X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?Y1IzNjNUS3RhOWFrZEwrME45TzE5RUZQY3Q2MDhVcEVDdUVhRWRtNFhlNEM5?= =?utf-8?B?V3FYOTRRVE5YaDIzaEdpS29tUmpEbmxLWGJmOU9EaVhPaWFERGs2TDNyTFpo?= =?utf-8?B?bkFESzV0TGdDNHdTZWMvaUQ0VVF5RlFWMmZsNi9YUTZEN0E3bUN3WHF5bENo?= =?utf-8?B?MXRiKzB6VU9oRHVlNFJyVENXSmM3YktwNlRiWk5WaUxacWdYb2IwaFNxcS84?= =?utf-8?B?dmpIVFY3VlVsUi93WEpPU0hSc2N1bGM3cmJEOVhjOFN0bEpXR0pJUGd3Mmt3?= =?utf-8?B?UUh6OUVlNWk0K3ZoM1Z4MmowMUplOGdVdDhjTlM2WEE4aFNvWmc4SUxXTm13?= =?utf-8?B?ZzlQSHdUNEZSeFdrQnlWd2xHMHVqaHpFZTlpTEJGWE4rNldFek5tU0ZsS0N2?= =?utf-8?B?a1p2Z0R2dzBpU2V3SDZoSktaTlNzdDNubjlXNDBuTktxN1ZENjk4ZVlKYysy?= =?utf-8?B?cGRVU2RKb3ZjenFkdDlEd29Pbk5YM0poNDJtM1ZCNm1LZ0Y5bXBzOG5iTVlr?= =?utf-8?B?OXBJMGM3R0FXbkZ4TUpjSlBmREk0RHBtVlFyUmE0ZmVESVpwNk1pdEpRSmo5?= =?utf-8?B?NUdRVE1OcUU5UmphQkFycVpXSDhtbW16ZWxPZHdRRTdwMEdIMTlQWWxKR2Zx?= =?utf-8?B?WS9NWFo3Ni9qZ0pOVXFxVFJGU1NFWDFJSENYUFpGUTB4cy83Skd1R0hORGFD?= =?utf-8?B?djM5WHpKUFAzcGNtVFFIcDF3eFk1MFFGZ2V6ZGxBc1Q3cVhHVmN2NTJpZkx5?= =?utf-8?B?U29ndTc5MVRFbXBSbG5qdldxK2FJQXFxR0d6QWtTSldZNFkzVDZVNTBPc05t?= =?utf-8?B?MnJDaTMxd0V5ZFhMRVBFNDREUU92UE0zMDBaZCs5YlZzMStYaGU4RXBDUHpo?= =?utf-8?B?enNiNGNRSnZtemJ5cng1Unl2YjZpVTRXd1Z4eWdQdWhZQWVwbHcveWlUSWUx?= =?utf-8?B?TjduRnhBalhGcmJVOW9EdGQyeFZCRndVWmQxMXNISmhvdzRFdHVCRVZEVDFB?= =?utf-8?B?ME1YT2lXVU5rQmZSR3QrZ29WUnJpL3FuMUVIeFU5ajFxcktoZElUeUtXNWM5?= =?utf-8?B?YlJkSmxJYSt3RlhuWHk4WS82Y1Rmak12ZldqWW1JL0NVa1ppNVdPSnhFbU8v?= =?utf-8?B?R2hpR0dqM1MzYXFCaWhkOGp2VUs3KzhqUGZZVDJCUlJpT21RbnEvb0VkajNQ?= =?utf-8?B?ei9nOXJsU0dxRDdSMWswUWY5eGRKc0RiOERnWEV4b0duVVZtYVg0NVI4VU5a?= =?utf-8?B?ZmxMd3FVVzlFbmp5Rm9ibEtMWkZVWS9YcHVEZndSZnh5VWFsT3dRMDM4NGFQ?= =?utf-8?B?RS92d0hEdEsvQVdlVkowa2I1cmY1a05lS2pvWnE1K1Bnb3JGZ0EyY1FHMi9y?= =?utf-8?B?Q1ZNUkErY05ESXA3M2Z4SGdNbE04WWhlaUFsc2FPUXJiNkRaVkx2Z3pDaUMy?= =?utf-8?B?dGxlQ0pIcXB6T3F0M045TklndTRTUVMzK1l3SnBpeXdJNUE5OUJVb1pzbGIw?= =?utf-8?B?Z0IxaXdDVEc2VEtnOHc5RDhzSEhMYTFjZjBYM29LdXo0ZVhKRjJBNy9mYWlD?= =?utf-8?B?UUZzejV1OFNGTEdwdTg5RnZVZlZkUHJNQm5jSGYxdkpuN3pQSTZmbGZyYVJI?= =?utf-8?Q?w2mefbKvsUArvzEmd8ZP+8OVDX+QtpTu1Y/FB2ZPiVnM=3D?= X-OriginatorOrg: sct-15-20-4755-11-msonline-outlook-e8f36.templateTenant X-MS-Exchange-CrossTenant-Network-Message-Id: 158fc005-6b96-42d9-e2fa-08dbed37728f X-MS-Exchange-CrossTenant-AuthSource: CO1PR11MB4770.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 24 Nov 2023 21:51:00.8719 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN0PR11MB5963 X-Spamd-Result: default: False [1.77 / 15.00]; FORGED_MUA_THUNDERBIRD_MSGID_UNKNOWN(2.50)[]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; NEURAL_SPAM_MEDIUM(0.99)[0.991]; NEURAL_SPAM_LONG(0.97)[0.971]; NEURAL_HAM_SHORT(-0.69)[-0.694]; DMARC_POLICY_ALLOW(-0.50)[hotmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2a01:111:f400::/48]; R_DKIM_ALLOW(-0.20)[hotmail.com:s=selector1]; MIME_GOOD(-0.10)[text/plain]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:8075, ipnet:2a01:111:f000::/36, country:US]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[hotmail.com]; MLMMJ_DEST(0.00)[questions@freebsd.org]; RCVD_TLS_LAST(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; DWL_DNSWL_NONE(0.00)[hotmail.com:dkim]; FROM_HAS_DN(0.00)[]; DKIM_TRACE(0.00)[hotmail.com:+]; FREEMAIL_FROM(0.00)[hotmail.com]; TO_DN_NONE(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4ScTFN4DKXz4Y7f X-Spamd-Bar: + On 11/24/23 10:43, Matthew Seaman wrote: > On 24/11/2023 15:31, mike tancsa wrote: >   BTW, does FreeBSD upgrade from 13 to 14 do a zpool upgrade automatically >> or do you have to do that step manually ? >> >>      ---Mike > > No, the system upgrade process very carefully does not do a zpool > upgrade, because that would make it impossible to back-out a botched > upgrade. > > Before doing `zpool upgradez be aware that you will need to update your > boot blocks or efiboot partition (whichever mechanism your machine uses) > _before_ updating the zpool, or you will render your machine unbootable. > > Also, for maximum recoverability, be very careful to create and make > backups of zpool including all your boot environments. > > So the suggested sequence of events should be something broadly like: > > * Upgrade system from 13 to 14 by whatever means you prefer, but you are > strongly advised to create a new boot environment for FreeBSD 14 and > also keep the FreeBSD 13 B.E. available for the time being. Backups are strongly advised. Boot environments (=snapshots) and snapshots are a cheap imitation by comparison but get users past most problems without having to go through a 'restore from backup' and 'may' be quicker by comparison. Backups get you past all the same problems and the rest except for backup corruption/failure (backup testing+multiple backups fights this). Snapshots are nearly instant to create, simple to delete, and only take a bit more disk space than the newly written blocks after such snapshots are made so having them is good if not too tight on free space. > * Do whatever testing and qualification you require until you are > confident the FreeBSD 14 upgrade hasn't resulted in bugs or regressions > for your use-case.  At minimum, just use FreeBSD 14 for a few days and > look out for any problems. > > * Once you're sure you're never going to need to revert back to FreeBSD > 13, update the bootblocks / efiboot to the version from FreeBSD 14. The new boot loader gains knowledge of how to access the new ZFS pool feature sets but does not lose knowledge of how to access the old ones. You can continue to use a new loader just fine if you do go back. This step is safe to do sooner; if there are any bugs in the new boot loader, you will not find them until this step. If a new boot loader had a bug, you would have to install an older, or newer (fixed) boot loader anyways, and probably by booting from separate media as I suspect you found the issue by not being able to boot. > * Now you can apply the `zpool upgrade` This will make any FreeBSD 13 > Boot Environments you may have unusable, so those can be deleted. Boot environments do not contain the booted copy of the boot loader as zfs does not contain the booted copy. Booting takes place from non zfs sections either being mbr bootblocks or efi's fat filesystem bootblocks. Neither of those areas is ever a ZFS pool. The kernel (well, just its zfs module) may not be happy but you could always give it an install of sysutils/openzfs. It is easiest to install such programs while the discussed system boots, so before the pool upgrade. Not doing so would require installing the package/port when booted from separate media. Further bootloader updates need to come from a boot loader that understands the newer pool features; installing a bootloader from FreeBSD media that contains that same version, or newer, of ZFS is 'usually' adequate but there can be times where pool features exist that are not part of a boot loader yet. > For updating the bootblocks on a MBR system, see gptzfsboot(8) and the > 'bootcode' subcommand of gpart(8). > > For updating efiboot, see efibootmgr(8) and the 'Upgrading from Previous > Releases of FreeBSD' in the release notes: > https://www.freebsd.org/releases/14.0R/relnotes/ > > Now, it may or may not be possible to revert an upgrade to the zpool -- > some property settings can be removed if they haven't been used yet, > some can't.  So trying to revert a `zpool upgrade` is not something you > should count on being able to do.  Take a look at the zpoolprops(7) man > page for the details. If you need that revert feature, you need to use zpool-checkpoint(8) instead of snapshots. Presuming no major destruction, you can then roll a pool back to a previous state including undoing new properties being activated+used. This was how pools with block cloning corruption were fixed without restoring from backup. It is a different workflow than snapshots and comes with some limitations. Checkpoints and shapshots are not a replacement for proper backups. >     Cheers, > >     Matthe