From nobody Fri Jan 10 15:07:32 2025 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4YV4m238t3z5kTmg for ; Fri, 10 Jan 2025 15:08:18 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-yb1-xb2a.google.com (mail-yb1-xb2a.google.com [IPv6:2607:f8b0:4864:20::b2a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4YV4m14Zhtz531s for ; Fri, 10 Jan 2025 15:08:17 +0000 (UTC) (envelope-from mavbsd@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-yb1-xb2a.google.com with SMTP id 3f1490d57ef6-e549dd7201cso3787599276.0 for ; Fri, 10 Jan 2025 07:08:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1736521697; x=1737126497; darn=freebsd.org; h=content-transfer-encoding:in-reply-to:autocrypt:from :content-language:references:to:subject:user-agent:mime-version:date :message-id:sender:from:to:cc:subject:date:message-id:reply-to; bh=E/bhul6vPBckm6WVbw7ytK4Nsy47gyOr7QJ5awoQmv8=; b=njlzF72zMC2ly4XTguhgXPm0h0wvIrBrVTAcm1ra+fHQWg3nkmLeDMWV/uUdp7sSjH zZstdUrG+s3PUdmIKOky4iVbkGReSV9Abbsvg7nD5FyAjsmkaeeA7WizJWsNlb1qEmjP MKcZQFzUq+rvMWfvl5HB/rJhq0F485sV9pjYT0JyIOmdrE83HUSkKjZy1jYHnkQpleqI KlDaW0oFrkF8s6W61ZFahVIGHPm7BlNeWAR4uO1hj/Ksksflq4RyZSBQdDYeOQhIj0rr y64/PBbJlIQDkyNlvZ/0eenmoBFvG3uuauyMzx8Cm86fHGqSmWGxyrvMxIGnO7unyHt0 20PA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1736521697; x=1737126497; h=content-transfer-encoding:in-reply-to:autocrypt:from :content-language:references:to:subject:user-agent:mime-version:date :message-id:sender:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=E/bhul6vPBckm6WVbw7ytK4Nsy47gyOr7QJ5awoQmv8=; b=TGrDPJYvwKii57OlBI31O9ALOySo0S4tDAOoeHCD5HiACwV5tcDWIuFDMEOQoOqYIA EQRUE+qk5+QcaY6kpilcThMredGd92lev0MuNv5lRiv/K0xVoTTbbhJ8tTMl92Vp1Dvm HQyRMXB9gpAoLsXzwEm8DHIvrp6c/27qpQ5HaS7hqN7TMfkk2oXVkAgP5hAxq/+mdmPp euRkkdCgltQLg0rILUYyrI07C59dTQclPLVJK+dktxj7xZmW8zH5O4VWi0BSDnHEJVq8 R0dR8nSkPwYDByMJ4/8M706pMXofkViZmzdD/W0RkOojRMy2k8dQtWzkma9oBzEB6ylA aX1w== X-Forwarded-Encrypted: i=1; AJvYcCW0lYjK30JqdTYsBxR/o8tofwHUEenZBVtWql0xYzozlO+/7Dzy5qMa/QKA1KBTr7aZqpFg5Y6aEH+1/h7gU1w=@freebsd.org X-Gm-Message-State: AOJu0YwaCEdXMxCZhLuqAK2K+G8CuHHpnGFjn6p864y8Ri+1GQoWAQyU 1Z/ITa2q0wIjLkUmONijr3FFjPWEJ+J114idvPFyDDjzgrSO3nxFDcYWsw== X-Gm-Gg: ASbGncsUwEVfFa08GjzdEAwo5kZgSdepFxqFWR/3rj+mei6QCj8TR0w/SBQkC/vUEy1 tymu3coMc1kwuA0b11xxw4wMuLjmcacL04ST6ZgMH+ZvjP2x+0wJv01c0WMYKZoObUNCJXDC/ey mK9MORUNAQvjM2K7HqH5WaL6xvotlNvojZMhYOnU2Q0GvMJiyfNjM/PrtibFUPnKh0mGZe1SUox a7tk2dc3IzZ1163jjDWJvwQdl0SMDxz5NFvNM7PN6vkfq8Kc4YO1+lCm8S5c9gwEhgekLfFCXit wAumAsbf18C3P7XvakZWKZrV X-Google-Smtp-Source: AGHT+IGizuEnEo3cTxySWUfC/REvkJktv1YwAU/utvSI5HmWGulcj/4iTrJsoLsOw1fDdKrPqpQJ3w== X-Received: by 2002:a05:690c:7009:b0:6ee:ad00:f157 with SMTP id 00721157ae682-6f5312d3c04mr93100247b3.32.1736521696614; Fri, 10 Jan 2025 07:08:16 -0800 (PST) Received: from ?IPV6:2600:1700:3580:3560:a236:9fff:fe4f:c69a? ([2600:1700:3580:3560:a236:9fff:fe4f:c69a]) by smtp.gmail.com with ESMTPSA id 00721157ae682-6f546e31db1sm6562127b3.105.2025.01.10.07.08.15 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Fri, 10 Jan 2025 07:08:16 -0800 (PST) Message-ID: <79d3921a-a8cf-4daf-936e-6fc6f9634118@FreeBSD.org> Date: Fri, 10 Jan 2025 10:07:32 -0500 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: Panic testing ZFS raidz expansion feature. To: Maurizio Vairani , freebsd-current References: Content-Language: en-US From: Alexander Motin Autocrypt: addr=mav@FreeBSD.org; keydata= xsBNBFOzxAwBCADkPrax0pI2W/ig0CK9nRJJwsHitAGEZ2HZiFEuti+6/4UVxj81yr4ak/4g 9bKUyC7rMEAp/ZHNhd+MFCPAAcHPvtovnfykqE/vuosCS3wlSLloix2iKVLks0CwbLHGAyne 46lTQW74Xl/33c3W1Z6d8jD9gVFT/xaVzZ0U9xdzOmsYAZaAj4ki0tuxO9F7L+ct9grRe7iP g8t9hai7BL4ee3VRwk2JXnKb7UvBiVITKYWKz1jRvZIrjPokgEcCLOSlv7x/1kjuFnj3xWZU 7HSFFT8J93epBbrSSCsYsppIk2fZH41kaaFXsMQfTPH8wkeM6qwrvOh4HiQM08R+9tThABEB AAHNIUFsZXhhbmRlciBNb3RpbiA8bWF2QEZyZWVCU0Qub3JnPsLAlwQTAQoAQQIbAwULCQgH AwUVCgkICwUWAwIBAAIeAQIXgAIZARYhBOmM88TmnMPNDledVYMYw5VbqyJ/BQJiOjayBQkU Kg0mAAoJEIMYw5VbqyJ/wxUIANAqbfF6tgjgdWk4c8yE0HNG+ptVOZp/wszRZ8olC0rgfK4S sND2Y+bP1fvkG1a+U1JRZzYt1s2IyIoIX6gkriUnX7VVOjcqyZ2QjKxxgACmDGoYC3c/ZvfF ysrqZ/eB0U6yp1AHQ7MCwmDNFHQbh7JhQ/pnG1NYpw/8splYfwYKhbDNyzCqOvk7WAyOJV7v TbTCF40jLzCUpyjOJj8HkdbGZsBACr7KF7kfVVq3tVLXY+NfzVKQoAs+LwfDqe8m0nnCBqU8 nNZ76normAp2z2cclAt2UCaMXnUwOLf0dj4daDG41vb+4jXTxm8Fksfj1NflVjgFcpd4FC4a Q8hd89fOwE0EU7PEDAEIAOZgWf2cJIu+58IzP2dkXE/urj3tr4OqrB/yHGWUf71Lz6D0Fi6Z AXgDtmcFLGPfMyWuLAvSM+xmoguk7zC4hRBYvQycmIhuqBq1jO1Wp/Z+lpoPM/1cDYLn8Flv mI/c40MhUZh345DA4jYWWaZNjQHUWVQ1fPf595vdVVMPT/abE8E5DaF6fSkRmqFTmfYRkfbt 3ytU8NdUapDcJVY7cEP2nJBVNZPnOIObR/ZIgSxjjrG5o34yXoqeup8JvwEv+/NylzzuyXEZ R1EdEIzQ/a1nh/0j4NXtzZEqKW4aTWlmSqb6wN8jh1OSOOqkYsfnE3nfxcZbxi4IRoNQYlm5 9R8AEQEAAcLAfAQYAQoAJgIbDBYhBOmM88TmnMPNDledVYMYw5VbqyJ/BQJiOjbIBQkUKg08 AAoJEIMYw5VbqyJ/rXwH/2UaH7Z7893+uEPo20gJkw94xDw5Fji9M8pLNpfiF7dKXfJMUe2T 0J3rHZaMlShy6ImDc/Iketxq+KvBWa4mWajEZcxFrevhuQe2ALO+GabvT2p0++L4QgE+WXs3 lwask4wrc4f/aRBHKWWgXWeVwc3OuTchq4O5AYxzgjyEmwZshrdN5szpzNg6+vFO4NWiMhlv eDULjtXEqXJJc2weIW0RpUIfCp7YLVC+Ff1j6+7DfeiM9WqWXPHzmKatwWwlk8rvDMMZ3gSy wXL32LpWKU76bIWxB6w1uykDk643swZTG0XyoOZgYH6a8931y06Jng50XARXIYm8+LgfpTMW pNk= In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4YV4m14Zhtz531s X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] Hi Maurizio, I was able to reproduce it on a real hardware. The critical points are that vdev should have ashift > 9 and it should be a debug build. This patch fixes it for me: https://github.com/openzfs/zfs/pull/16942 . On 10.01.2025 03:33, Maurizio Vairani wrote: > I'm using vm-bhyve-1.5.0_1. The vm-byve package is configured correctly. > > # vm iso > https://download.freebsd.org/snapshots/amd64/amd64/ISO-IMAGES/15.0/FreeBSD-15.0-CURRENT-amd64-20250109-4c89d59e0cda-274641-bootonly.iso > # vm create fbsd15-13 > # cd /mnt/pool2tb/vm/fbsd15-13 > In fbsd15-13.conf: > memory=2G > # vm install fbsd15-13 > FreeBSD-15.0-CURRENT-amd64-20250109-4c89d59e0cda-274641-bootonly.iso > # vm console fbsd15-13 > Install the OS and switch off the VM. > # truncate -s 10G disk1.img > # truncate -s 10G disk2.img > # truncate -s 10G disk3.img > # truncate -s 10G disk4.img > lines added in fbsd15-13.conf: > disk1_type="virtio-blk" > disk1_name="disk1.img" > disk2_type="virtio-blk" > disk2_name="disk2.img" > disk3_type="virtio-blk" > disk3_name="disk3.img" > disk4_type="virtio-blk" > disk4_name="disk4.img" > # vm start fbsd15-13 > # vm console fbsd15-13 > In the VM: > # zpool create tank raidz1 vtbd1 vtbd2 vtbd3 > # zpool attach tank raidz1-0 vtbd4 > panic: VERIFY(vd == vd->vdev_top) failed > > cpuid = 0 > time = 1736497428 > KDB: stack backtrace: > db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame > 0xfffffe005469f820 > vpanic() at vpanic+0x136/frame 0xfffffe005469f950 > spl_panic() at spl_panic+0x3a/frame 0xfffffe005469f9b0 > zio_vdev_io_start() at zio_vdev_io_start+0x63a/frame 0xfffffe005469fa00 > zio_nowait() at zio_nowait+0x10c/frame 0xfffffe005469fa40 > vdev_check_boot_reserve() at vdev_check_boot_reserve+0x7a/frame > 0xfffffe005469fa70 > spa_vdev_attach() at spa_vdev_attach+0x712/frame 0xfffffe005469faf0 > zfs_ioc_vdev_attach() at zfs_ioc_vdev_attach+0x75/frame 0xfffffe005469fb30 > zfsdev_ioctl_common() at zfsdev_ioctl_common+0x49a/frame 0xfffffe005469fbd0 > zfsdev_ioctl() at zfsdev_ioctl+0xfb/frame 0xfffffe005469fc00 > devfs_ioctl() at devfs_ioctl+0xd1/frame 0xfffffe005469fc50 > vn_ioctl() at vn_ioctl+0xb6/frame 0xfffffe005469fcc0 > devfs_ioctl_f() at devfs_ioctl_f+0x1e/frame 0xfffffe005469fce0 > kern_ioctl() at kern_ioctl+0x286/frame 0xfffffe005469fd40 > sys_ioctl() at sys_ioctl+0x12f/frame 0xfffffe005469fe00 > amd64_syscall() at amd64_syscall+0x158/frame 0xfffffe005469ff30 > fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe005469ff30 > --- syscall (54, FreeBSD ELF64, ioctl), rip = 0x2f2054f58cca, rsp = > 0x2f2048e41cf8, rbp = 0x2f2048e41d60 --- > KDB: enter: panic > [ thread pid 999 tid 100184 ] > Stopped at      kdb_enter+0x33: movq    $0,0x10538d2(%rip) > db> -- Alexander Motin