From nobody Mon Apr 11 15:37:27 2022 X-Original-To: freebsd-xen@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id ECCBA1AB5B7C for ; Mon, 11 Apr 2022 15:37:52 +0000 (UTC) (envelope-from prvs=09308b1b0=roger.pau@citrix.com) Received: from esa4.hc3370-68.iphmx.com (esa4.hc3370-68.iphmx.com [216.71.155.144]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx1.hc3370-68.iphmx.com", Issuer "HydrantID Server CA O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KcXzx5zGjz3pPN for ; Mon, 11 Apr 2022 15:37:49 +0000 (UTC) (envelope-from prvs=09308b1b0=roger.pau@citrix.com) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=citrix.com; s=securemail; t=1649691469; h=date:from:to:cc:subject:message-id:references: content-transfer-encoding:in-reply-to:mime-version; bh=noV/yhcMs/+Ed0pmkXczXIHazppoE6s8rAPknsISibo=; b=PVSYuEbdHREK7pjQIKWm+I0dB6r2v6Nafdb3eUD1oOeKE0T+Ce2Qj4p6 EZYqxSScTffhfQVyygz5jGeawpt0eQzIiVCyZ5IpnXM97CD+mmqJeXIQt JpcEBLVUtQncHnVwft0FncvmvJMJYESteH4NZmPhQxlzdrDOZmhA938Yi Q=; X-SBRS: 5.1 X-MesageID: 70968029 X-Ironport-Server: esa4.hc3370-68.iphmx.com X-Remote-IP: 162.221.156.83 X-Policy: $RELAYED IronPort-Data: A9a23:ti6lr6yTygBtK5GnCTh6t+c0xirEfRIJ4+MujC+fZmUNrF6WrkUPz zZOWmvXM//cZGTxf9x1YYW380sGvpXWzIBlTldq+SAxQypGp/SeCIXCJC8cHc8zwu4v7q5Dx 59DAjUVBJlsFhcwnj/0bv656yMUOZigHtIQMsadUsxKbVIiGX9JZS5LwbZj2NY02IHhWWthh PupyyHhEA79s9JLGjp8B5Kr8HuDa9yr5Vv0FnRnDRx6lAe2e0s9VfrzFonoR5fMeaFGH/bSe gr25OrRElU1XfsaIojNfr7TKiXmS1NJVOSEoiI+t6OK2nCuqsGuu0qS2TV1hUp/0l20c95NJ NpljoOxUR4qOLX1scMcUTYJCy1aI4lA0eqSSZS/mZT7I0zudnLtx7NlDV0sPJ1e8eFyaY1M3 aVGcnZXNEnF3r/ohuLgIgVvrp1LwM3DJoQQt2sm1TjEJf0nXYrCU+PB4towMDIY2ZgfQ6aGP ZtxhTxHXTeaPD9wHlAuJ8gvsMWumHnUQgJqgQfAzUYwyzeKl1EguFT3C/LfZ9yQQtp9mEiSr WvCuWPjDXkyOsaSxDCe/je8i+nnkzn2VYgJGPu/7PECqE+eynELEwwNfVS+qPi9zEW5Xrpix 1c8o3R06/JorQryE4e7D0bQTGO4UgA0YMVRC/Q57hm0443V4SnIHmQgUBpHQYlz3CMpfgAC2 liMltLvIDVgtryJVH6QnoupQSOO1Ts9djFbO3JdJecRy5y6+dxo0EqTJjp2OPTt5uAZDw0c1 NxjQMIWo7wIxfAG2Kyglbwsq2L9/8OZJuLZC+i+Y45E0u+bTNP+D2BLwQKChRqlEGp+ZgPc1 EXoY+DEsIgz4WilzURhutklErCz/OqiOzbBm1NpFJRJ323zpy/9JN4LvWghdR0B3iM4ldjBO hG7hO+szMULYCvCgVFfPupd9PjGPYC/TI+4B5g4n/JFY4RrdR/vwc2dTRX44owZq2B1yftXE c7CKa6EVC9GYYw6nGveb7pMitcDm3FhrV4/sLimlnxLJ5LFPyXLIVrEWXPTBt0EAFSs/F2Oo 4kCbZPTo/idOcWnChTqHUcoBQliBVAwBIzsqtwRceiGIwF8H3omBeOXyrQkE7GJVYwP/gsU1 hlRgnNl9Wc= IronPort-HdrOrdr: A9a23:kj9nw6NsymuVs8BcTyX155DYdb4zR+YMi2TDiHoedfUFSKOlfp 6V8MjztSWVtN4QMEtQ/+xoHJPwPE80kqQFnbX5XI3SJjUO3VHIEGgM1/qG/9SNIVybygcZ79 YeT0EcMqyBMbEZt7eD3ODQKb9Jq7PrgcPY59s2jU0dNj2CA5sQnjuRYTzra3GeKjM2YqbQQ/ Gnl7R6TnebCD8qR/X+IkNAc/nIptXNmp6jSRkaByQ/4A3LqT+z8rb1HzWRwx9bClp0sPof2F mAtza8yrSosvm9xBOZ/2jP765OkN+k7tdYHsSDhuUcNz2poAe1Y4ZKXaGEoVkO0auSwWdvtO OJjwYrPsx15X+UVmapoSH10w2l6zoq42+K8y7vvVLT5ejCAB4qActIgoxUNjHD7VA7gd162K VXm0qEqpt+F3r77WrAzumNcysvulu/oHIkn+JWpWdYS5EiZLhYqpFa1F9JEa0HADnx5OkcYa ZT5fnnlbZrmG6hHjPkVjEF+q3vYp1zJGbLfqE6gL3V79AM90oJinfxx6Qk7wA9HdwGOt15Dt //Q9ZVfYF1P7wrhJ1GdZI8qOuMeyXwqEH3QSqvyWqOLtByB5uKke+x3IkI X-IronPort-AV: E=Sophos;i="5.90,252,1643691600"; d="scan'208";a="70968029" ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Lghbei/Y4nS2i1DM+4MJ3XGh8W2UnGF/Zly0pJSUatSwYD1tXmxm0s412l9Bb3LOKEWZaM2tRYG/G3mxcocUOg1ux+7qKa02gT6ouaV/sH4likHDgsYOKjVgc4REJKniRm+VKb242YrvY8CduMhzHjcnFQ8plDLt0wW+0J8QBk5fYNz+DP0kkqZNN+KGlpJMlm9o4aTZbZmp+oNN4u6sqe6USdYTHV3HLOe4xMuiCBTOoFfcxfMnjt+99PVSQzChqF+17EcfmATHJYgaPMEvw2F5p5hGPVkyBg1X/gcZ3oBodNwqwsAljUbZX8QI2gCRtKW2hMFjsoZRRVc5Mo07Mg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=9a59LEUBHWb9tzmlre4kWA+us+lrI3Y5j2LKd+yy8+0=; b=kQoFuFb2HceAk/ryAUS/dHAfrBBrwcr9rBUBrEhIn8yt1AguC0beqsUcjco3D5yuVpdlJnR5nW/XOMiQVDemidkL3/EMh15Vjz8z2Bo6byvbdmpzTL7o8eRjQ9PrGzofr+5d1+VkKVyksuQs2qas8WHWGnBgpNMaJ1oaZJMhUdZ9oEOygVTIDCwpNwnLGkah0MP3ugazLq/NV9ipVcFolUH4chUBTQjwGx0QKp2nTJKWdVKcC+jVGW/2rmgITtpRbtVHwmgAkrsXsAH2cASqv4sBZZimpkLCbYROeRowe5Rly0nL0n7Ps0OJaXeFhnbBzDls+uyOEhRQKnWHc6lY7Q== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=citrix.com; dmarc=pass action=none header.from=citrix.com; dkim=pass header.d=citrix.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=citrix.onmicrosoft.com; s=selector2-citrix-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=9a59LEUBHWb9tzmlre4kWA+us+lrI3Y5j2LKd+yy8+0=; b=ujRXXXZdeAEzghPigG/pw8trtvkgkx1U2Fbpo+r9t60y3Xsnw8a2YETA1BduTATxc2HCHrNgblpti8ptGf0jmQe8E74NV8sggEU8bV92tC/UKoTegVTkPvrApJ5PsFbGuAVyuudjuC10VpT8ckZL1cb4HLgPTAHSA4Scc/WeDlI= Date: Mon, 11 Apr 2022 17:37:27 +0200 From: Roger Pau =?utf-8?B?TW9ubsOp?= To: Ze Dupsys CC: , Subject: Re: ZFS + FreeBSD XEN dom0 panic Message-ID: References: <4da2302b-0745-ea1d-c868-5a8a5fc66b18@gmail.com> <48b74c39-abb3-0a3e-91a8-b5ab1e1223ce@gmail.com> <22643831-70d3-5a3e-f973-fb80957e80dc@gmail.com> <209c9b7c-4b4b-7fe3-6e73-d2a0dc651c19@gmail.com> <1286cb59-867e-e7d0-2bd3-45c33feae66a@gmail.com> Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <1286cb59-867e-e7d0-2bd3-45c33feae66a@gmail.com> X-ClientProxiedBy: LO4P123CA0362.GBRP123.PROD.OUTLOOK.COM (2603:10a6:600:18e::7) To DS7PR03MB5608.namprd03.prod.outlook.com (2603:10b6:5:2c9::18) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-xen List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-xen@freebsd.org X-BeenThere: freebsd-xen@freebsd.org MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: ca5bafaa-a488-4843-b3a4-08da1bd131e8 X-MS-TrafficTypeDiagnostic: MWHPR03MB2496:EE_ X-Microsoft-Antispam-PRVS: X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 0nmnB17pqYGbuPqs+p7C/fEnuopxI1eV98cedItFV93TRh5hrTQL5nEur4DBX41OevRN17JQxNqz3AtvD/seF5bqOBe7T9Z6e+BZ9bjvzqCf+zwlKodxZ6LKSB8tRYn85ltVSz/P6Ql0mbWmNqv1c64AUl3HoJ0e9CuCf9de7qTUEZIai+JljOOJkYvH15R9yHJD7vScqegVTxaM0IyGcWiBx62nYeKpon6Mc9cpBV1vxo2VfFbNhHKZ7DPVD3dZEY3vqHYKCBnL1T7FTTwZQJ1HEPBwXeKCy3qmiAlePN5TqjYyM5XmkRqHMFaWQNTkIz4UxApVyFvxuNiGSq232YiLuMBCAVyylT07w9mUcZ7gSFohyDNWMtK5O4L1gIyzrEWUs5wwwj963SLajI5YDw+K5gci9YRoCr010hVRLV5bM+Qcdu2CxfcoMP9ddmLvY5WnMapGnfPu27n7h5cWsubECO58R1HUud6tdU/xLfzq5KwHqoAvEQAmVfJEf/Ha+J3JzJl0bpKVo1zSx7QKiiWpNwO5o1QwBf+gLTiGXE2wL7o9gDX9pVPV9tmOgkP9pjibrL5aHxh8LD+buMsCEM4O0kco4sA/vw859zsAzUADTCBRWJyy8qMNtoJZRgCcGyOIW4mc+sHcSih3hxSGUA7nXysIzrnl44wXMlE/Y8wnCLn62mhhEBDll6fS18OK253gVLrS2hNIfQPnR0MxikqRXWh3socLZX3xRHsPi6s= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:DS7PR03MB5608.namprd03.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230001)(7916004)(4636009)(366004)(186003)(83380400001)(86362001)(26005)(2906002)(8936002)(85182001)(6512007)(9686003)(6666004)(6506007)(316002)(33716001)(6486002)(966005)(5660300002)(4326008)(66946007)(38100700002)(66476007)(66556008)(82960400001)(6916009)(508600001)(8676002);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?T1BQT3R2U0xMSGo1M0lKWGFEd29WaTc4NnoybENCbWJSUmJvYjZtYXE1aVhP?= =?utf-8?B?Y25MSzd6c0RWaFNJVWNjajUyUDBGWWdnTVZ5eVVmUEhEZ0xyYUN0dHJkK1No?= =?utf-8?B?MkdTYVF3aFNmUEo5d2tkUW1JTlNCY21PUHJVVlNYalpBRnhYendNNy8zRVFE?= =?utf-8?B?ZklnUk1uVXhGQ0JibEg4cWY3RTlWUys0dWxVZStWdXBKSHg3bHhpZkVWTUZz?= =?utf-8?B?QWRGR1pZTnVkWlJCd3RvS1BoU3g4STNnbjVZa3JwYjYvRElSaDM0bS9UaWps?= =?utf-8?B?WWRKaE52Q0lVOVV2a01RdlFtSC9CNklnWmtsWm1UWFgwdjNYak85anY4cnBT?= =?utf-8?B?a2xUWjk0MTRIYVNUY0FuQmRNMFNWVWtWeHAvVnh2K3BOSmlyT2tTaVcrUWdI?= =?utf-8?B?VmZsZVhzaVJJNlppTnBpdHRYOGJ6UzRqRmN4NVZaUzFCQVRUVThnbUU2bWd0?= =?utf-8?B?TFpYcm0vL0s5WjVGOXFuazBLY2NqOVlMWHZQSnNPQW5sc1V2b3VIb0JhZnJL?= =?utf-8?B?U2lnY1ROc2JCRDhwc2pnc1VtNTVJUnRYMHAxQ09rRkQ4cDFueXE3M21QRGR4?= =?utf-8?B?bXN2ellYUEZWU3I1bjB1NTg2NVRSd1RETm5Tb1hoc0R2cXM1UlhER3Z5bXhI?= =?utf-8?B?Ukd5Z0NhekRNSG45RHZ1eHNBbzJMKzQzanFMNko2eWVOMXBhekdNbUIwZFhw?= =?utf-8?B?Sit1TXVmVzhEUkVJWm5YV2hZdUFhZmlrL09UZTVKS0RpTnNtcTF2TVhidVEr?= =?utf-8?B?eEJOR3FsdFRqR0o3a0V0NEJCeExnNXlJRXhHOTVlTElXTDZrYkF5SktzWUFu?= =?utf-8?B?UUR4a0t6bGkxQjBOeXlXdDdMQVZ4Umh5U2xoVU4zYVltUVE1bkVxOVF4S3pJ?= =?utf-8?B?Smp1Z2tKaFRic3VsaHdRUjlHWmErK3BSUlo2RldxTGhXUlVGSlFlSDBYd1h0?= =?utf-8?B?S09lcFBXUmRGZUkxSjc2Q28xNW5SR1NLQ1ROTXFnVDBHN1hTdUxlUUxncHJT?= =?utf-8?B?cUtrdHNnWWV5dEo1YXplUDdhNDVLdW9SYWc1WU16SDhWOWFRTWJjOGRuY0Rx?= =?utf-8?B?L3hjbTArais0SktkbE9CYmwvYTg0eHpMNmNYTmZLSEo2V2N3ZU9xU1E3bWxv?= =?utf-8?B?QkUvUVRvQmExMGIrcjRSUDc0a0VFVHpHL2hLcjJKdCt6RDd5a0hScDhQdGl6?= =?utf-8?B?UVJjVUdqMjZwcWRWODRjTEFvUUJpbFdJZEpGN1hWWHNFUDM5dFNjc2sxcVQv?= =?utf-8?B?VEFyK1ZGT3orTEovd2lyQytURkI1dUNraElUN0J5Y3RUazdPd3RSOTJEY0hN?= =?utf-8?B?cTRKaHBxMGhyY3YwdFdaazZJYTJ1QVBlVE1aWUhlNGVDemZQMXN6d3ZqbjVZ?= =?utf-8?B?ZnNuVkpuTjJpTXB5eWFUMEZLUjY5Nm1tR2NYcHRqVUEyVGVXVGRhZGlMamUv?= =?utf-8?B?SFV4Szh5azlLQVEzdllxRm52NGxhdWpVUDhKSjA5UFpWNnZ2UTdwY2V6WXFG?= =?utf-8?B?N2E2VllUZHIvYnFsMHdRVXZZQnBIcTVEbkFKRzVYWDdCQzgwcDY1VTdvbm9D?= =?utf-8?B?ZjMwUnVWdmwzUG1HenpIY2NkcEx5aEVYemE2T1JJbnJQekJVYUdiTUxTUkJq?= =?utf-8?B?WlNzdktOQXRYRHRidW9ZRkxodWNyTk9OY2tzTWNHZXd6Z3I2a0pITEVsRTdq?= =?utf-8?B?RFhBa3pJTkZLVFIrUVc5STZnNCtub0c0YXF3NlhMMmMvK2xmbjVlUCsyNnlv?= =?utf-8?B?NjNjT2c3Zmo5WXJnRnJZakljcC9JZEJ0QW5QTG9kblNWR25LMXZ5SmczclRL?= =?utf-8?B?LysyRWpkdE1LS3dPaTV2cU9BV05obWNBR1EvWXRNSFlENk9VUUtQNFFOQnZn?= =?utf-8?B?ckdwOTdKWS9MVS8zd3VIZE5OM29hMEkvb3owWDhCOUxtelRzTkJvQmxROXdT?= =?utf-8?B?dk1mSllJYjFxRGwwZjFaMC9JeVhKcUhUNUJvRzBYb1ZablQrTVpwOEp4UTlL?= =?utf-8?B?LzJXM2FDWmwwSURsYTJwOUNKWVo4VXdkNnR1NXM1YlBidUtSaENhbTgyL1pr?= =?utf-8?B?dTRVYW9VRWl0djVpTS9DbEUyN0k0b1FxQ3d0Vzg0SGw5M1FDelpRaW92bTVN?= =?utf-8?B?TDNwSDY2ckFoak42YlU3V0pRSkRUb0VJeDlaYkJjMzZSZm01b1RvSHU4ZGhm?= =?utf-8?B?NEZLQUdPVlo1elVtNklkSGQ0aW1pdXRBM3BvcTZySUFqQmx3TzZ3eTNSZXl4?= =?utf-8?B?QU5VZWh5d0ZWRm5VSXZRbFlROURTenIyNFhVcSsrL3V0TjVjYjNvUTBmV0Fm?= =?utf-8?B?enhOcjVlbVVGTWoxdTZhUHF2SWlhWVdtS2JBRDRNMjVRYW5xWmFwZ3VNVno2?= =?utf-8?Q?TadF76U572tXyBcc=3D?= X-MS-Exchange-CrossTenant-Network-Message-Id: ca5bafaa-a488-4843-b3a4-08da1bd131e8 X-MS-Exchange-CrossTenant-AuthSource: DS7PR03MB5608.namprd03.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 11 Apr 2022 15:37:32.7357 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 335836de-42ef-43a2-b145-348c2ee9ca5b X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: ft0FSYswT4UKN54Rn+s1xDP7ZktuENSI25CL0zwy9+p4+9wUYe4mL5KmHSI82GKRYYk+fyx2v1sGARP0m9HZIQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: MWHPR03MB2496 X-OriginatorOrg: citrix.com X-Rspamd-Queue-Id: 4KcXzx5zGjz3pPN X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=citrix.com header.s=securemail header.b=PVSYuEbd; dkim=pass header.d=citrix.onmicrosoft.com header.s=selector2-citrix-onmicrosoft-com header.b=ujRXXXZd; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=reject) header.from=citrix.com; spf=pass (mx1.freebsd.org: domain of "prvs=09308b1b0=roger.pau@citrix.com" designates 216.71.155.144 as permitted sender) smtp.mailfrom="prvs=09308b1b0=roger.pau@citrix.com" X-Spamd-Result: default: False [-5.59 / 15.00]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+exists:216.71.155.144.spf.hc3370-68.iphmx.com]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; DKIM_TRACE(0.00)[citrix.com:+,citrix.onmicrosoft.com:+]; RCVD_IN_DNSWL_MED(-0.20)[216.71.155.144:from]; DMARC_POLICY_ALLOW(-0.50)[citrix.com,reject]; NEURAL_HAM_SHORT(-0.94)[-0.941]; FREEMAIL_TO(0.00)[gmail.com]; RCVD_COUNT_ZERO(0.00)[0]; MIME_TRACE(0.00)[0:+]; R_MIXED_CHARSET(0.56)[subject]; ASN(0.00)[asn:16417, ipnet:216.71.154.0/23, country:US]; FROM_NEQ_ENVFROM(0.00)[roger.pau@citrix.com,prvs=09308b1b0=roger.pau@citrix.com]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[citrix.com:s=securemail,citrix.onmicrosoft.com:s=selector2-citrix-onmicrosoft-com]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; FORGED_SENDER_VERP_SRS(0.00)[]; DWL_DNSWL_LOW(-1.00)[citrix.com:dkim]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-xen]; MID_RHS_NOT_FQDN(0.50)[] X-ThisMailContainsUnwantedMimeParts: N On Mon, Apr 11, 2022 at 11:47:50AM +0300, Ze Dupsys wrote: > On 2022.04.08. 18:02, Roger Pau Monné wrote: > > On Fri, Apr 08, 2022 at 10:45:12AM +0300, Ze Dupsys wrote: > > > On 2022.04.05. 18:22, Roger Pau Monné wrote: > > > > .. Thanks, sorry for the late reply, somehow the message slip. > > > > > > > > I've been able to get the file:line for those, and the trace is kind > > > > of weird, I'm not sure I know what's going on TBH. It seems to me the > > > > backend instance got freed while being in the process of connecting. > > > > > > > > I've made some changes, that might mitigate this, but having not a > > > > clear understanding of what's going on makes this harder. > > > > > > > > I've pushed the changes to: > > > > > > > > http://xenbits.xen.org/gitweb/?p=people/royger/freebsd.git;a=shortlog;h=refs/heads/for-leak > > > > > > > > (This is on top of main branch). > > > > > > > > I'm also attaching the two patches on this email. > > > > > > > > Let me know if those make a difference to stabilize the system. > > > > > > Hi, > > > > > > Yes, it stabilizes the system, but there is still a memleak somewhere, i > > > think. > > > > > > System could run tests for approximately 41 hour, did not panic, but started > > > to OOM kill everything. > > > > > > I did not know how to git clone given commit, thus i just applied patches to > > > 13.0-RELEASE sources. > > > > > > Serial logs have nothing unusual, just that at some point OOM kill starts. > > > > Well, I think that's good^W better than before. Thanks again for all > > the testing. > > > > It might be helpful now to start dumping `vmstat -m` periodically > > while running the stress tests. As there are (hopefully) no more > > panics now vmstat might report us what subsystem is hogging the > > memory. It's possible it's blkback (again). > > > > Thanks, Roger. > > > > Yes, it certainly is better. Applied patch on my pre-production server, have > not had any panic since then, still testing though. > > On my stressed lab server, it's a bit different story. On occasion i see a > panic with this trace on serial (can not reliably repeat, but sometimes upon > starting dom id 1 and 2, sometimes mid-stress-test, dom id > 95). > panic: pmap_growkernel: no memory to grow kernel > cpuid = 2 > time = 1649485133 > KDB: stack backtrace: > #0 0xffffffff80c57385 at kdb_backtrace+0x65 > #1 0xffffffff80c09d61 at vpanic+0x181 > #2 0xffffffff80c09bd3 at panic+0x43 > #3 0xffffffff81073eed at pmap_growkernel+0x27d > #4 0xffffffff80f2d918 at vm_map_insert+0x248 > #5 0xffffffff80f30079 at vm_map_find+0x549 > #6 0xffffffff80f2bda6 at kmem_init+0x226 > #7 0xffffffff80c731a1 at vmem_xalloc+0xcb1 > #8 0xffffffff80c72a9b at vmem_xalloc+0x5ab > #9 0xffffffff80c724a6 at vmem_alloc+0x46 > #10 0xffffffff80f2ac6b at kva_alloc+0x2b > #11 0xffffffff8107f0eb at pmap_mapdev_attr+0x27b > #12 0xffffffff810588ca at nexus_add_irq+0x65a > #13 0xffffffff81058710 at nexus_add_irq+0x4a0 > #14 0xffffffff810585b9 at nexus_add_irq+0x349 > #15 0xffffffff80c495c1 at bus_alloc_resource+0xa1 > #16 0xffffffff8105e940 at xenmem_free+0x1a0 > #17 0xffffffff80a7e0dd at xbd_instance_create+0x943d > > | sed -Ee 's/^#[0-9]* //' -e 's/ .*//' | xargs addr2line -e > /usr/lib/debug/boot/kernel/kernel.debug > /usr/src/sys/kern/subr_kdb.c:443 > /usr/src/sys/kern/kern_shutdown.c:0 > /usr/src/sys/kern/kern_shutdown.c:843 > /usr/src/sys/amd64/amd64/pmap.c:0 > /usr/src/sys/vm/vm_map.c:0 > /usr/src/sys/vm/vm_map.c:0 > /usr/src/sys/vm/vm_kern.c:712 > /usr/src/sys/kern/subr_vmem.c:928 > /usr/src/sys/kern/subr_vmem.c:0 > /usr/src/sys/kern/subr_vmem.c:1350 > /usr/src/sys/vm/vm_kern.c:150 > /usr/src/sys/amd64/amd64/pmap.c:0 > /usr/src/sys/x86/x86/nexus.c:0 > /usr/src/sys/x86/x86/nexus.c:449 > /usr/src/sys/x86/x86/nexus.c:412 > /usr/src/sys/kern/subr_bus.c:4620 > /usr/src/sys/x86/xen/xenpv.c:123 > /usr/src/sys/dev/xen/blkback/blkback.c:3010 > > With gdb backtrace i think i can get a better trace though: > #0 __curthread at /usr/src/sys/amd64/include/pcpu_aux.h:55 > #1 doadump at /usr/src/sys/kern/kern_shutdown.c:399 > #2 kern_reboot at /usr/src/sys/kern/kern_shutdown.c:486 > #3 vpanic at /usr/src/sys/kern/kern_shutdown.c:919 > #4 panic at /usr/src/sys/kern/kern_shutdown.c:843 > #5 pmap_growkernel at /usr/src/sys/amd64/amd64/pmap.c:208 > #6 vm_map_insert at /usr/src/sys/vm/vm_map.c:1752 > #7 vm_map_find at /usr/src/sys/vm/vm_map.c:2259 > #8 kva_import at /usr/src/sys/vm/vm_kern.c:712 > #9 vmem_import at /usr/src/sys/kern/subr_vmem.c:928 > #10 vmem_try_fetch at /usr/src/sys/kern/subr_vmem.c:1049 > #11 vmem_xalloc at /usr/src/sys/kern/subr_vmem.c:1449 > #12 vmem_alloc at /usr/src/sys/kern/subr_vmem.c:1350 > #13 kva_alloc at /usr/src/sys/vm/vm_kern.c:150 > #14 pmap_mapdev_internal at /usr/src/sys/amd64/amd64/pmap.c:8974 > #15 pmap_mapdev_attr at /usr/src/sys/amd64/amd64/pmap.c:8990 > #16 nexus_map_resource at /usr/src/sys/x86/x86/nexus.c:523 > #17 nexus_activate_resource at /usr/src/sys/x86/x86/nexus.c:448 > #18 nexus_alloc_resource at /usr/src/sys/x86/x86/nexus.c:412 > #19 BUS_ALLOC_RESOURCE at ./bus_if.h:321 > #20 bus_alloc_resource at /usr/src/sys/kern/subr_bus.c:4617 > #21 xenpv_alloc_physmem at /usr/src/sys/x86/xen/xenpv.c:121 > #22 xbb_alloc_communication_mem at > /usr/src/sys/dev/xen/blkback/blkback.c:3010 > #23 xbb_connect at /usr/src/sys/dev/xen/blkback/blkback.c:3336 > #24 xenbusb_back_otherend_changed at > /usr/src/sys/xen/xenbus/xenbusb_back.c:228 > #25 xenwatch_thread at /usr/src/sys/dev/xen/xenstore/xenstore.c:1003 > #26 in fork_exit at /usr/src/sys/kern/kern_fork.c:1069 > #27 > > > There is some sort of mismatch in info, because panic message printed > "panic: pmap_growkernel: no memory to grow kernel", but gdb backtrace in > #5 0xffffffff81073eed in pmap_growkernel at > /usr/src/sys/amd64/amd64/pmap.c:208 > leads to lines: > switch (pmap->pm_type) { > .. > panic("pmap_valid_bit: invalid pm_type %d", pmap->pm_type) > > So either trace is off the mark or message in serial logs. If this was only > memleak related, then it should not happen when dom id 1 is started, i > suppose. That's weird, I would rather trust the printed panic message rather than the symbol resolution. Seems to be a kind of memory exhaustion, as the kernel is failing to allocate a page for use in the kernel page table. I will try to see what can be done here. Thanks, Roger.