From nobody Sat Mar 26 14:38:29 2022 X-Original-To: freebsd-xen@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 615DC1A3467F for ; Sat, 26 Mar 2022 14:38:53 +0000 (UTC) (envelope-from prvs=077da0f8a=roger.pau@citrix.com) Received: from esa2.hc3370-68.iphmx.com (esa2.hc3370-68.iphmx.com [216.71.145.153]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx1.hc3370-68.iphmx.com", Issuer "HydrantID Server CA O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4KQhRJ21slz3j7v for ; Sat, 26 Mar 2022 14:38:52 +0000 (UTC) (envelope-from prvs=077da0f8a=roger.pau@citrix.com) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=citrix.com; s=securemail; t=1648305532; h=date:from:to:cc:subject:message-id:references: content-transfer-encoding:in-reply-to:mime-version; bh=3+GmxL8ZtcD+6f3PEzqPUXFCC5eeh6hjPHv+5feZUJA=; b=Gd48kh88h9P0BEhi/QaM7/zbY6B91uGceEDmME3ytyMmrn/seIIYKIA4 bpxOPcSsLClOwxZmftrkzsrp26JbyYGHOpDhK2bugQGWmEsZWTSwuhl8T UIN5Na/FAig4jBWT6LZe91OUNZ1lnt0LDNtVGLcDbGLy4caUhzlTfQ1Mn 8=; X-SBRS: 5.1 X-MesageID: 67252212 X-Ironport-Server: esa2.hc3370-68.iphmx.com X-Remote-IP: 162.221.156.83 X-Policy: $RELAYED IronPort-Data: A9a23:yUCstqIUr0otjR2JFE+RxpUlxSXFcZb7ZxGr2PjKsXjdYENS3mRWn WcbCm/QMvvfNGL2KNkjPo/goBwHvpHWyNJkHlZlqX01Q3x08seUXt7xwmUcns+xwm8vaGo9s q3yv/GZdJhcokf0/0vrav67xZVF/fngqoDUUYYoAQgsA148IMsdoUg7wbRh2dQ22YLR7z6l4 rseneWOYDdJ5BYsWo4kw/rrRMRH5amaVJsw5zTSVNgT1LPsvyB94KE3fMldG0DQUIhMdtNWc s6YpF2PEsE1yD92Yj+tuu6TnkTn2dc+NyDW4pZdc/DKbhSvOkXee0v0XRYRQR4/ttmHozx+4 Mh/toaaTCAEB6732+46axBCEAohHLITrdcrIVDn2SCS50jPcn+qyPRyFkAme4Yf/46bA0kXq 6ZecmpUKEne2aTmm9pXScE17ignBNPsM44F/Glp0BnSDOo8QICFSKLPjTNd9Glv3J0UR6+ED yYfQWZBbQnlbxhLBgsKJakBjMiwnzqjIzIN/Tp5ooJoujOOnWSdyoPFOsfVYNuVbcNblE2Ro iTB5WuRKh8AOdGV0jbA4n+qruHVkC7xQ45UE6e3ntZ4jVGO3ncCEzUZUFK6pb+yjUvWZj5EA xVKoGx09/F0rRH1CImmN/GlnJKalgMuWMB6FsoX0QK2iaDz2w+DBUNbbyEUPbTKq/QKbTAt0 1aImfbgCjpurKCZRBqhy1uEkd+hEXNLdDFfPEfoWSNAuoC++99r0nojW/45SMaIYsvJ9SYcK txghAw3nP0tgMECzM1XFniX0mv39vAlouPYjzg7v15JDCskPOZJhKTysDA3CMqsyq7AHzFtW 1Bex6CjABgmV83lqcB0aLxl8EuVz/iEKibAplVkAoMs8T+gk1b6I9wAuWwjeRk4aZxfEdMMX KM1kVoAjHO0FCH3BZKbnqrrU5h6pUQePYqNug/ogipmPcEqKV7vENBGbk+MxWH9+HXAYolkU ap3hf2EVC5AYYw+lWLeb75EjdcDm3BvrUuOFMuT50n2jtKjiIu9FO5t3K2mNbtisstpYWz9r r5iCid940gGCLSlOHiOq+b+7zkidBAGOHw/kOQOHsarKQt6AmAxTfjXxLIqYYt+mKpJ0OzP+ xmAtoVwkTITWVWvxd22V01e IronPort-HdrOrdr: A9a23:dDmdPqPLLDKjkMBcTyP155DYdb4zR+YMi2TDiHofdfUFSKClfp 6V8cjztSWUtN4QMEtQ/uxoHJPwO080kqQFnLX5XI3SJzUO3VHHEGgM1/qB/9SNIVyaygcZ79 YdT0EcMqyAMbEZt7eC3ODQKb9Jq7PmgcOVbKXlvg9QpGlRGt9dBmxCe2Cm+yNNNW177c1TLu vi2iMLnUvpRV0nKuCAQlUVVenKoNPG0LrgfB49HhYirC2Dlymh5rLWGwWRmk52aUIE/Z4StU z+1yDp7KSqtP+2jjfaym/o9pxT3P/s0MFKCsCggtUcbh/slgGrToJ8XKDqhkF/nMifrHIR1P XcqRYpOMp+r1vXY2GOuBPonzLt1T4/gkWSvmOwsD/Gm4jUVTg6A81OicZyaR3C8Xctu9l6ze Ziw3+Zn4A/N2KOoA3No/zzEz16nEu9pnQv1cQJiWZEbIcYYLhN6aQC4UJuFosaFi6S0vFqLA BXNrCc2B9qSyLbU5iA1VMfg+BEH05DUytue3Jy9PB8iFNt7TJEJ0hx/r1qop5PzuN5d3B+3Z W2Dk1ZrsA/ciYoV9MOOA4ge7rANoWfe2OEDIqtSW6XYZ3vfUi976LK3A== X-IronPort-AV: E=Sophos;i="5.90,213,1643691600"; d="scan'208";a="67252212" ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=HQbfqUQ8ULZkzJRldW6r7uSjCYRh6bpWL/hBQ8PlObmvpEvGgYYj0fo4rb/5is1/K1zo2kBct+hcUrJegRXT3MLyo98KlIsQwzvNnxNwN0GY2WE/FF0XhEVbf3JOU41vJjaMtnujq8sG2jxlPAnJA4rPQUY5mNstPjEas5Bq8W5ATrtN362blEOjPOPWn9+nuEq7SGCmLpA2fgZTMERBKHKaoY/LqH24BEpgA9sNQBFLoPEB1wiIYozgdN7w2OtnIwhQM9ogCxkJr8xPZ1h6A+sqBf9FIy0YyM4B5+GoaBrTpUZ6SbG/b1Ct2lz0MhCyyoLPOWFG31Eotf3eQdJVuA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=Rmbf3IjoWfpa8j3mCcp1Ww3XtuvBdGWCANx1M6Ra+NU=; b=SoTuaqnz04PG/myrHAxUGf2TITmYcS8j+qSs/gepQ8H52UYYEWOGCIzi/U0oTLNC/7XLyt1dCBxrfkOKDqjYfaZee/GUNt9Jt9CvBSw7ViQhxC0KkvbZTNK4LFa2k7y7EI+tVZFg7mxVx5tF0pMDGT/3uMP46yaeP1iCNUo+3/le8RdbCU7njob8o7w92ptly3LJQd055u2BjgOiiP/wnfPPQcla8vIOhbjiI8gvUeC/eBtkI1EP7aaZwzGi0jLyS8ZKRudWH5JZOiNUMbAlzUcVPFgCmo5xPBvffYFSFTaKupKNeiIGo+p44esfMUJNHL+w8jdroDS/YI2ZbDlpiQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=citrix.com; dmarc=pass action=none header.from=citrix.com; dkim=pass header.d=citrix.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=citrix.onmicrosoft.com; s=selector2-citrix-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Rmbf3IjoWfpa8j3mCcp1Ww3XtuvBdGWCANx1M6Ra+NU=; b=u3AeYTdtX+HpdOHXFvMsYoxfyq4H/TERzSgVfPIhaaKvrCa8LZOclMTAJRT62TxotRfvS8BLjJ4mpXmZcHVPjHh9DkFXbSNzRwAXuhI/KsooYmPxW6npr6P3zfgGHNwxxSNJl5PntR1w1ifLlqZNSdB/6zj1JRB01pWIYrkeL1w= Date: Sat, 26 Mar 2022 15:38:29 +0100 From: Roger Pau =?utf-8?B?TW9ubsOp?= To: Ze Dupsys CC: , Subject: Re: ZFS + FreeBSD XEN dom0 panic Message-ID: References: <088c8222-063a-1db5-da83-a5a0168d66c6@gmail.com> <639f7ce0-8a07-884c-c1cf-8257b9f3d9e8@gmail.com> <4da2302b-0745-ea1d-c868-5a8a5fc66b18@gmail.com> Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <4da2302b-0745-ea1d-c868-5a8a5fc66b18@gmail.com> X-ClientProxiedBy: MR2P264CA0017.FRAP264.PROD.OUTLOOK.COM (2603:10a6:500:1::29) To DS7PR03MB5608.namprd03.prod.outlook.com (2603:10b6:5:2c9::18) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-xen List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-xen@freebsd.org X-BeenThere: freebsd-xen@freebsd.org MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 5b7e48fe-d11a-499a-51c6-08da0f364e8c X-MS-TrafficTypeDiagnostic: DM6PR03MB5338:EE_ X-Microsoft-Antispam-PRVS: X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: J/Nkn7648SHZUIBZZ8giKUpVKZbvQeJ2HDGG8z6C/i0Jb2JpiYEHXQgLB06yJnQ4eoJajZE3KQ58pkoaPybXcscqpnwofO0bRRSNIcBB5Nhl+CaSoi84/y8cG27e+KnguMXqBR5wxO/Bl2tGUzgBVY5gmC8VmOZAsZ/gt1HwMNiwGZwBRrlt8SbZfALS5sPqUwoZaaTwySU7kJUtXAbbysvT0vxnL7L/veCE0QniGa/C9ZZM3siAsnImHk4VG9ZauG9k9Em94ZY/d81lIYItgprfYK/o1t76c5OmlOkjFh79NqqaYGt/Q+hurbjnhNrok9gjWATpe5Jg+kKUQoq7qES+uhcmONmgPZ8WuTMe95PtzBQuYVvTJDSBP/cwpFIeoll/EqcHLXrtUCqEkMi/nQg6qu5IXBwHzeXu8nPD8qMUMpsNip44gK1jK3bKFwEKLtl7Zdb9FBHaGaNhRkQVCKAiwh9uVfRNFQb0yX25s21s508jCHlV84Ej/FPxC35FsOjd3Itt1cRmW6+V6SXd/aYOh1jC8+03qq42B9j1CxXJXZIYS6GrOzgiGQQ0c0ZPngN1KWWwQD89gkEL6xnyHBd04jbknG1NVVLlmOC/L3T0itJq04/HvQ8SdJDHxaBLwmlv97b9nqq4W9Rf346uOIZ+cjX1BQOJP8QfGbnb/+/6wJoYChRnJeQbtX9Ggfp64R7E3VCWkJgrB2pQ0mzN4NXonvO4DEKaLvbtNl+EsChatUPFO7Em4buHkJhXqTPuNymJyVPw1d2cPdclyX3Qig== X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:DS7PR03MB5608.namprd03.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230001)(4636009)(7916004)(366004)(508600001)(86362001)(33716001)(316002)(6916009)(6486002)(8936002)(966005)(8676002)(66556008)(66476007)(66946007)(4326008)(26005)(186003)(5660300002)(82960400001)(9686003)(6506007)(6512007)(6666004)(85182001)(83380400001)(38100700002)(2906002)(67856001);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?SnFHZ0RDbFBONUdSWjdZTlNPYVdyQ2pqTmVoRFF6cGdxY216Q1crV1pZMzk4?= =?utf-8?B?alJZaDVFMFhjMnFNQzE0WUxiWXhQRWU3cWNqVXUzMEhlSmN0TXZGcnp2U2ln?= =?utf-8?B?T2UwdDlhWlNleWlLTFMyb21yQnNOMU00Sm5Ob2huTUY2a2VKcFh0dW1jVkVC?= =?utf-8?B?djlTaGExZXhtaExzY1c4VSsxRUZBWU54S1pjMzA0eUJEb1R5L0R6aWZPdUxs?= =?utf-8?B?UlVETU05dEJHTGhqR09CdXJaVWNPS1lFcW0rcVhqc0VZN2J6NDliaWRHYW9q?= =?utf-8?B?SjVzd0lzMWQ1VVZyM080YldhK2FoV040MnNiV1hDcjk5cHREVFg4K3piVzU2?= =?utf-8?B?dmtvSmpOM3NKYXY0LzhQbFliN0UrZVNrV2NKaTlYR2ltdEVvaTdMcnpCZDlx?= =?utf-8?B?Y3YyaC82MWdtcE0yVm8wa1lPSnFLQjNrWDA2OFArdUYzZWxqRGpHNmdIRmhz?= =?utf-8?B?OWlacjd3Uys3R0lHelhZMmZFSSthQjg1ZFV1ZW9TSkp4NlkvNThCaWlQOS95?= =?utf-8?B?OHdyY1oxaGRQMWtBYm96aWNLYzFNWjNOOHl3Ym1rMEFobkJQcmhkOE9IbjJB?= =?utf-8?B?ckZmd00zRE9oc2JSOVcvdjR0bld0dWh2K3dNYllST2t0emVBUlZVZHArakxj?= =?utf-8?B?dm9JMDdEb1U2ckRVcytYSmt2bjNxcFBYNFhhZ2ZaY05KYnF2UnBrTmE4Qkho?= =?utf-8?B?dVhiUHFPa2x2eklXWmtLdHYvUGZBUEdGMjBoRUt6eG9sSmdaOVVwaGpxUnBu?= =?utf-8?B?NGhtTlJjU2lyQ0ZSVFJLTXdZTk9iZEV2SktuM2ZlMVhRck1DaTJMandqdlZ0?= =?utf-8?B?TThFaXhTdnd4Vml1cUV2UXZTMG5zUWlUT0Z6eU91WFl4NmJoQWNkOVJuR2hZ?= =?utf-8?B?KzhRQmVVcDNBZWNJckw1Z1I5T1NTZldrUWRCTGZRZWJERE1JWmxjektLVjJF?= =?utf-8?B?Vm9aaktqUjJaZ1FicWNZU25hcEtFaDd2OFcyKzVIb2x2bGROVUtwWGN6MlRr?= =?utf-8?B?TEkzUmZsRDMxemg4emdEcFRnclpBdjVDZWh1Q05qYWNRWXNQS25MSmtlTWF1?= =?utf-8?B?TExxR3pYVFk5T1FQeGs4S1RLRjZqSUFJT2hSSS94U3h3WmNtc2FSUFZzYitE?= =?utf-8?B?VnpZWHB6eVBSaFNtODdTYlFlS2s3bTY0NE93MFNhYVFzZjZrTGVvRDRQOGMw?= =?utf-8?B?QjNqRGQ3NWdJK0tITlBhTVZvYXhVNlZRWG4rRHhtd05HMmJIN1FKUjlIQWVz?= =?utf-8?B?eTg0NjM3RUo2RDdsSTg2SjN6ckhQWVppRWtGT3lyc0ViU2FvQytsL05GOXdC?= =?utf-8?B?aUxHbHhhbllMY1FYdVlVRlh2dkhXaUNPdlNFQjdlaDIyc1cvN2YzWFVEWENC?= =?utf-8?B?dEQxdE9LbldMcmZhYTFvQ3J1UC9TdGVsRkIxYUVmQVNqYzlZVUNOWUZOYlpX?= =?utf-8?B?RjRNVC9VcXFmeUlNdUVuY2x5cFlac0V6a3VZK1hEZzFRbFpuaDZxd3FYcWdK?= =?utf-8?B?eE9YbU0yQkhLZ0gvWE4xT2U4MzNZeEVnWFc5aDlqTkd6cXhEczNZVVRSSEM3?= =?utf-8?B?d1R4NnVLSHh1NUJ4L05Oc3dzbU5GVFdaY3lUU3VoOG5naFZUcTlLRk4vdExn?= =?utf-8?B?MEF5UVNUeHpzOTBoKzd3T1lOdVNSbThxTnBlbWRkSXpEZDF2NkxHaEpwVVNi?= =?utf-8?B?WWRiOW5Xd0VRUElkOUwvc0lJWWJNNU1hRHlLQ2lEdjcvTkgrTDhuWkxwdG1s?= =?utf-8?B?Mkk0YWNjZGZ1VmhOZFFFakwrUEVTTklHa1F6VldMRDBGaXJpUm5TUENVdlJu?= =?utf-8?B?ODR6NU1kcExmWS80Y0xWWkF0VVlBU2gzL2lWZmphRC9MRXB3dHlsRVFlV1Qx?= =?utf-8?B?VnR2MWh5RSswVDdjSkd6N1RIbk8xSGZLZng1c0lBL3E1ZlN2Z2JGbTEwa2Q4?= =?utf-8?B?SE14VDl0YnJqMGVxV1hTNE5zL2ZNWjYxUk0xT1pDR0hXQ3IrM2NneTc5SXIz?= =?utf-8?B?cHpTSkQ4SndRaFo0V2tZZWlXVEhMNDU4cXo4RjUyVzNPWHFsa3ZmaHcybjk2?= =?utf-8?B?OVdwZ0FrMGgxZFhsMWozS3RRT2VmakNJcXVvWFhmbklpdW9LUGQ4K3VQelFl?= =?utf-8?B?RjU3QUQzZkhHR3I4UGZFbUxvRURVWGprbzBEL2M4bDR5bC9sMjFrWU1Hemw5?= =?utf-8?B?ZXFnL2c5R0ZuY0VWTFZscWU2K2NqcXEvS2g0S1l0WU5rVW9oQjE4L25RbXQ3?= =?utf-8?B?NkJhOUJyaThlUTVSakp0MXlzRnNYMzVPZ2hld1FYUnFib3VNVEV6djlEU0Rm?= =?utf-8?B?OGJsRnRyYU5CZWxSSTFVclpIRVRVRnloUElKd3dFTDNHems3MUNHUT09?= X-MS-Exchange-CrossTenant-Network-Message-Id: 5b7e48fe-d11a-499a-51c6-08da0f364e8c X-MS-Exchange-CrossTenant-AuthSource: DS7PR03MB5608.namprd03.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 26 Mar 2022 14:38:34.8221 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 335836de-42ef-43a2-b145-348c2ee9ca5b X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: b7RQoQzMU2gqmrU7uah7IkZ2a74Ky0DDsonmxsiG1UEviwMdAutHr+JrOuIyVLjFFD6RkTtZ6wM9a+4i9Zhaew== X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6PR03MB5338 X-OriginatorOrg: citrix.com X-Rspamd-Queue-Id: 4KQhRJ21slz3j7v X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=citrix.com header.s=securemail header.b=Gd48kh88; dkim=pass header.d=citrix.onmicrosoft.com header.s=selector2-citrix-onmicrosoft-com header.b=u3AeYTdt; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=reject) header.from=citrix.com; spf=pass (mx1.freebsd.org: domain of "prvs=077da0f8a=roger.pau@citrix.com" designates 216.71.145.153 as permitted sender) smtp.mailfrom="prvs=077da0f8a=roger.pau@citrix.com" X-Spamd-Result: default: False [-5.55 / 15.00]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+exists:216.71.145.153.spf.hc3370-68.iphmx.com]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; DKIM_TRACE(0.00)[citrix.com:+,citrix.onmicrosoft.com:+]; DMARC_POLICY_ALLOW(-0.50)[citrix.com,reject]; RCVD_IN_DNSWL_MED(-0.20)[216.71.145.153:from]; FREEMAIL_TO(0.00)[gmail.com]; RCVD_COUNT_ZERO(0.00)[0]; MIME_TRACE(0.00)[0:+]; R_MIXED_CHARSET(0.56)[subject]; ASN(0.00)[asn:16417, ipnet:216.71.145.0/24, country:US]; FROM_NEQ_ENVFROM(0.00)[roger.pau@citrix.com,prvs=077da0f8a=roger.pau@citrix.com]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[citrix.com:s=securemail,citrix.onmicrosoft.com:s=selector2-citrix-onmicrosoft-com]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_SHORT(-0.91)[-0.906]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; FORGED_SENDER_VERP_SRS(0.00)[]; DWL_DNSWL_LOW(-1.00)[citrix.com:dkim]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-xen]; MID_RHS_NOT_FQDN(0.50)[] X-ThisMailContainsUnwantedMimeParts: N On Sat, Mar 26, 2022 at 02:08:06PM +0200, Ze Dupsys wrote: > On 2022.03.26. 11:11, Roger Pau Monné wrote: > > > > Hm, do you think you could upload (or attach) your > > /usr/lib/debug/boot/kernel/kernel.debug and provide an updated panic > > trace using that same exact kernel? > > Yes, it is just too big for email attachment. > Uploaded at: https://files.fm/f/mp3v3qa22 > > This time i starved Dom0 of RAM(2G) to speed panic up. Panic trace it the > same. > > Trace: > Fatal trap 12: page fault while in kernel mode > cpuid = 2; apic id = 04 > fault virtual address = 0x22710028 > fault code = supervisor read data, page not present > instruction pointer = 0x20:0xffffffff80c6a2b2 > stack pointer = 0x28:0xfffffe009e486b30 > frame pointer = 0x28:0xfffffe009e486b30 > code segment = base 0x0, limit 0xfffff, type 0x1b > = DPL 0, pres 1, long 1, def32 0, gran 1 > processor eflags = interrupt enabled, resume, IOPL = 0 > current process = 3995 (devmatch) > trap number = 12 > panic: page fault > cpuid = 2 > time = 1648293768 > KDB: stack backtrace: > #0 0xffffffff80c7c285 at kdb_backtrace+0x65 > #1 0xffffffff80c2e2e1 at vpanic+0x181 > #2 0xffffffff80c2e153 at panic+0x43 > #3 0xffffffff810c8b97 at trap+0xba7 > #4 0xffffffff810c8bef at trap+0xbff > #5 0xffffffff810c8243 at trap+0x253 > #6 0xffffffff810a0848 at calltrap+0x8 > #7 0xffffffff80c86ed1 at rman_is_region_manager+0x241 > #8 0xffffffff80c3eb41 at sbuf_new_for_sysctl+0x101 > #9 0xffffffff80c3df8c at kernel_sysctl+0x3ec > #10 0xffffffff80c3e603 at userland_sysctl+0x173 > #11 0xffffffff80c3e44f at sys___sysctl+0x5f > #12 0xffffffff810c949c at amd64_syscall+0x10c > #13 0xffffffff810a115b at Xfast_syscall+0xfb > Uptime: 10m19s It's weird, because here you get a page fault, but there are also traces with: general protection fault while in kernel mode cpuid = 3; a(d8) Scan for VGA option rom pic id = 06 instruction pointer = 0x20:0xffffffff810c5d64 stack pointer = 0x28:0xfffffe00a20fe990 frame pointer = 0x28:0xfffffe00a20fe990 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 8998 (devmatch) trap number = 9 panic: general protection fault cpuid = 3 time = 1647416577 KDB: stack backtrace: #0 0xffffffff80c7ca05 at kdb_backtrace+0x65 #1 0xffffffff80c2ea11 at vpanic+0x181 #2 0xffffffff80c2e883 at panic+0x43 #3 0xffffffff810c9b97 at trap+0xba7 #4 0xffffffff810c907b at trap+0x8b #5 0xffffffff810a0dc8 at calltrap+0x8 #6 0xffffffff80c83067 at kvprintf+0x1007 #7 0xffffffff80c83df9 at snprintf+0x59 #8 0xffffffff80c8768b at rman_is_region_manager+0x27b #9 0xffffffff80c3f271 at sbuf_new_for_sysctl+0x101 #10 0xffffffff80c3e6bc at kernel_sysctl+0x3ec #11 0xffffffff80c3ed33 at userland_sysctl+0x173 #12 0xffffffff80c3eb7f at sys___sysctl+0x5f #13 0xffffffff810ca49c at amd64_syscall+0x10c #14 0xffffffff810a16db at Xfast_syscall+0xfb That show a general protection fault instead of a page fault. I've built an hypervisor with debug enabled for you, it's at: https://people.freebsd.org/~royger/xen-debug This is the same as the one in ports, just build with debug=y. If you can place it in /boot/ and change your xen_kernel to: xen_kernel="/boot/xen-debug" It might provide some additional info. I've also noticed it seems to always be 'devmatch' the process that triggers the panic. > > cat /tmp/panic.log| sed -Ee 's/^#[0-9]* //' -e 's/ .*//' | xargs addr2line > -e /usr/lib/debug/boot/kernel/kernel.debug > /usr/src/sys/kern/subr_kdb.c:443 > /usr/src/sys/kern/kern_shutdown.c:0 > /usr/src/sys/kern/kern_shutdown.c:844 > /usr/src/sys/amd64/amd64/trap.c:944 > /usr/src/sys/amd64/amd64/trap.c:0 > /usr/src/sys/amd64/amd64/trap.c:0 > /usr/src/sys/amd64/amd64/exception.S:292 > /usr/src/sys/kern/subr_rman.c:0 I've been able to get a better trace with gdb and your debug symbols, and this is: (gdb) info line *0xffffffff80c6a2b2 Line 1386 of "/usr/src/sys/kern/subr_bus.c" starts at address 0xffffffff80c6a2b2 and ends at 0xffffffff80c6a2b6 . (gdb) info line *0xffffffff80c86ed1 Line 1052 of "/usr/src/sys/kern/subr_rman.c" starts at address 0xffffffff80c86ecc and ends at 0xffffffff80c86ed5 . The page fault happens exactly at: https://cgit.freebsd.org/src/tree/sys/kern/subr_bus.c?h=stable/13#n1386 Which is called from https://cgit.freebsd.org/src/tree/sys/kern/subr_rman.c?h=stable/13#n1052 I'm trying to figure out how the device could be removed or disconnected from the rman. I will try to create a patch to catch the device that leaves rman regions when destroyed/removed. Thanks, Roger.