From nobody Wed May 22 19:20:35 2024 X-Original-To: arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Vl1Nk1CBtz5KXmK for ; Wed, 22 May 2024 19:20:38 +0000 (UTC) (envelope-from jfc@mit.edu) Received: from NAM11-DM6-obe.outbound.protection.outlook.com (mail-dm6nam11on2105.outbound.protection.outlook.com [40.107.223.105]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Vl1Nj59sjz3y53 for ; Wed, 22 May 2024 19:20:37 +0000 (UTC) (envelope-from jfc@mit.edu) Authentication-Results: mx1.freebsd.org; none ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=TweqtHHdItz4bRVIrTgIVqwfWK/rY38WZ2nnRXBdV2837lJIyYWvo5fuLBNCzMVV4l/xKKqdt4TnxHwO35axn5jpoyEbw2QUwAX2lfbLMxM0zcuBLm7bXqYpftV91goxAvPJBLkn0ZwqRe+ZCBp8EvWo6Kdl5UDUHHWwWTx/QdfToos0lGRyst2YnMO7ROBFayiTC0i3fnlWvAqlBRKrRlhvdtJ8qNiw5NqlOkigSpo9aO6FSQVapo0MVVqkLnjAI8WFylYnzQ+abB7SwDI/Nw4X2yeDKjZIuf4PcKI8h5jJ3VIu2HCnaevhOF/w4jL3VRYAJ62Qs3aK6csOXK9rsw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=tYjKkxrU+2z2Vs0eCNRAt6LuQ4PpWbKolvfVLcrtxxA=; b=dfA38W6r6KOfpGXhrG2cB+S+u8e13kivsA23FFiRWbaqV2JzcGf2rWcuspz91Tz/jV8vK9c5yeIkH6BrkA96hseZqlASgcBRh8toT2x0n7zpMaAtCTiJTZrN3gAiN4BMsCZdcblRHpmRxkXiTUbgIOmz4CDe/mjB7+PGcu4TAlYX3thY/AHfYkNgWK17wXl7vuDupU+QBtkWubs+Jiep6/QL5oRy/lWVzNkfNOagmPmPu0yuhfs/KQjteHR60E5iUCYv7PKe/9Q0D5VZN5ACvP1yYuVIxg9Afxn39l5/qds80KpDLvwWSw3uDSKRagh1+zLAdqJ9SACiSM9lKYMSSA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=mit.edu; dmarc=pass action=none header.from=mit.edu; dkim=pass header.d=mit.edu; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=mit.edu; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=tYjKkxrU+2z2Vs0eCNRAt6LuQ4PpWbKolvfVLcrtxxA=; b=rUWG2qCiSorFapx6oFYHELSZ0nZD0EtQWUJe+KpbtIspV2Qbe+P3PhNRMZS6xu/yzrGWIF18I04m7B0neZtGt6t2PFCUgL4n6owX4my2TZ3EoCXtB5qbtKOZzR8tvr+IOcnx2rSr1D8SlnY6MhlITgwEqKq5Kdu1Nmz/Xr1X+yo= Received: from SA3PR01MB8450.prod.exchangelabs.com (2603:10b6:806:382::17) by DS7PR01MB7855.prod.exchangelabs.com (2603:10b6:8:82::13) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7587.35; Wed, 22 May 2024 19:20:35 +0000 Received: from SA3PR01MB8450.prod.exchangelabs.com ([fe80::bb39:d8c:f575:6b9d]) by SA3PR01MB8450.prod.exchangelabs.com ([fe80::bb39:d8c:f575:6b9d%5]) with mapi id 15.20.7611.016; Wed, 22 May 2024 19:20:35 +0000 From: John F Carr To: Mario Marietto CC: Mark Millard , Ronald Klop , "arm@freebsd.org" , Lexi Winter Subject: Re: vmm (bhyve) on GICv2 Thread-Topic: vmm (bhyve) on GICv2 Thread-Index: AQHarBYYCQeAyN3/IUiOCh/1k52a5bGi1v8AgAADUQCAAIipAIAAAmSAgAASvYCAAAhTgIAAIZcA Date: Wed, 22 May 2024 19:20:35 +0000 Message-ID: <71FB8C8C-DA84-469B-8742-1C3DD5F3E773@mit.edu> References: <18B789E4-5891-4F3E-BAB6-05FD45949438@yahoo.com> <1923834610.13708.1716392599662@localhost> <6117F301-D584-40F7-9022-F90103FF5468@yahoo.com> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-publictraffictype: Email x-ms-traffictypediagnostic: SA3PR01MB8450:EE_|DS7PR01MB7855:EE_ x-ms-office365-filtering-correlation-id: 8cd54e48-0630-4db1-948a-08dc7a944166 x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0;ARA:13230031|376005|1800799015|366007|38070700009; x-microsoft-antispam-message-info: =?us-ascii?Q?agGAuJPikE+207r8um6/zSJ/sO4j7G7JMzyM6oaPJu7VWcPqKvu0XuSiQ+es?= =?us-ascii?Q?PD954oJgMiHsnESBv6CNSK3ZD/QHPES80fRMpby9BZEAjTF24GSMco3IKO4i?= =?us-ascii?Q?ECbqvoiEStHeRClDV4Pvrdk3P7A6nX74NDha9h5SIw0r3vZ1tx2PhcWuh4Xc?= =?us-ascii?Q?7O+rabmjxRAq1Px/Thu+3PO1Jsy52fafVguVQzaJxFQPbA7mBB8QKx2oiP/m?= =?us-ascii?Q?zu4BqHQU2Q6KV4vEbEpznznrjeMlNaswbK5MIgKgj7GCIhE7XLW5z329tlH4?= =?us-ascii?Q?sPFAsuXsTa62yDAGPN6ukstwDMaOxqRwqahB7YOd/jOCyJ1lq0U8VtYEtGv0?= =?us-ascii?Q?dxiSvAjuUn2NqhIS2byZONG1wqReSxFiQm7yqWe9jcJwCDBdGa6YFkFX578i?= =?us-ascii?Q?XspOkjyR7J+xErKrmudHJXFlVL8gXym7/o/TYoUaUPtpa66zP7TwydWifvam?= =?us-ascii?Q?NzNjy2dQL3l6ycso24xnc3CEWF0MGRYE4sTUDI1vPqG9ilYtjAo3FtC98Daq?= =?us-ascii?Q?oOvf3ZcvPool3Mp7kmiLIIlRtmnyJxqpukt38dEStjfsXRzou4SypZE8qHre?= =?us-ascii?Q?OoSHa5CY4Tghm/dZsRgLjCyVP/PgTmNe56DX2kQsH55dcLjazW3qMx+Nsuiw?= =?us-ascii?Q?damIL2ryd6MhJG7NWr/StIOeYh0mGUUM15RxIGzh6NzQRkDPQE5v+vfHWDIW?= =?us-ascii?Q?1dRvdNsEBMjXtK3QfFR94Y96X+R0uh3nvAExtHkv1dx62piBmtyRdOWJtxMr?= =?us-ascii?Q?TOWlZ8MCyCwrPCPLcwZhCWPv5vhg0peW6YK658ffBYRNnu72TFVEEGcwiIXr?= =?us-ascii?Q?FvFb3TS5uAWx1hwAA/DhHnjPCOPrvqhfpRIfUS5DGf9PuAON07MWE9zGVhjU?= =?us-ascii?Q?lYjtQBwIdLkHAIz+ajCZ8mgP0+1e6qSyvUsVghMJjDkxmwhgNPD8TylIrYG5?= =?us-ascii?Q?EPezXMLicQhXPCRAe+847BCMMLhccJr5LcFEUMRJt02Nr5/eX/vspa24d2Au?= =?us-ascii?Q?DuPDuWYVLxeL9ddg2eCCjw6V7roJarwj1NS7szeBhSST8jk3ytjzVNW3sYEE?= =?us-ascii?Q?teuA6hZj1qGmNJdfCL6YKl9nILJc0w/Fv06SfVS4yw96TuaIlBWDKn09Hs1l?= =?us-ascii?Q?f6dziPD6K9uzbJAs6bdgSQOHSw21Hn7tjsV8qgsp3MVAZTjG4g294FnHIa68?= =?us-ascii?Q?w+4uTQCbPHNJkR6qcnsN611S3144TW4D5KIru6GNEnJIOG6UOZVN1W4Yx9gn?= =?us-ascii?Q?agVrgaDcNwPeswM2TD1Rf7fVppHGSFA34/cFEp/fGA=3D=3D?= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:SA3PR01MB8450.prod.exchangelabs.com;PTR:;CAT:NONE;SFS:(13230031)(376005)(1800799015)(366007)(38070700009);DIR:OUT;SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?1+Cbr03LrsaUB1dqOGxSCjcFZYFZoBjP0lRk48sEDG5kEGga2IlfQuytFUM2?= =?us-ascii?Q?pE4c81AyaegGbrWDHgUOQV1jZNj5bCZBQu9yBYJPu+iniV3gBT0H1/PSleCT?= =?us-ascii?Q?DaxcpyATb+tkCTZQNwwiEtcdDpwXYRqfta/r+XJdTwkw8LXa5LPjFkdWqPbi?= =?us-ascii?Q?ELGWgmrwHZ9o3tN4/yDLaucHgD+sSRaJIDMVo1ZmiEc3m7qXWvuob7KdjrSy?= =?us-ascii?Q?esLHht3VG2Xwh3CrZrJusXx6IkS4tnix2J+QHAmDIVR+0ulky6ft9UMxS4tc?= =?us-ascii?Q?bBWz6DX5ZoepquTxCwvH7ZB9vtQIksFm0odUXbJ7MUJKt0gn3+wQ7X8gldaj?= =?us-ascii?Q?M+Iz2BvOKd5WcCHFtWhOmZY22rVUog+VSXFoCcYia84zEf6/72Q+7KLOpgcD?= =?us-ascii?Q?s+UoqjdHyItCm3KQwPwMQ0PfbUihZBGc/gwo+/UdkTx+N+A68qbGi9Ug4qVS?= =?us-ascii?Q?kqnHJHHwGV81JZsE949q6ZhOHQt7WTJCJoYiM3EEyLJaT5uVbjAKMXTm+BkX?= =?us-ascii?Q?L4p59WAl5UHZWCzfnVpsdfWWR8QCz9F79GN6iCn3DBczrLG0OXUmg/pYyFDa?= =?us-ascii?Q?AhTZTc8PNBQP006OsJpWNSgrk3WPL3Wd/QZ7bk4gE+U5vqh7a1N/H4Pv9NdP?= =?us-ascii?Q?HC7jB3noe28p5k4uiNYMGaj1ZRteGNQOT1lwuPBhMGRhen8mdN/cKDFv1Hfh?= =?us-ascii?Q?Mb1wYYMzybHVLy7PMRLG/4s9fD9W3fjFSTHdtAv47FGcmfiis2kN+DO3s01i?= =?us-ascii?Q?feAR6kAXE10qUiCOK80gF6fhfClJYAU7lFK9o/bpCruvoq8hSh+ptZd10PwT?= =?us-ascii?Q?mNNOfdkz74fq9Rt9NvKx45biSQ92ps6sv0w7BfNSxpGyhyT2qrxjtCsPAZ2p?= =?us-ascii?Q?1NJusAgCPNh68ldXASRUUIHW/5zF6oi9MnYSY+Om7d0d5NgiPHCUHdHLxxkp?= =?us-ascii?Q?sMQRrilq3fUXSEdcbSTielvCaGH2L8FIcrkI7QK36z2f6yPC42pl4IODg8O5?= =?us-ascii?Q?ksRJMdFKGYj31HdmQOn+5+/+MGztsBrgVZMw5T16C7df4mdqsYbQk8h7cZ1I?= =?us-ascii?Q?UETXjQylj/MssWpj6Aut82M3H6sdcafPNdIH3oYPJ84UMWujik9+SS36DgMX?= =?us-ascii?Q?nkcR/KcDYsgYVjK7iOdBfbxRUbeH7kgQdW8wnw5qmOCjh655ShYAozCtuY/r?= =?us-ascii?Q?3yTkpdeR6fWISeWGj37E8Lu6EB92DCJDuxh3BD2DW8NoufdGPwxJJL+cz6qw?= =?us-ascii?Q?sfu1qilpAjVgHCuwGTALOGE0iI8MfY51u6GX9Esj93+IxnRwSyMzE9kiV6pb?= =?us-ascii?Q?WtYXPSSNwIlLFrjgbeBtunvHQncaw6eTWA7u9YUjLRbCZLwTUD2f1IOPM+7p?= =?us-ascii?Q?3gmAeRSFTTMyLKNsfYH/DFPnb52j6RuUhbG8BNVUTCFK5Dr+YIANjRckUGsx?= =?us-ascii?Q?8R3xw6BAbOFDUW7ol08d8m23NlmXXoTpYmKZb6YGDJ0+x5Jv7O0XB8stCsWD?= =?us-ascii?Q?kLNwIyMRpTHu0Jzr5kk/KWpxIRP4nYqJo4qbU34Colcz7dk4Gopyzsv4pUzx?= =?us-ascii?Q?I6HgmImFJTgU0g9jzfaMk11a3iC9S1LsV42UZFm4uGlatd6kK3he7yg93gjJ?= =?us-ascii?Q?K/GX/lOTON2ipMwPwxZugpTwI28t1J+I9XqBXSaAeEo8?= Content-Type: text/plain; charset="us-ascii" Content-ID: Content-Transfer-Encoding: quoted-printable List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@FreeBSD.org MIME-Version: 1.0 X-OriginatorOrg: mit.edu X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: SA3PR01MB8450.prod.exchangelabs.com X-MS-Exchange-CrossTenant-Network-Message-Id: 8cd54e48-0630-4db1-948a-08dc7a944166 X-MS-Exchange-CrossTenant-originalarrivaltime: 22 May 2024 19:20:35.0209 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 64afd9ba-0ecf-4acf-bc36-935f6235ba8b X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: 9RCQ2pJEjsoYfc472CvtfhVjJFHDg/G1WkYxOr3RvuKghOw+9XjlE9Qc5/9ev1GP X-MS-Exchange-Transport-CrossTenantHeadersStamped: DS7PR01MB7855 X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US] X-Rspamd-Queue-Id: 4Vl1Nj59sjz3y53 > On May 22, 2024, at 13:20, Mario Marietto wrote: >=20 > Can someone confirm that bhyve works ok on the RockPro64 (RK3399) ? Has b= hyve been patched in relation to this bug : >=20 > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D277559 >=20 > ? >=20 > I read that there is a huge amount of work to do on the RPI5 before it wo= rks with FreeBSD. And anyway,it does not support bhyve. So if I will buy a = soc,it will be the RockPro64.... The RockPro64 should be usable for development, not production use of virtual machines. The kernel sometimes locks up the first time the vmm module is loaded. Once the module loads it can be unloaded and reloaded without risk. I was able to boot FreeBSD-13.3-RELEASE-arm64-aarch64.raw in bhyve on my RockPro64 with this script: NCPU=3D1 MEM=3D384m DISK0=3D/dev/nda0s4 VMNAME=3Dthirteen bhyve -c "${NCPU:?}" -m "${MEM:?}" \ -s 0:0,hostbridge \ -s 1:0,virtio-blk,"${DISK0:?}" \ -o bootrom=3D/usr/local/share/u-boot/u-boot-bhyve-arm64/u-boot.bin \ -o rtc.use_localtime=3Dfalse \ -o console=3Dstdio \ -o config.dump=3Dfalse \ -o acpi_tables=3Dtrue \ "${VMNAME:?}" I had copied the image to /dev/nda0s4. It should work just as well with th= e regular file after "virtio-blk". Some observations: 1. There is no clock visible to the guest OS: Warning: no time-of-day clock registered, system time will not be set accur= ately 2. The RockPro system has two types of cores. One has a physically indexed= I-cache, the other virtually indexed. The virtual CPU reports a virtually indexed c= ache. CPU 0: ARM Foundation-Model r0p0 affinity: 0 Cache Type =3D <64 byte D-cacheline,64 byte I-cacheline,= VIPT ICache,64 byte ERG,64 byte CWG> I think this will cause correct behavior despite being technically wrong. I have a Quartz64, a newer Pine64 SBC, but I have not yet tried to install = BSD on it. John Carr