Re: bhyve disk performance issue

On 2/28/24 15:02, Vitaliy Gusev wrote:
>
>
>> On 28 Feb 2024, at 23:03, Matthew Grooms <mgrooms@shrew.net> wrote:
>>
>> ...
>> The virtual disks were provisioned with either a 128G disk image or a 
>> 1TB raw partition, so I don't think space was an issue.
>>
>> Trim is definitely not an issue. I'm using a tiny fraction of the 
>> 32TB array have tried both heavily under-provisioned HW RAID10 and SW 
>> RAID10 using GEOM. The latter was tested after sending full trim 
>> resets to all drives individually.
>>
> It could be then TRIM/UNMAP is not used, zvol (for the instance) 
> becomes full for the while. ZFS considers it as all blocks are used 
> and write operations could  have troubles. I believe it was recently 
> fixed.
>
> Also look at this one:
>
> GuestFS->UNMAP->bhyve->Host-FS->PhysicalDisk
>
> The problem of UNMAP that it could have unpredictable slowdown at any 
> time. So I would suggest to check results with enabled and disabled 
> UNMAP in a guest.
>
Yes. I'm aware of issues associated with TRIM/UNMAP, but that's not 
implemented by any hardware RAID vendor that I'm aware of. I tested with 
both hardware and software RAID10. The issue I'm reporting is present in 
both cases. I'm quite certain this has nothing to do with TRIM/UNMAP.

-Matthew