Mellanox NIC + Bridge + VM traffic issues on 12.1-RELEASE

[Ali Mashtizadeh]

Hello Everyone,

I've noticed something strange happening after I upgraded to FreeBSD 12.1
on one machine.

My VM is bridged to a Mellanox ConnectX4 that connects to our cluster of
machines.  Traffic appears to go between the VM and external machines
except for ARP replies.

I noticed ARP replies from the VM do not make it to the external network
and appear to be dropped by the NIC.  All network connectivity is fine when
using an Intel ixl NIC.

Has anyone seen this? Does this have something to do with the NIC
offloads?  I experimented with them but did not succeed in fixing ARP
traffic.

Best,
Ali