Packet Loss on FW1 but not FW2 (CARP + PF on FBSD8)

[Pyun YongHyeon]

On Fri, May 14, 2010 at 03:56:38PM -0400, list at cykotix.com wrote:
> Quoting Pyun YongHyeon <pyunyh at gmail.com>:
> 
> >On Fri, May 14, 2010 at 02:56:12PM -0400, list at cykotix.com wrote:
> >>Hello,
> >>
> >>I recently just purchased 2 Soekris5501 with identical 120gb 2.5" WD
> >>Scorpio HDDs.  I'm using them for network failover, using CARP, PF and
> >>pfSync on FreeBSD 8-STABLE.
> >>
> >>The short version of my problem:
> >>
> >>I setup FW2 first, imaged its hard drive to FW1.  I changed the
> >>necessary configs to update the IPs and ensure FW1 was carp MASTER.
> >>Using a known working port on the switch, I continue to get 70% packet
> >>loss on FW1 on vr0 (vr0 - extif, vr1 - intif, vr2 - pfsync).  If I
> >>flip FW1 and FW2, the packet loss follows FW1.  I took FW1 home,
> >>plugged it into my home network on vr0 and it works fine with 0%
> >>packet loss so the interface seems fine.  I also took the IP bound to
> >>vr0 on FW1 and bound it to vr0 on FW2 and the ISP isn't the problem.
> >>
> >
> >Show me the output of "sysctl dev.vr.0.stats=1" and "netstat -ndI vr0".
> 
> soekris1# sysctl dev.vr.0.stats=1
> dev.vr.0.stats: -1 -> -1
> 

Please check the output of console. It would have printed some MAC
counters maintained in driver.

> soekris1# netstat -ndI vr0
> Name    Mtu Network       Address              Ipkts Ierrs    Opkts  
> Oerrs  Coll Drop
> vr0    1500 <Link#1>      00:00:24:cc:cb:94    17491     0    14993     
>  0     0    0
> vr0    1500 98.xxx.xxx.56 98.xxx.xxx.59          992     -     9374     
>  -     -    -
> 

No Ierrs, so MAC counters would be more helpful here.

> 
> soekris2# sysctl dev.vr.0.stats=1
> dev.vr.0.stats: -1 -> -1
> 
> soekris2# netstat -ndI vr0
> Name    Mtu Network       Address              Ipkts Ierrs    Opkts  
> Oerrs  Coll Drop
> vr0    1500 <Link#1>      00:00:24:ca:40:60   575909     0   588703     
>  0     0    0
> vr0    1500 98.xxx.xxx.56 98.xxx.xxx.60        10029     -    53106     
>  -     -    -
> 
> 
> Let me know if you need any other information!  Thanks!
> 
> Patrick