Issue with BGP router / high interrupt / Chelsio / FreeBSD 12.1

[Andrey V. Elsukov]

On 13.02.2020 06:21, Rudy wrote:
> 
> 
> I'm having issues with a box that is acting as a BGP router for my
> network.  3 Chelsio cards, two T5 and one T6.  It was working great
> until I turned up our first port on the T6.  It seems like traffic
> passing in from a T5 card and out the T6 causes a really high load (and
> high interrupts).
> 
> Traffic (not that much, right?)
> 
>      Dev  RX bps    TX bps    RX PPS    TX PPS Error
>      cc0       0         0         0         0         0
>      cc1    2212 M       7 M     250 k       6 k 0 (100Gbps uplink,
> filtering inbound routes to keep TX low)
>     cxl0     287 k    2015 M     353       244 k 0   (our network)
>     cxl1     940 M    3115 M     176 k     360 k 0 (our network)
>     cxl2     634 M    1014 M     103 k     128 k 0 (our network)
>     cxl3       1 k      16 M       1         4 k       0
>     cxl4       0         0         0         0         0
>     cxl5       0         0         0         0         0
>     cxl6    2343 M     791 M     275 k     137 k 0 (IX , part of lagg0)
>     cxl7    1675 M     762 M     215 k     133 k 0 (IX , part of lagg0)
>     ixl0     913 k      18 M       0         0 0
>     ixl1       1 M      30 M       0         0         0
>    lagg0    4019 M    1554 M     491 k     271 k       0
>    lagg1       1 M      48 M       0         0         0
> FreeBSD 12.1-STABLE orange                 976 Bytes/Packetavg
>  1:42PM  up 13:25, 5 users, load averages: 9.38, 10.43, 9.827

Hi,

did you try to use pmcstat to determine what is the heaviest task for
your system?

# kldload hwpmc
# pmcstat -S inst_retired.any -Tw1

Then capture several first lines from the output and quit using 'q'.

Do you use some firewall? Also, can you show the snapshot from the `top
-HPSIzts1` output.

-- 
WBR, Andrey V. Elsukov

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 554 bytes
Desc: OpenPGP digital signature
URL: <http://lists.freebsd.org/pipermail/freebsd-net/attachments/20200214/7357dabb/attachment.sig>