SNMP/No Bufferspace
Larry Rosenman
ler at lerctr.org
Mon Jun 3 18:15:38 UTC 2019
On 06/03/2019 1:09 pm, Eugene Grosbein wrote:
> 04.06.2019 0:49, Larry Rosenman wrote:
>
>> On 06/03/2019 12:23 pm, Eugene Grosbein wrote:
>>> 03.06.2019 22:56, Larry Rosenman wrote:
>>>
>>>> I have a mrtg job that runs every 5 minutes on a FreeBSD-CURRENT box
>>>> and gets this randomly:
>>>>
>>>> SNMP Error:
>>>> send_query: No buffer space available
>>>
>>> [skip]
>>>
>>>> How can I debug this?
>>>
>>> Your outgoing network interface stalls for some reason.
>>> Where is this traffic directed to? Some kind of VPN tunnel? Physical
>>> NIC that looses link?
>>> Some Wifi or mobile network?
>>>
>> physical NIC on the same physical network (all Ubiquiti gear).
>>
>>
>> ⌂66% [ler at borg.lerctr.org:~] $ ifconfig
>> lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
>> options=680003<RXCSUM,TXCSUM,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
>> inet6 ::1 prefixlen 128
>> inet6 fe80::1%lo0 prefixlen 64 scopeid 0x1
>> inet 127.0.0.1 netmask 0xff000000
>> groups: lo
>> nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
>> bce0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST>
>> metric 0 mtu 1500
>>
>> options=c01bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE>
>> ether a4:ba:db:29:66:95
>> media: Ethernet autoselect (1000baseT <full-duplex>)
>> status: active
>> nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
>> bce1: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
>>
>> options=c01bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE>
>> ether a4:ba:db:29:66:97
>> media: Ethernet autoselect
>> nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
>> bce2: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
>>
>> options=c01bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE>
>> ether a4:ba:db:29:66:99
>> media: Ethernet autoselect
>> nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
>> bce3: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
>>
>> options=c01bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE>
>> ether a4:ba:db:29:66:9b
>> media: Ethernet autoselect
>> nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
>> bridge0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0
>> mtu 1500
>> ether 02:d7:b8:51:f2:00
>> inet6 fe80::d7:b8ff:fe51:f200%bridge0 prefixlen 64 scopeid 0x6
>> inet6 2600:1700:210:b180:d7:b8ff:fe51:f200 prefixlen 64 autoconf
>> inet 192.168.200.4 netmask 0xfffffc00 broadcast 192.168.203.255
>> id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15
>> maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200
>> root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
>> member: bce0 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
>> ifmaxaddr 0 port 2 priority 128 path cost 55
>> groups: bridge
>> nd6 options=23<PERFORMNUD,ACCEPT_RTADV,AUTO_LINKLOCAL>
>> ⌂68% [ler at borg.lerctr.org:~] $
>>
>> bridge0 via bce0 to the "main-switch" . and all the
>> AP's,switches, etc.
>
> You should search system logs for possible link problems
> and check counters shown by "netstat -idnh" (errs/drop/coll).
>
> Also check counters by "netstat -m" for mbufs/mbuf clusters.
⌂79% [ler at borg.lerctr.org:~] $ netstat -idnh
Name Mtu Network Address Ipkts Ierrs Idrop
Opkts Oerrs Coll Drop
lo0 16K <Link#1> lo0 27M 0 0
27M 0 0 0
lo0 - ::1/128 ::1 582k - -
582k - - -
lo0 - fe80::%lo0/64 fe80::1%lo0 0 - -
0 - - -
lo0 - 127.0.0.0/8 127.0.0.1 190k - -
26M - - -
bce0 1.5K <Link#2> a4:ba:db:29:66:95 715M 186k 0
533M 0 0 15M
bce1* 1.5K <Link#3> a4:ba:db:29:66:97 0 0 0
0 0 0 0
bce2* 1.5K <Link#4> a4:ba:db:29:66:99 0 0 0
0 0 0 0
bce3* 1.5K <Link#5> a4:ba:db:29:66:9b 0 0 0
0 0 0 0
bridg 1.5K <Link#6> 02:d7:b8:51:f2:00 715M 0 0
533M 15M 0 0
bridg - fe80::%bridge fe80::d7:b8ff:fe5 7.2k - -
7.2k - - -
bridg - 2600:1700:210 2600:1700:210:b18 578M - -
476M - - -
bridg - 192.168.200.0 192.168.200.4 161M - -
72M - - -
⌂86% [ler at borg.lerctr.org:~] $ netstat -m
3212/18193/21405 mbufs in use (current/cache/total)
2078/11604/13682/8175421 mbuf clusters in use (current/cache/total/max)
2045/8075 mbuf+clusters out of packet secondary zone in use
(current/cache)
6/9355/9361/4087710 4k (page size) jumbo clusters in use
(current/cache/total/max)
0/0/0/1211173 9k jumbo clusters in use (current/cache/total/max)
0/0/0/681285 16k jumbo clusters in use (current/cache/total/max)
4983K/65176K/70159K bytes allocated to network (current/cache/total)
0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters)
0/0/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters)
0/0/0 requests for jumbo clusters delayed (4k/9k/16k)
0/0/0 requests for jumbo clusters denied (4k/9k/16k)
0 sendfile syscalls
0 sendfile syscalls completed without I/O request
0 requests for I/O initiated by sendfile
0 pages read by sendfile as part of a request
0 pages were valid at time of a sendfile request
0 pages were valid and substituted to bogus page
0 pages were requested for read ahead by applications
0 pages were read ahead by sendfile
0 times sendfile encountered an already busy page
0 requests for sfbufs denied
0 requests for sfbufs delayed
⌂83% [ler at borg.lerctr.org:~] $
Hrm. I may be able to move directly away from the bridge.....
⌂83% [ler at borg.lerctr.org:~] $ grep bce0 /var/log/messages
⌂80% [ler at borg.lerctr.org:~] 1 $ grep bridge /var/log/messages
Jun 3 02:48:30 borg kernel: arp: 192.168.200.54 moved from
04:c9:d9:63:22:87 to 04:c9:d9:63:22:89 on bridge0
Jun 3 02:49:49 borg kernel: arp: 192.168.200.54 moved from
04:c9:d9:63:22:89 to 04:c9:d9:63:22:87 on bridge0
⌂83% [ler at borg.lerctr.org:~] $ uptime
1:15PM up 1 day, 18:11, 1 user, load averages: 20.08, 18.82, 18.13
⌂83% [ler at borg.lerctr.org:~] $
--
Larry Rosenman http://www.lerctr.org/~ler
Phone: +1 214-642-9640 E-Mail: ler at lerctr.org
US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106
More information about the freebsd-net
mailing list