Racoon and setkey problems

[Misak Khachatryan]

Hi,

# vmstat -m | egrep "sec|sah|pol"
 inpcbpolicy   122     4K       -  4955796  32
    secasvar 48558 12140K       -  1572045  256
      sahead     3     1K       -       15  256
 ipsecpolicy   256    64K       -  9911740  256
ipsecrequest    12     2K       -       48  128
  ipsec-misc 389632 12176K       - 12575976  16,32,64
   ipsec-saq     3     1K       -       15  128
   ipsec-reg     3     1K       -       12  32

# netstat -m
3178/8717/11895 mbufs in use (current/cache/total)
3075/4025/7100/524288 mbuf clusters in use (current/cache/total/max)
3075/4009 mbuf+clusters out of packet secondary zone in use (current/cache)
0/248/248/126182 4k (page size) jumbo clusters in use (current/cache/total/max)
0/0/0/37387 9k jumbo clusters in use (current/cache/total/max)
0/0/0/21030 16k jumbo clusters in use (current/cache/total/max)
6944K/11221K/18165K bytes allocated to network (current/cache/total)
0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters)
0/0/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters)
0/0/0 requests for jumbo clusters delayed (4k/9k/16k)
0/0/0 requests for jumbo clusters denied (4k/9k/16k)
0 requests for sfbufs denied
0 requests for sfbufs delayed
0 requests for I/O initiated by sendfile

# vmstat -z | egrep 'ITEM|mbuf'
ITEM                   SIZE  LIMIT     USED     FREE      REQ FAIL SLEEP
mbuf_packet:            256, 1615140,    3084,    4000,835233903,   0,   0
mbuf:                   256, 1615140,     104,    4707,1373358845,   0,   0
mbuf_cluster:          2048, 524288,    7084,      16,    7084,   0,   0
mbuf_jumbo_page:       4096, 126182,       0,     248,  309522,   0,   0
mbuf_jumbo_9k:         9216,  37387,       0,       0,       0,   0,   0
mbuf_jumbo_16k:       16384,  21030,       0,       0,       0,   0,   0
mbuf_ext_refcnt:          4,      0,       0,       0,       0,   0,   0

# sysctl kern.ipc.nmbclusters
kern.ipc.nmbclusters: 524288


Nothing new in messages with net.inet.ipsec.debug=1


Best regards,
Misak Khachatryan


On Mon, Feb 19, 2018 at 1:25 PM, Eugene Grosbein <eugen at grosbein.net> wrote:
> 19.02.2018 13:27, Misak Khachatryan wrote:
>
>>        1644111 messages with memory allocation failure
>>
>> 3 of machines running   10.4-RELEASE-p1, one 10.3.
>> Two of the machine almost the same, only ip addresses and few lines of
>> configs differ. One is OK, other one have problem.
>>
>> Running almost any setkey command leads to:
>>
>>  # setkey -x
>> setkey: send: No buffer space available
>>
>> All packet versions are completely the same, binaries exactly same size.
>>
>> Any help will be appreciated.
>
> Perhaps, that is mbuf cluster exhaustion. Please show output of commands:
>
> netstat -m
> vmstat -z | egrep 'ITEM|mbuf'
> sysctl kern.ipc.nmbclusters
>
> How much RAM do they have? Do they run 32 bit or 64 bit system?
>
>