igb "requests for mbufs denied"

[Alexander V. Chernikov]

On 28.08.2014 12:31, Eggert, Lars wrote:
> Hi,
>
> no matter what value I bump kern.ipc.nmbclusters and kern.ipc.nmbufs to, I still get "requests for mbufs denied" with igb interfaces, and the occasional connection stall, even when dialing down hw.igb.num_queues=1:
>
> [root at laurel: ~] netstat -m
> 3070/1355/4425 mbufs in use (current/cache/total)
> 3069/773/3842/8144896 mbuf clusters in use (current/cache/total/max)
> 3069/772 mbuf+clusters out of packet secondary zone in use (current/cache)
> 0/6/6/1018097 4k (page size) jumbo clusters in use (current/cache/total/max)
> 0/0/0/301658 9k jumbo clusters in use (current/cache/total/max)
> 0/0/0/169682 16k jumbo clusters in use (current/cache/total/max)
> 6905K/1908K/8814K bytes allocated to network (current/cache/total)
> 73/3831/3091 requests for mbufs denied (mbufs/clusters/mbuf+clusters)
> 0/0/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters)
> 0/0/0 requests for jumbo clusters delayed (4k/9k/16k)
> 6/0/0 requests for jumbo clusters denied (4k/9k/16k)
> 0 requests for sfbufs denied
> 0 requests for sfbufs delayed
> 0 requests for I/O initiated by sendfile
>
> The box in question has six igb interfaces, 2x 'I210 Gigabit Network Connection' and 4x '82580 Gigabit Network Connection' and is running:
>
> FreeBSD laurel.muccbc.hq.netapp.com 10.0-RELEASE-p7 FreeBSD 10.0-RELEASE-p7 #0: Tue Jul  8 06:37:44 UTC 2014     root at amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC  amd64
>
> Anyone have any ideas what else to try?
Do you have jumbo frames turned on?
>
> Thanks,
> Lars