From nobody Fri Aug 18 21:54:01 2023 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RSFyM1gwbz4r8vV for ; Fri, 18 Aug 2023 21:54:19 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: from mail-yb1-xb2f.google.com (mail-yb1-xb2f.google.com [IPv6:2607:f8b0:4864:20::b2f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RSFyL6tvQz4cw8 for ; Fri, 18 Aug 2023 21:54:18 +0000 (UTC) (envelope-from kob6558@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-yb1-xb2f.google.com with SMTP id 3f1490d57ef6-d35a9d7a5bdso1401509276.0 for ; Fri, 18 Aug 2023 14:54:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1692395658; x=1693000458; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=hqIvn+d5AvqCRErBR/oPUPCf6IRAW3bNEhD1osQf/YU=; b=YMMT8s0lda9T24dBZJ+DWJhJdy8JuW+UKyPauD+VaoBtKKhNhXXF+/u7ass0RdLOit SLWQzrMF1mpVtJgiR4hYkzrtQz3PYO85S5dlJ91STpFZN098xb4Fwx/01zluzT1sJ6eD 64rEEoaVycrrcpyF8aGXzOMhP4N9yeJ7IZg4o567JHp0EXKEWDzxOG2I+hRy8T/xbl/o C54FBvnmDo+3IJQspPhGCd7au0dEGUNubwNtekIfcFEJje7e/EBe5o9lYCVSEYbG1gAe 3/cfJQT7tRkbDn0OJZ3XKAZg1eaq73QLT6HEBf/shbIkjvhQRfxLMOgkt3o1qqLi+u6Z JzbQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1692395658; x=1693000458; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=hqIvn+d5AvqCRErBR/oPUPCf6IRAW3bNEhD1osQf/YU=; b=j9QenKSoPP8fd8sTi2Bkv6WqIjmuAb5ljl8TUuqjc3dWKfp3c5r5DrMfwRRnCxouX9 udEbm9je5NTy4D5y5DOe87yciJLp1ixtrwYqbHYt36JCf3WLZY1BwvF8IK7KXNXVrB3X m8aN0pnc4yM6J/Su6kPSValmCdMdlDUFn9o2xdnKxr2dOrTcs6xFli5NsmtV/qLHVJPc U3w15xXTESPPVEUnVTPpetOC0z8Saf92apVI8kIMvcsZXwY5GZYiistj1/sb5YBxyfNi 1c4j0tIjtncDDD+6xGYc7lidXnZOvyUuYN1ZX6DsHW87shpQ7+4TL2zKEjqy36DAMwCw 4j9w== X-Gm-Message-State: AOJu0YzH0Vz0fezFt/lVBoz7Uz6zZD72xLyxrWRn0UaTmxACBg0BdzTq Mr/qVYq1oI4bq81UFTW7luP92YfJt4GzjnqILT7E48HduMA= X-Google-Smtp-Source: AGHT+IGX3DmsEHilQVl9jUfy6Na/KjKt6540x/VCQEzI/yx0ISiDRRzIOx18wGBjoDhwH1DNnFbIQ932kAwdnUlRhSA= X-Received: by 2002:a25:9f8e:0:b0:d24:985b:a386 with SMTP id u14-20020a259f8e000000b00d24985ba386mr433836ybq.57.1692395657980; Fri, 18 Aug 2023 14:54:17 -0700 (PDT) List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@freebsd.org MIME-Version: 1.0 References: <503561ece3e7201318c298c2d5b91eb5@mail.yourbox.net> In-Reply-To: <503561ece3e7201318c298c2d5b91eb5@mail.yourbox.net> From: Kevin Oberman Date: Fri, 18 Aug 2023 14:54:01 -0700 Message-ID: Subject: Re: em0: No buffer space available for IPv6 traffic but IPv4 is OK To: =?UTF-8?B?Sm9zw6kgUMOpcmV6?= Cc: freebsd-net@freebsd.org Content-Type: multipart/alternative; boundary="0000000000000376d80603399218" X-Rspamd-Queue-Id: 4RSFyL6tvQz4cw8 X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] --0000000000000376d80603399218 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Fri, Aug 18, 2023 at 1:02=E2=80=AFAM Jos=C3=A9 P=C3=A9rez = wrote: > Hi, > on this intel em0 > # dmesg |fgrep em0 > em0: port 0xd800-0xd81f mem > 0xfe9e0000-0xfe9fffff,0xfe9dc000-0xfe9dffff irq 48 at device 0.0 on pci1 > em0: Using 1024 TX descriptors and 1024 RX descriptors > em0: Using 2 RX queues 2 TX queues > em0: Using MSI-X interrupts with 3 vectors > em0: Ethernet address: xx:xx:xx:xx:xx:xx > em0: netmap queues/slots: TX 2/1024, RX 2/1024 > > IPv4 and IPv6 used to work seamlessly for the past 6+ years. > > # ifconfig em0 > em0: flags=3D8843 metric 0 mtu > 1500 > > > options=3D81249b > ether xx:xx:xx:xx:xx:xx > inet xxx.xxx.xxx.xxx netmask 0xffffff00 broadcast > xxx.xxx.xxx.255 > inet6 fe80::xxxx:xxxx:xxxx:xxxx%em0 prefixlen 64 scopeid 0x1 > inet6 2xxx:xxxx:xxxx:xxxx::1 prefixlen 64 > media: Ethernet autoselect (100baseTX ) > status: active > nd6 options=3D23 > > Nevertheless, now IPv6 traffic does not work anymore: > # ping6 www.google.com > PING6(56=3D40+8+8 bytes) 2xxx:xxxx:xxxx:xxxx::1 --> 2yyy:yyyy:yyyy:yyyy::= 1 > ping6: sendmsg: No buffer space available > ping6: wrote www.google.com 16 chars, ret=3D-1 > > From send(2): > [...] > [ENOBUFS] The system was unable to allocate an internal > buffer. > The operation may succeed when buffers become > available. > > [ENOBUFS] The output queue for a network interface was > full. > This generally indicates that the interface has > stopped sending, but may be caused by transient > congestion. > [...] > > There is little traffic on the interface and it seems that buffers are > available: > # netstat -m > 2108/3472/5580 mbufs in use (current/cache/total) > 2062/1336/3398/1018874 mbuf clusters in use (current/cache/total/max) > 15/1250 mbuf+clusters out of packet secondary zone in use > (current/cache) > [...] > > Interestingly, there is incoming IPv6 local broadcast traffic as sniffed > by > # tcpdump -n -i em0 ip6 > (ICMP6, neighbor solicitation, UDP from LAN link local addresses). > > Has anyone seen this before and can suggest a fix? > > Reboot did not solve, no software updates made, no config changes, just > stop working from one day to the next. > > Thank you. > > -- > Jos=C3=A9 P=C3=A9rez > Oddly, ENOBUFS is the error I get when my firewall is blocking transmit traffic. There may well be other causes. --=20 Kevin Oberman, Part time kid herder and retired Network Engineer E-mail: rkoberman@gmail.com PGP Fingerprint: D03FB98AFA78E3B78C1694B318AB39EF1B055683 --0000000000000376d80603399218 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
On Fri, Aug 18, 2023 at 1:02=E2= =80=AFAM Jos=C3=A9 P=C3=A9rez <fbl@aoek.= com> wrote:
Hi,
on this intel em0
# dmesg |fgrep em0
em0: <Intel(R) Gigabit CT 82574L> port 0xd800-0xd81f mem
0xfe9e0000-0xfe9fffff,0xfe9dc000-0xfe9dffff irq 48 at device 0.0 on pci1 em0: Using 1024 TX descriptors and 1024 RX descriptors
em0: Using 2 RX queues 2 TX queues
em0: Using MSI-X interrupts with 3 vectors
em0: Ethernet address: xx:xx:xx:xx:xx:xx
em0: netmap queues/slots: TX 2/1024, RX 2/1024

IPv4 and IPv6 used to work seamlessly for the past 6+ years.

# ifconfig em0
em0: flags=3D8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mt= u
1500

options=3D81249b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,LRO,W= OL_MAGIC,VLAN_HWFILTER>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0ether xx:xx:xx:xx:xx:xx
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0inet xxx.xxx.xxx.xxx netmask 0xffffff00 b= roadcast
xxx.xxx.xxx.255
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0inet6 fe80::xxxx:xxxx:xxxx:xxxx%em0 prefi= xlen 64 scopeid 0x1
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0inet6 2xxx:xxxx:xxxx:xxxx::1 prefixlen 64=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0media: Ethernet autoselect (100baseTX <= ;full-duplex>)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0status: active
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0nd6 options=3D23<PERFORMNUD,ACCEPT_RTA= DV,AUTO_LINKLOCAL>

Nevertheless, now IPv6 traffic does not work anymore:
# ping6 www.google.com
PING6(56=3D40+8+8 bytes) 2xxx:xxxx:xxxx:xxxx::1 --> 2yyy:yyyy:yyyy:yyyy:= :1
ping6: sendmsg: No buffer space available
ping6: wrote www.google.com 16 chars, ret=3D-1

=C2=A0From send(2):
[...]
=C2=A0 =C2=A0 =C2=A0 [ENOBUFS]=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 The system= was unable to allocate an internal
buffer.
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0The operation may succeed when buffers become
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0available.

=C2=A0 =C2=A0 =C2=A0 [ENOBUFS]=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 The output= queue for a network interface was
full.
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0This generally indicates that the interface has
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0stopped sending, but may be caused by transient
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0congestion.
[...]

There is little traffic on the interface and it seems that buffers are
available:
# netstat -m
2108/3472/5580 mbufs in use (current/cache/total)
2062/1336/3398/1018874 mbuf clusters in use (current/cache/total/max)
15/1250 mbuf+clusters out of packet secondary zone in use
(current/cache)
[...]

Interestingly, there is incoming IPv6 local broadcast traffic as sniffed by
# tcpdump -n -i em0 ip6
(ICMP6, neighbor solicitation, UDP from LAN link local addresses).

Has anyone seen this before and can suggest a fix?

Reboot did not solve, no software updates made, no config changes, just stop working from one day to the next.

Thank you.

--
Jos=C3=A9 P=C3=A9rez

Oddly, ENOBUF= S is the error I get when my firewall is blocking transmit traffic. There m= ay well be other causes.
--
Kevin = Oberman, Part time kid herder and retired Network Engineer
E-mail: rkoberman@gmail.com=
PGP Fingerprint: D03FB98AFA78E3B78C1694B318AB39EF1B055683
--0000000000000376d80603399218--