From nobody Sun May 01 04:18:02 2022 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C33531AB3B78 for ; Sun, 1 May 2022 04:18:13 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic315-8.consmr.mail.gq1.yahoo.com (sonic315-8.consmr.mail.gq1.yahoo.com [98.137.65.32]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KrXyX60kJz3t58 for ; Sun, 1 May 2022 04:18:12 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1651378685; bh=h52fvnteuRrGDPBs9wfz50y8qei/0CWe/9kbtnioYVY=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=LBhFooBSzqtqInP+47/xclxUybNsJUMOwUX2g+v09hzoCqXpBzUp/3w4HcRpqZ4/TpxcgzZop9Kzhyg1fQADSM1EuwsWVa+FWHGXQF9JST3/MgAas6RGG1t3382ZbYFd7Yq9uZJBOHXLVXfkV7SLF/x7wTAyJqqeB7aRRPBEeibEMNrRxFieZhX0leVr0TinTA0oL6bUTF0EKS1wfTgYMm3TtutgGtjUcxhuCquqt+lnaU75sB4UcTMRyWy0zFf5C7698qu/awNOctfsi7WN67tAviZstCr3XpaBbsdJW3JRNjZiivyJvASTWRXt8UaUEBKV8CejlPDTDiQnyLv6cA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1651378685; bh=R4V/a6mHBCOaqNleVWFwnOgUDaW8kTz2oPHeDku2uV3=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=BFx/rFWSo5TGVBUjQwUe6xSfKilrdGcWNsyVz2YcsMy+O8FE6wh5oC9OEqsrzIvUmJlyqWvBPbexVk28h7wq/rOqyUo4YThspZF9qjE9yBgsWN7suRHLaHxfiP4Wpv6pF8fRsVyiUUXhfj9UAZPSLGg8pbreHY45i/bMgmoEX1N9m/EGdXaLdKAo8OfaV2i+d7byOM1zUgeGc0cNMsM2PRFz4nGJ5AOyP3L9nYjPl5HrlOpGT6WMl/urhaytahUh0Cw8M8WAB4ItpGik8RTpxmEZwPAi6SfWpOnBHMCKZRUrANeSNrUd1+WvFeqGwf0H1NMhndaKiDbBy2EjRS9cYA== X-YMail-OSG: GBEgD.EVM1lJ0UcB5TDxmxSijQo0cMMaGBO6p4MdKt3KKGeqMV_ZbnzklDWHoJi GMqmfbjAjQiksbqAvKNRLZLiK6ZOprhr8IPVKOZ9MqxMcxx35CEUR1wFaOfI1gZ.64zXwaUCwiBn NjfODc45qg.iCW9lKqs6fWNGvEJyVtej05XXYsCd5qSoj87x8s3rMqjDd2NSk0ULcvJ6wxaS6a7p UScWDHyiV7fssxYFZ_LHBJKdRK30SRCsg_cBxDPjnWO73xa8D0na63uU4kwRQ8NY5UZZLeBhFzRc iVnqZA7TqivLKBLuT_2a.se34ZS04ZtOj43f9kju7Gm_aooJ417xGSwYRq7D.BzKybWzPrbBSfWc u8hxY..NC4M_8Pzu.cr5msraAlZEnE9zRan8RsIggyJEj_V8Wx6rXrhohge9wuup11LjLBL89LLk 8PtusdgDMgFm9z5V6og.VljX3hh1Guut1DcQOBd8Nry216Mql_lbrCT7wZpqK4wR0TQ.6bbZdO.s fNM7b29YurBMg9oZB.WgRJCnozXOvizs8qB69ZrhZPMBbaifHaFyEPuCurSgJeegovrnMn4fL28g xkFtzczkxzt03naTD7sfbjnzM7en7tJ99OuqZexw1SR3zhATU0kloQZZsGPy0OpRWQVrw39cEK1U xxSr.P3iwiR5QJixvgbJ85iYVYF7MBUPciOBgz5jPZGuHYB9ixICwuG3THuikj29m5wxzOO7WBqT tBw.MZatOAIjGX3jdwi5Ai_Ox1RIZ3E6bHaWteQlwctjWqe.r5iOsf7xrIFLRUfsgrKqPrTfZkYg iDL842pjlgpy2AQXyiFDOdJ28O7Qe9Jk3DzQuqBe_J9j3DwN7lEjgzpLLUKtTav5V4n75bd5JC54 3FqjWUNnsXF3iGsQ61v6AZ8JFWeU6_OogIjTYW6rar0fAhqxRO8xm0qWbzf10QJw_BdvochZcQvZ SQfQ3Hy9w2_O8EB_FmB4uSJfoS46XSsAtk3VTVMNqWbj0PWXeXmQ8roCPHhlx6zxxmsnSrkyh8es mKiuwM31HZSv22Ne4e6z6bsfFzV5yy0Dgf5sAbzsnfzurFYG7EiRvbg3GNoB635_bYpuoDFNbkVZ CjxysJiUBkembH5xf3mTxlRCiA6iu6DTrFdsPphtKw2umYV_Z6aOgjy.9MQgnBR8vitzkO_tuEaD _suICb9JkyCu6.wFTwS2A7Pwf71RObJYgs8n50dpn0PDdDOLLyqDr3AdfXS1zOOot5QKOLVN2lnQ yOV4z2W7RNwt.cAxjfHmCF.grBUiNx2bLgI8RunUCDnga_fj9GinllKaRpH99WmCNrnNK9KQAU5X ZE.NPHBfdtGlU7gO7QNX8XvZbHurRxh5bgkBCKEXysPyFkDD98AJUzLxrhkX49kxQoFMKEgYH9n5 E3v3WX_4pWuTpsOb3CCdp6Ye9ZcPNpwtVPdUTtUeCayy0XiYsPjsxuHTXlacGTACywhxUc1N6NRX gf6jvNhAlLbKJfjUnCdsrxeOUk7KD8WxyS7Tb6fZ4EjWuEphFghItJA9gNd_XkFwFQYkJW2KUIyG 8PY8CEb21mMI7duTLIcNQebV34RE_FJcH2sNwVxP_HPmC6NDmRmrC0eLu1lO7SNmkz2qHeELMON8 otxN6.wRVXpkCyfRoJkDLIYPHCIuw3uWzBf1Hf8ZLMYqbDHrpeVWZ9xb8k1XJLEKKIAje5YOISSg HwSPe96BPAePVa1b4qi8wM5rMPZ0Bn40k8fvlxpJSx9sGE3a5CCumu4dY8uA4P2GyEN__fvXxHQA _YLM.I2ArrL_OOltS.86rOQil5uMUOdN_7vhOFda0Cyry.uKBsCsNFF2fyM0P3C_yL2UAYqeqxS6 cDZDbNr3XGJkidrzSaIKPlP4XNXR25NJrtFKVqME9dfKtzULMbcukvkvMZkuzgcrl9PJzW4jsrtc 0Pj7dypBaWh.IJk8J54u_gA_ZR5Ggq34t7w81JwnCGWtderhOOhyb7oUJXkdPMM4Q5B4_pYfq.WV 0VK8oq0tUqp2lz898HlZXM4wc8XtCNc9J_8CiKDZPIBtxNBRvKPdMQVJTyXN_JoOB3SwpQiQdscI TpCobFfMb7t.Vw.lKTYiCB7kzfmm12wIcRPhr9xaqv0YkRrunEnTtHrbZ1c8H3fnz0Td85SPAMV4 Pk.IwJVoYF4I679j4UTtQo0lYfORUMsIGffDHSNMdfgKtH8ldWrgqVU2FFUhQvniN99BdiT16tKT iHUDwGJ0M3BwhRsJ0g0rEI1aV_hZX8wJztV4EQPgB7SzU6.aKCF0YWxCq30kmXkJZtr986XBKO5r DMNyE3YhFtaO0tZhg8UU- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic315.consmr.mail.gq1.yahoo.com with HTTP; Sun, 1 May 2022 04:18:05 +0000 Received: by hermes--canary-production-ne1-75b69fcf97-cj84z (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 928a73409a23d54343fc16fef23a7b46; Sun, 01 May 2022 04:18:04 +0000 (UTC) Content-Type: text/plain; charset=utf-8 List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.120.0.1.13\)) Subject: Re: 60+% ping packet loss on Pi3 under -current and stable-13 From: Mark Millard In-Reply-To: <20220501011125.GC10723@www.zefox.net> Date: Sat, 30 Apr 2022 21:18:02 -0700 Cc: freebsd-net@freebsd.org, freebsd-arm@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <2B08DA24-34F7-4547-8B4E-96C9C8791D10@yahoo.com> References: <20220314010330.GA70447@www.zefox.net> <9FA3F874-2987-44A2-A987-F905E78CCA65@yahoo.com> <20220428023226.GA5666@www.zefox.net> <8A57B411-AA06-47F4-935D-EDF45D8DF0EC@yahoo.com> <70C2DF4B-D08B-491D-B7B5-1EAD0D1BF0E3@yahoo.com> <20220429005206.GA1171@www.zefox.net> <20220430021207.GA7600@www.zefox.net> <20220501011125.GC10723@www.zefox.net> To: bob prohaska X-Mailer: Apple Mail (2.3654.120.0.1.13) X-Rspamd-Queue-Id: 4KrXyX60kJz3t58 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=LBhFooBS; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.32 as permitted sender) smtp.mailfrom=marklmi@yahoo.com X-Spamd-Result: default: False [-3.50 / 15.00]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; NEURAL_HAM_LONG(-1.00)[-1.000]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.32:from]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MLMMJ_DEST(0.00)[freebsd-arm]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim] X-ThisMailContainsUnwantedMimeParts: N On 2022-Apr-30, at 18:11, bob prohaska wrote: > On Fri, Apr 29, 2022 at 08:14:27PM -0700, Mark Millard wrote: >> On 2022-Apr-29, at 19:12, bob prohaska wrote: >>=20 >>> Since about December of 2021 I've been noticing problems with >>> wired network connectivity on a pair of raspberry pi 3 machines >>> using wired network connections. One runs stable-13.1, the other >>> runs -current, both are up to date as of a few days ago. >>=20 >> Compared to your later notes about 192.168.1.n style use, >> are any of the above that way? Or are the all well-analogous >> to the "on the public network" context mentioned later? >>=20 > Not sure I follow what you're getting at, could you clarify > please? The move between public and private networks was done > by changing comment delimiters in /etc/rc.conf and moving > cables between public switch and private router. Only the two > Pi3s have so far failed to answer pings and ssh connections > after reboot.=20 >=20 What, if anything, has been tested that did not fail to answer pings and ssh connections after reboot on the public network? Any other types of RPi*'s? For example, temporarily moving a RPi4B from the private network to the public one, but booted from the same 13.1-RC4 microsd card as used for the RPi3B test, would allow checking if the problem happens on the additional type of RPi*. Testing a RPi2 v1.1 could not use the same 13.1-RC4 microsd card content as the RPi3B's can. Still a useful test, but I mention RPi4B above because it can boot from the same media content as was used for the RPI3B testing. >>> Essentially both machines fail to respond to inbound network >>> connections via ssh or ping after reboot. If I get on the=20 >>> serial console and start an outbound ping to anywhere, both >>> machines respond to incoming pings with about a 65% packet >>> loss. Ssh connections are answered with delays of zero to >>> perhaps thirty seconds. Once connected ssh is usable but >>> erratic, with dropped characters, multi-second delays and >>> disconnects after random intervals from minutes to hours. >>>=20 >>> There are five other Raspberry Pi's on the network. Three >>> Pi2's run 12.3-stable, one Pi2 runs -current >>=20 >> RPi2 v1.2's used as aarch64? (So similar to RPi3*'s.) > No, the Pi2s are v1.1. >> RPi2 v1.1's (armv7)? > Yes. Good to know. >=20 >> Which type of RPi3* variant? B? B+? Revision? >>=20 > The stable/13 machine reports: > bob@pelorus:~ % sysctl -a | grep model > hw.model: ARM Cortex-A53 r0p4 > hw.fdt.compatible: raspberrypi,3-model-b brcm,bcm2837 > hw.fdt.model: Raspberry Pi 3 Model B Rev 1.2 A RPi3B+ would be Rev 1.3 based on the table near the bottom of the page at: https://www.raspberrypi.com/documentation/computers/raspberry-pi.html No Rev 1.2 or before for RPi3B+. The only revision code documented for such a B+ is a020d3. But there is such a thing as a non-+ RPi3B with Rev 1.3 as well. But most of the revision codes for them are Rev 1.2. I'll note that if the RPi* firmware debugging output is enabled via config.txt then there are lines in the output identifying the exact .dtb file that is used as the starting point: MESS:00:00:02.136715:0: dtb_file 'bcm2710-rpi-3-b.dtb' MESS:00:00:02.140152:0: Trying Device Tree file 'bcm2710-rpi-3-b.dtb' MESS:00:00:02.155700:0: brfs: File read: /mfs/sd/bcm2710-rpi-3-b.dtb MESS:00:00:02.160357:0: Loading 'bcm2710-rpi-3-b.dtb' to 0x4000 size = 0x70fb The names are as below and indicate the plus or not expllicitly: bcm2710-rpi-2-b.dtb bcm2710-rpi-3-b-plus.dtb bcm2710-rpi-3-b.dtb bcm2710-rpi-cm3.dtb bcm2711-rpi-4-b.dtb bcm2711-rpi-400.dtb bcm2711-rpi-cm4.dtb Enabling the debug output looks like: enable_uart=3D1 uart_2ndstage=3D1 dtdebug=3D1 > dev.smscphy.0.%pnpinfo: oui=3D0x800f model=3D0xc rev=3D0x3 > bob@pelorus:~ %=20 >=20 > and the -current machine reports:=20 > bob@www:~ % sysctl -a | grep -i model > Memory Model Features 0 =3D > Memory Model Features 1 =3D <8bit VMID> > Memory Model Features 2 =3D <32bit CCIDX,48bit VA> > hw.model: ARM Cortex-A53 r0p4 > hw.fdt.compatible: raspberrypi,3-model-b brcm,bcm2837 > hw.fdt.model: Raspberry Pi 3 Model B Rev 1.2 Again, if the Rev. 1.2 is accurate, it is unlikely to be a RPi3B+ . > dev.smscphy.0.%pnpinfo: oui=3D0x800f model=3D0xc rev=3D0x3 > bob@www:~ %=20 >=20 > That's slightly surprising, since they are of different age and > one has WiFi, not sure which. I believe that makes one a B+ though > I gather FreeBSD still doesn't support the on-board WiFi. Either > way, I thought the wired ethernet setup was identical.=20 >=20 Both have WiFi: all RPi3's have WiFi. QUOTING https://www.raspberrypi.com/products/raspberry-pi-3-model-b/ : Specification Raspberry Pi 3 Model B is the earliest model of the third-generation = Raspberry Pi. It replaced Raspberry Pi 2 Model B in February 2016. See = also Raspberry Pi 3 Model B+, the latest product in the Raspberry Pi 3 = range. =E2=80=A2 Quad Core 1.2GHz Broadcom BCM2837 64bit CPU =E2=80=A2 1GB RAM =E2=80=A2 BCM43438 wireless LAN and Bluetooth Low Energy (BLE) = on board . . . END QUOTE What was different was the vintage of WiFi for the RPi3B+ : QUOTING = https://www.raspberrypi.com/products/raspberry-pi-3-model-b-plus/ : Specification The Raspberry Pi 3 Model B+ is the final revision in the Raspberry Pi 3 = range. =E2=80=A2 Broadcom BCM2837B0, Cortex-A53 (ARMv8) 64-bit SoC @ = 1.4GHz =E2=80=A2 1GB LPDDR2 SDRAM =E2=80=A2 2.4GHz and 5GHz IEEE 802.11.b/g/n/ac wireless LAN, = Bluetooth 4.2, BLE . . . END QUOTE So RPi3B+ had 5 GhZ 802.11.n and 802.11.ac . The one that I tested via a private network was also a RPi3B (non-+). I do not have access to a RPi3B+ . The RPi3B+ has different EtherNet, faster. Right hand side is again quoting those pages: RPI3B : =E2=80=A2 100 Base Ethernet RPi3B+: =E2=80=A2 Gigabit Ethernet over USB 2.0 (maximum throughput 300 = Mbps) >>> and a Pi4 runs >>> -current. All have no problems pinging one another and out >>> of network, so there's nothing obviously wrong with the net. >>> The network is not routed, but rather a block of eight >>> addresses simply bridged from my ISP over DSL. >>>=20 >>> It's been found that an image of 13.1-RC4 behaves similarly >>> on one Pi3 when on the public network but exhibits more normal >>> ping response when moved to a 192.168.1.n private network.=20 >=20 > Just to be clear, it was the same Pi3, I moved the cables and=20 > changed lines in /etc/rc.conf to make the switch. >=20 Yep. I've suggested testing a RPi4B via such switching of cables and /etc/rc.conf adjustment. >>> On the face of it, this seems significant, but I can't guess how. >>=20 >> Did you try a RPi4B on the public network, booted using the >> same 13.1-RC4 microsd card you used in the RPi3* testing? >> (Modern aarch64 RPi* images should boot either type of >> aarch64 RPI*.) >>=20 >=20 >> If yes, what was the behavior like? Did it behave like the >> RPi3*? >>=20 >> If no, it should be a good test for how specific the problem >> is to the RPi3* vs. RPi*'s more generally. >>=20 >=20 > I haven't tried yet, since the Pi4 was on the private network to > begin with and it has never had problems answering ping and ssh. The question that is left is if it would have problems on the public network vs. not. I can not reasonably predict that based on the private network result. > AIUI the Pi4 ethernet is on PCIe, while the Pi3 uses USB. If the > Pi4 failed to answer ping when running the snapshot I guess that > would point to either faulty media or a different place in the > network software. Perhaps worth a try.=20 >=20 Yep, that is a kind of information I was after. >=20 >> Testing a EtherNet dongle known to use a different driver >> could also be a form of cross check, if you happen to have >> such available. >=20 > My only alternative Ethernet adapter is a Ralink WiFi dongle. > My WiFi is private-network only, and the snapshot worked reasonably > well when wired on the private network. A wired adapter would be > more informative, but I'll have to figure out what to order.=20 Only being able to test a private network definately limits the utility of the such a test (WiFi test). I'm not sure if you want to get a device just for the test activity at this point. =3D=3D=3D Mark Millard marklmi at yahoo.com