From nobody Thu Jul 11 14:06:18 2024 X-Original-To: freebsd-virtualization@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4WKc3l2DCnz5QjX0 for ; Thu, 11 Jul 2024 14:06:59 +0000 (UTC) (envelope-from odhiambo@gmail.com) Received: from mail-oo1-xc2b.google.com (mail-oo1-xc2b.google.com [IPv6:2607:f8b0:4864:20::c2b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4WKc3k3qsfz4wqq for ; Thu, 11 Jul 2024 14:06:58 +0000 (UTC) (envelope-from odhiambo@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b="jUo02/VZ"; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of odhiambo@gmail.com designates 2607:f8b0:4864:20::c2b as permitted sender) smtp.mailfrom=odhiambo@gmail.com Received: by mail-oo1-xc2b.google.com with SMTP id 006d021491bc7-5c9fea3b566so573580eaf.0 for ; Thu, 11 Jul 2024 07:06:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1720706816; x=1721311616; darn=freebsd.org; h=to:subject:message-id:date:from:mime-version:from:to:cc:subject :date:message-id:reply-to; bh=4ABkS4pGvc3WxocVdWJ93kwapp5vb1tgcuHaF5blRRQ=; b=jUo02/VZ7wgrbg4f8pxW9mv9Y5KQqTEBzIKb5K1/tqOjHcx68wbipfdl2vNsG/MJmZ muTAZJHGNrW69YpiAZNk2ophR/Q4YSGesXbeZ68mp3AMtp75ShNCT72ynDN3MKP9UkKH URc9YFcAjNRgS7lOMQ9MqDYzSqZJnGo3ErNQVKpDsYIdNNsBhItksoSrBEf7RM+3S1kN amyroVBWcTMuCvDXLiBatn862Ms/r+3Xdhni7MNz7UhZDp9DpVYF451lG4Eceu+2Ogt2 dkZ95Bti8C/ySxDwuEVH4E/IuryIvlg6BSE+HwlL15hjZX5hVqcFHMkhQxkI4hBPlbjp ukTg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1720706816; x=1721311616; h=to:subject:message-id:date:from:mime-version:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=4ABkS4pGvc3WxocVdWJ93kwapp5vb1tgcuHaF5blRRQ=; b=iuM+rlXKDC1+f5zkSwr3ENt3vQrGWVqP3onOfrg9xfLkMtULAmvNvlXV9pEia5wsPZ 2lFEDKxa3GDfvgs8Tx5vhERSZILnW34z9z7xYgt4mJZ5aOMMrsQ476G11Ms6Wms6bnYi VnrhUpEqiBo0PmdbBOfHHSokpL5VB5mTVhg/Ul1e6R3pskhQWXGkMkAEua5GdmGI257R LDRxbcwuzSKta9/YTn3PTeHrxWz5sx3G7JozA5PqSb4wIPFXs7FroWb9/wmp9kqlmTJB iH8ghMt4NyH6WP1+HZcYGHAbcAWJGdCXvOjTtJc4S9arEr0XFCEkvmrnDxbbUaPXVmJH rVpA== X-Gm-Message-State: AOJu0YxkA+6F7hFSlqOc2IkaCjfKhI6w8uHayQcoNAIfpYkTv1QDKtGs 7Zi40uZBnaXqGQvoEXt+dHR35NZTQLGeBxsQP+jAOUI+klFWclYFQFqESqLkTQdk/kr+1cX8uB3 rK7gz+3S1KdE2xRNwmXbp2Hk4CtbyXD88Tlv5kSzW X-Google-Smtp-Source: AGHT+IGqfkLm/g539S2GC8DoSJ/m0SxwtnwsyVV/0OHlNnUg+WVrphfcO8tA+Yuug+BflkrthyFB/q/4vPBaAHR9oXo= X-Received: by 2002:a05:6870:8a26:b0:259:8858:a330 with SMTP id 586e51a60fabf-26039698d68mr1271016fac.22.1720706815420; Thu, 11 Jul 2024 07:06:55 -0700 (PDT) List-Id: Discussion List-Archive: https://lists.freebsd.org/archives/freebsd-virtualization List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-virtualization@freebsd.org Sender: owner-freebsd-virtualization@FreeBSD.org MIME-Version: 1.0 From: Odhiambo Washington Date: Thu, 11 Jul 2024 17:06:18 +0300 Message-ID: Subject: Suddenly unable to access VMs To: FreeBSD virtualization Content-Type: multipart/alternative; boundary="0000000000007ef20c061cf946be" X-Spamd-Bar: --- X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; TO_DN_ALL(0.00)[]; RCVD_TLS_LAST(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ARC_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FREEMAIL_FROM(0.00)[gmail.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MISSING_XM_UA(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; PREVIOUSLY_DELIVERED(0.00)[freebsd-virtualization@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; MID_RHS_MATCH_FROMTLD(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MLMMJ_DEST(0.00)[freebsd-virtualization@freebsd.org]; RCVD_COUNT_ONE(0.00)[1]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::c2b:from] X-Rspamd-Queue-Id: 4WKc3k3qsfz4wqq --0000000000007ef20c061cf946be Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable My bhyve VMs have been all fine until now. I can't ping them and can't SSH into them. However, I can connect to them with VNCViewer from a remote host (my PC from my house) :-( I haven't done any changes on the host at all. dnsmasq is running, but seems like the VMs aren't getting the IPs for some reason. ``` cloned_interfaces=3D"bridge0 tap0 tap1 tap2 tap3 tap4 tap5" ifconfig_bridge0_name=3D"vmbridge" ifconfig_vmbridge=3D"addm em1 addm tap0 addm tap1 addm tap2 addm tap3 addm tap4 addm tap5 up" ifconfig_vmbridge_alias0=3D"inet 172.16.0.1 netmask 255.255.255.0" ``` What might have happened? root@gw:/home/wash # ifconfig vmbridge vmbridge: flags=3D1008843 metric 0 mtu 1500 options=3D0 ether 58:9c:fc:10:df:1d inet 172.16.0.1 netmask 0xffffff00 broadcast 172.16.0.255 id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15 maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200 root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0 member: tap5 flags=3D143 ifmaxaddr 0 port 10 priority 128 path cost 2000000 member: tap4 flags=3D143 ifmaxaddr 0 port 9 priority 128 path cost 2000000 member: tap3 flags=3D143 ifmaxaddr 0 port 8 priority 128 path cost 2000000 member: tap2 flags=3D143 ifmaxaddr 0 port 7 priority 128 path cost 2000000 member: tap1 flags=3D143 ifmaxaddr 0 port 6 priority 128 path cost 2000000 member: tap0 flags=3D143 ifmaxaddr 0 port 5 priority 128 path cost 2000000 member: em1 flags=3D143 ifmaxaddr 0 port 2 priority 128 path cost 55 groups: bridge nd6 options=3D9 root@gw:/home/wash # ssh 172.16.0.99 ssh: connect to host 172.16.0.99 port 22: Permission denied root@gw:/home/wash # ssh 172.16.0.100 ssh: connect to host 172.16.0.100 port 22: Permission denied root@gw:/home/wash # ping 172.16.0.100 PING 172.16.0.100 (172.16.0.100): 56 data bytes ping: sendto: Permission denied ping: sendto: Permission denied ping: sendto: Permission denied ping: sendto: Permission denied ^C --- 172.16.0.100 ping statistics --- 4 packets transmitted, 0 packets received, 100.0% packet loss root@gw:/home/wash # ping 172.16.0.99 PING 172.16.0.99 (172.16.0.99): 56 data bytes ping: sendto: Permission denied ping: sendto: Permission denied ping: sendto: Permission denied ^C --- 172.16.0.99 ping statistics --- 3 packets transmitted, 0 packets received, 100.0% packet loss root@gw:/home/wash # service dnsmasq status dnsmasq is running as pid 4190. root@gw:/home/wash # --=20 Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 In an Internet failure case, the #1 suspect is a constant: DNS. "Oh, the cruft.", egrep -v '^$|^.*#' =C2=AF\_(=E3=83=84)_/=C2=AF :-) [How to ask smart questions: http://www.catb.org/~esr/faqs/smart-questions.html] --0000000000007ef20c061cf946be Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
My bhyve VMs have been all fine until=C2=A0now.
I can&= #39;t ping them and can't SSH into them. However, I can connect to them= with VNCViewer from a remote host (my PC from my house) :-(

=
I haven't done any changes on the host at all.
dns= masq is running, but seems like the VMs aren't getting the IPs for some= reason.

```
cloned_interfaces=3D"b= ridge0 tap0 tap1 tap2 tap3 tap4 tap5"
ifconfig_bridge0_name=3D"= ;vmbridge"
ifconfig_vmbridge=3D"addm em1 addm tap0 addm tap1 a= ddm tap2 addm tap3 addm tap4 addm tap5 up"
ifconfig_vmbridge_alias0= =3D"inet 172.16.0.1 netmask 255.255.255.0"
```
= What might have happened?


root@gw:/= home/wash # ifconfig vmbridge
vmbridge: flags=3D1008843<UP,BROADCAST,= RUNNING,SIMPLEX,MULTICAST,LOWER_UP> metric 0 mtu 1500
=C2=A0 =C2=A0 = =C2=A0 =C2=A0 options=3D0
=C2=A0 =C2=A0 =C2=A0 =C2=A0 ether 58:9c:fc:10:= df:1d
=C2=A0 =C2=A0 =C2=A0 =C2=A0 inet 172.16.0.1 netmask 0xffffff00 bro= adcast 172.16.0.255
=C2=A0 =C2=A0 =C2=A0 =C2=A0 id 00:00:00:00:00:00 pri= ority 32768 hellotime 2 fwddelay 15
=C2=A0 =C2=A0 =C2=A0 =C2=A0 maxage 2= 0 holdcnt 6 proto rstp maxaddr 2000 timeout 1200
=C2=A0 =C2=A0 =C2=A0 = =C2=A0 root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
=C2=A0 = =C2=A0 =C2=A0 =C2=A0 member: tap5 flags=3D143<LEARNING,DISCOVER,AUTOEDGE= ,AUTOPTP>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 ifm= axaddr 0 port 10 priority 128 path cost 2000000
=C2=A0 =C2=A0 =C2=A0 =C2= =A0 member: tap4 flags=3D143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
= =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 ifmaxaddr 0 port 9 = priority 128 path cost 2000000
=C2=A0 =C2=A0 =C2=A0 =C2=A0 member: tap3 = flags=3D143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
=C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 ifmaxaddr 0 port 8 priority 128 path= cost 2000000
=C2=A0 =C2=A0 =C2=A0 =C2=A0 member: tap2 flags=3D143<LE= ARNING,DISCOVER,AUTOEDGE,AUTOPTP>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 ifmaxaddr 0 port 7 priority 128 path cost 2000000
= =C2=A0 =C2=A0 =C2=A0 =C2=A0 member: tap1 flags=3D143<LEARNING,DISCOVER,A= UTOEDGE,AUTOPTP>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 ifmaxaddr 0 port 6 priority 128 path cost 2000000
=C2=A0 =C2=A0 =C2= =A0 =C2=A0 member: tap0 flags=3D143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP&g= t;
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 ifmaxaddr 0 p= ort 5 priority 128 path cost 2000000
=C2=A0 =C2=A0 =C2=A0 =C2=A0 member:= em1 flags=3D143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
=C2=A0 =C2=A0= =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 ifmaxaddr 0 port 2 priority 128 = path cost 55
=C2=A0 =C2=A0 =C2=A0 =C2=A0 groups: bridge
=C2=A0 =C2=A0= =C2=A0 =C2=A0 nd6 options=3D9<PERFORMNUD,IFDISABLED>
root@gw:/hom= e/wash # ssh 172.16.0.99
ssh: connect to host 172.16.0.99 port 22: Permi= ssion denied
root@gw:/home/wash # ssh 172.16.0.100
ssh: connect to ho= st 172.16.0.100 port 22: Permission denied
root@gw:/home/wash # ping 172= .16.0.100
PING 172.16.0.100 (172.16.0.100): 56 data bytes
ping: sendt= o: Permission denied
ping: sendto: Permission denied
ping: sendto: Pe= rmission denied
ping: sendto: Permission denied
^C
--- 172.16.0.10= 0 ping statistics ---
4 packets transmitted, 0 packets received, 100.0% = packet loss
root@gw:/home/wash # ping 172.16.0.99
PING 172.16.0.99 (1= 72.16.0.99): 56 data bytes
ping: sendto: Permission denied
ping: send= to: Permission denied
ping: sendto: Permission denied
^C
--- 172.1= 6.0.99 ping statistics ---
3 packets transmitted, 0 packets received, 10= 0.0% packet loss
root@gw:/home/wash # service dnsmasq status
dnsmasq = is running as pid 4190.
root@gw:/home/wash #



-= -
Best regards,
Odh= iambo WASHINGTON,
Nairobi,KE
+254 7 3200 0004/+254 7 2274 3223
<= div>=C2=A0In=C2=A0an Internet failure case, the #1 suspect is a constan= t: DNS.
"Oh, the cruft.",=C2=A0egrep -v '^$|^.*#'=C2=A0=C2= =AF\_(=E3=83=84)_/=C2=AF=C2=A0:-)
[How to ask smart question= s:=C2=A0http://www.catb.org/~= esr/faqs/smart-questions.html]
--0000000000007ef20c061cf946be--