sshd crash

Fri Nov 1 18:40:48 UTC 2013

On Sat, Nov 2, 2013 at 1:53 AM, Ian Lepore <ian at freebsd.org> wrote:
> On Sat, 2013-11-02 at 01:44 +0800, Jia-Shiun Li wrote:
>> may I add: putty causes this to happen. mine 0.62. But ssh from another
>> FreeBSD host has no problem.
>>
>> I suspect it to be some issues related to memory or malloc issues
>> specific to bbb. 'tmux a -d' without existing detached sessions
>> causes tmux client to core dump. But sshd and it are both fine on rpi.
>>
>> -Jia-Shiun.
>
> This is the first I've heard of being able to ssh to an arm platform
> that doesn't have PrivSep disabled, since about July or so.  I've never
> heard a report yet that anything on the client side could make a
> difference.
>
> It's definitely not a beaglebone thing, it happens on every arm board
> I've got... dreamplug, rpi, bbw, imx53, wandboard.

Ok let me make sure I did not mix things up. ;)

IIRC  I once saw similar issue on rpi shortly. But after another
weekly update it was gone. I did not pay too much attention on rpi,
and thought it was bbb specific.

I did not change sshd_config, UsePrivilegeSeparation supposed
remaining on as default is.

sshd logs attached initiating ssh to bbb from:
 - PuTTY on Windows w/ key auth,
 - PuTTY on Windows w/ password auth, and
 - (open)ssh on rpi

Both rpi & bbb are now running r257094:
--- 8< ---
jsli at beaglebone:~ % uname -a
FreeBSD beaglebone 11.0-CURRENT FreeBSD 11.0-CURRENT #0 r257094: Sat
Oct 26 03:06:24 CST 2013
jsli at 4cbsd:/root/crochet-freebsd/work/obj/arm.armv6/usr/src/sys/BEAGLEBONE
 arm
jsli at beaglebone:~ %

jsli at raspberry-pi:~ % uname -a
FreeBSD raspberry-pi 11.0-CURRENT FreeBSD 11.0-CURRENT #2 r257094: Sat
Oct 26 00:16:37 CST 2013
jsli at 4cbsd:/rpi/obj/arm.armv6/usr/src/sys/RPI-B  arm
jsli at raspberry-pi:~ %
--- 8< ---

-Jia-Shiun.
-------------- next part --------------
jsli at beaglebone:~ # `which sshd` -d
debug1: HPN Buffer Size: 65536
debug1: sshd version OpenSSH_6.3p1_hpn13v11 FreeBSD-20130918, OpenSSL 1.0.1e-freebsd 11 Feb 2013
debug1: read PEM private key done: type RSA
debug1: private host key: #0 type 1 RSA
debug1: read PEM private key done: type DSA
debug1: private host key: #1 type 2 DSA
debug1: read PEM private key done: type ECDSA
debug1: private host key: #2 type 3 ECDSA
debug1: rexec_argv[0]='/usr/sbin/sshd'
debug1: rexec_argv[1]='-d'
debug1: Bind to port 22 on ::.
debug1: Server TCP RWIN socket size: 65536
debug1: HPN Buffer Size: 65536
Server listening on :: port 22.
debug1: Bind to port 22 on 0.0.0.0.
debug1: Server TCP RWIN socket size: 65536
debug1: HPN Buffer Size: 65536
Server listening on 0.0.0.0 port 22.
debug1: fd 5 clearing O_NONBLOCK
debug1: Server will not fork when running in debugging mode.
debug1: rexec start in 5 out 5 newsock 5 pipe -1 sock 8
debug1: inetd sockets after dupping: 3, 3
debug1: res_init()
Connection from 192.168.111.11 port 4144
debug1: HPN Disabled: 0, HPN Buffer Size: 65536
debug1: Client protocol version 2.0; client software version PuTTY_Release_0.62
debug1: no match: PuTTY_Release_0.62
debug1: Enabling compatibility mode for protocol 2.0
debug1: Local version string SSH-2.0-OpenSSH_6.3_hpn13v11 FreeBSD-20130918
debug1: permanently_set_uid: 22/22 [preauth]
debug1: list_hostkey_types: ssh-rsa,ssh-dss,ecdsa-sha2-nistp256 [preauth]
debug1: SSH2_MSG_KEXINIT sent [preauth]
debug1: SSH2_MSG_KEXINIT received [preauth]
debug1: kex: client->server aes256-ctr hmac-sha1 none [preauth]
debug1: kex: server->client aes256-ctr hmac-sha1 none [preauth]
debug1: SSH2_MSG_KEX_DH_GEX_REQUEST_OLD received [preauth]
<jemalloc>: jemalloc_arena.c:387: Failed assertion: "p[i] == 0"
debug1: SSH2_MSG_KEX_DH_GEX_GROUP sent [preauth]
debug1: monitor_read_log: child log fd closed
debug1: do_cleanup
debug1: Killing privsep child 8906
jsli at beaglebone:~ # 
-------------- next part --------------
jsli at beaglebone:~ # `which sshd` -d
debug1: HPN Buffer Size: 65536
debug1: sshd version OpenSSH_6.3p1_hpn13v11 FreeBSD-20130918, OpenSSL 1.0.1e-freebsd 11 Feb 2013
debug1: read PEM private key done: type RSA
debug1: private host key: #0 type 1 RSA
debug1: read PEM private key done: type DSA
debug1: private host key: #1 type 2 DSA
debug1: read PEM private key done: type ECDSA
debug1: private host key: #2 type 3 ECDSA
debug1: rexec_argv[0]='/usr/sbin/sshd'
debug1: rexec_argv[1]='-d'
debug1: Bind to port 22 on ::.
debug1: Server TCP RWIN socket size: 65536
debug1: HPN Buffer Size: 65536
Server listening on :: port 22.
debug1: Bind to port 22 on 0.0.0.0.
debug1: Server TCP RWIN socket size: 65536
debug1: HPN Buffer Size: 65536
Server listening on 0.0.0.0 port 22.
debug1: fd 5 clearing O_NONBLOCK
debug1: Server will not fork when running in debugging mode.
debug1: rexec start in 5 out 5 newsock 5 pipe -1 sock 8
debug1: inetd sockets after dupping: 3, 3
debug1: res_init()
Connection from 192.168.111.11 port 4168
debug1: HPN Disabled: 0, HPN Buffer Size: 65536
debug1: Client protocol version 2.0; client software version PuTTY_Release_0.62
debug1: no match: PuTTY_Release_0.62
debug1: Enabling compatibility mode for protocol 2.0
debug1: Local version string SSH-2.0-OpenSSH_6.3_hpn13v11 FreeBSD-20130918
debug1: permanently_set_uid: 22/22 [preauth]
debug1: list_hostkey_types: ssh-rsa,ssh-dss,ecdsa-sha2-nistp256 [preauth]
debug1: SSH2_MSG_KEXINIT sent [preauth]
debug1: SSH2_MSG_KEXINIT received [preauth]
debug1: kex: client->server aes256-ctr hmac-sha1 none [preauth]
debug1: kex: server->client aes256-ctr hmac-sha1 none [preauth]
debug1: SSH2_MSG_KEX_DH_GEX_REQUEST_OLD received [preauth]
debug1: SSH2_MSG_KEX_DH_GEX_GROUP sent [preauth]
<jemalloc>: jemalloc_arena.c:387: Failed assertion: "p[i] == 0"
debug1: monitor_read_log: child log fd closed
debug1: do_cleanup
debug1: Killing privsep child 8939
jsli at beaglebone:~ #
-------------- next part --------------
jsli at beaglebone:~ # `which sshd` -d
debug1: HPN Buffer Size: 65536
debug1: sshd version OpenSSH_6.3p1_hpn13v11 FreeBSD-20130918, OpenSSL 1.0.1e-freebsd 11 Feb 2013
debug1: read PEM private key done: type RSA
debug1: private host key: #0 type 1 RSA
debug1: read PEM private key done: type DSA
debug1: private host key: #1 type 2 DSA
debug1: read PEM private key done: type ECDSA
debug1: private host key: #2 type 3 ECDSA
debug1: rexec_argv[0]='/usr/sbin/sshd'
debug1: rexec_argv[1]='-d'
debug1: Bind to port 22 on ::.
debug1: Server TCP RWIN socket size: 65536
debug1: HPN Buffer Size: 65536
Server listening on :: port 22.
debug1: Bind to port 22 on 0.0.0.0.
debug1: Server TCP RWIN socket size: 65536
debug1: HPN Buffer Size: 65536
Server listening on 0.0.0.0 port 22.
debug1: fd 5 clearing O_NONBLOCK
debug1: Server will not fork when running in debugging mode.
debug1: rexec start in 5 out 5 newsock 5 pipe -1 sock 8
debug1: inetd sockets after dupping: 3, 3
debug1: res_init()
Connection from 192.168.111.9 port 62265
debug1: HPN Disabled: 0, HPN Buffer Size: 65536
debug1: Client protocol version 2.0; client software version OpenSSH_6.3_hpn13v11 FreeBSD-20130918
debug1: match: OpenSSH_6.3_hpn13v11 FreeBSD-20130918 pat OpenSSH*
debug1: Enabling compatibility mode for protocol 2.0
debug1: Local version string SSH-2.0-OpenSSH_6.3_hpn13v11 FreeBSD-20130918
debug1: permanently_set_uid: 22/22 [preauth]
debug1: list_hostkey_types: ssh-rsa,ssh-dss,ecdsa-sha2-nistp256 [preauth]
debug1: SSH2_MSG_KEXINIT sent [preauth]
debug1: SSH2_MSG_KEXINIT received [preauth]
debug1: kex: client->server aes128-ctr hmac-md5-etm at openssh.com none [preauth]
debug1: kex: server->client aes128-ctr hmac-md5-etm at openssh.com none [preauth]
debug1: expecting SSH2_MSG_KEX_ECDH_INIT [preauth]
debug1: SSH2_MSG_NEWKEYS sent [preauth]
debug1: expecting SSH2_MSG_NEWKEYS [preauth]
debug1: SSH2_MSG_NEWKEYS received [preauth]
debug1: KEX done [preauth]
debug1: userauth-request for user jsli service ssh-connection method none [preauth]
debug1: attempt 0 failures 0 [preauth]
debug1: PAM: initializing for "jsli"
debug1: PAM: setting PAM_RHOST to "192.168.111.9"
debug1: userauth-request for user jsli service ssh-connection method keyboard-interactive [preauth]
debug1: attempt 1 failures 0 [preauth]
debug1: keyboard-interactive devs  [preauth]
debug1: auth2_challenge: user=jsli devs= [preauth]
debug1: kbdint_alloc: devices 'pam' [preauth]
debug1: auth2_challenge_start: trying authentication method 'pam' [preauth]
Postponed keyboard-interactive for jsli from 192.168.111.9 port 62265 ssh2 [preauth]
debug1: do_pam_account: called
debug1: PAM: num PAM env strings 0
Postponed keyboard-interactive/pam for jsli from 192.168.111.9 port 62265 ssh2 [preauth]
debug1: do_pam_account: called
Accepted keyboard-interactive/pam for jsli from 192.168.111.9 port 62265 ssh2
debug1: monitor_child_preauth: jsli has been authenticated by privileged process
debug1: monitor_read_log: child log fd closed
debug1: PAM: establishing credentials
User child is on pid 8914
debug1: PAM: establishing credentials
debug1: Entering interactive session for SSH2.
debug1: server_init_dispatch_20
debug1: server_input_channel_open: ctype session rchan 0 win 1048576 max 16384
debug1: input_session_request
debug1: channel 0: new [server-session]
debug1: session_new: session 0
debug1: session_open: channel 0
debug1: session_open: session 0: link with channel 0
debug1: server_input_channel_open: confirm session
debug1: server_input_global_request: rtype no-more-sessions at openssh.com want_reply 0
debug1: server_input_channel_req: channel 0 request pty-req reply 1
debug1: session_by_channel: session 0 channel 0
debug1: session_input_channel_req: session 0 req pty-req
debug1: Allocating pty.
debug1: session_new: session 0
debug1: session_pty_req: session 0 alloc /dev/pts/4
debug1: server_input_channel_req: channel 0 request shell reply 1
debug1: session_by_channel: session 0 channel 0
debug1: session_input_channel_req: session 0 req shell
debug1: Setting controlling tty using TIOCSCTTY.

debug1: Received SIGCHLD.
debug1: session_by_pid: pid 8915
debug1: session_exit_message: session 0 channel 0 pid 8915
debug1: session_exit_message: release channel 0
debug1: session_by_tty: session 0 tty /dev/pts/4
debug1: session_pty_cleanup: session 0 release /dev/pts/4
debug1: session_by_channel: session 0 channel 0
debug1: session_close_by_channel: channel 0 child 0
debug1: session_close: session 0 pid 0
debug1: channel 0: free: server-session, nchannels 1
Received disconnect from 192.168.111.9: 11: disconnected by user
debug1: do_cleanup
debug1: do_cleanup
debug1: PAM: cleanup
debug1: PAM: closing session
debug1: PAM: deleting credentials
jsli at beaglebone:~ #