From nobody Sat Aug 12 06:19:19 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RN9VX6vWYz4TtxF for ; Sat, 12 Aug 2023 06:19:32 +0000 (UTC) (envelope-from joesuf4@gmail.com) Received: from mail-wr1-x42e.google.com (mail-wr1-x42e.google.com [IPv6:2a00:1450:4864:20::42e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RN9VW5nDCz3W43 for ; Sat, 12 Aug 2023 06:19:31 +0000 (UTC) (envelope-from joesuf4@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20221208 header.b=sS2LkGVN; spf=pass (mx1.freebsd.org: domain of joesuf4@gmail.com designates 2a00:1450:4864:20::42e as permitted sender) smtp.mailfrom=joesuf4@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-wr1-x42e.google.com with SMTP id ffacd0b85a97d-31751d7d96eso2243771f8f.1 for ; Fri, 11 Aug 2023 23:19:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1691821170; x=1692425970; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :from:to:cc:subject:date:message-id:reply-to; bh=wP0PQ+WAuJ8Dcj4Ma6U/aTSQwGLNtYETDVHPS/K/aZg=; b=sS2LkGVNq2bIRovI2LaPNlWg6TBUtiY2N2HFdY/wAJO2oz9eSk+iyr+OvOFM3Dy3Jk TR5yI5nZ+PxubYvNB76/YuN+yfkKOvdcNOes0WhSUfeRNbb1E3Zu2CM4usIN7MjqxtGn ggMYx9Ha98iSCvEPs/ZPPW8N+UJBItetlIaE/Ctl+CaBV2FQfiPxs2Rtn38hHaim+G+Y c6Qg/b8qEhuSWVamxFjbLwB0Z8q9gIbD9LRrpRMhXIcbmkUkBLtQDekypi5cAXBOAur2 25x25huCr5VZO9SnQ1b9h32WeTcTz905oNB56/X33Ea2m1avIbPLkkMFIwFPtbMVI2el eJiQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1691821170; x=1692425970; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=wP0PQ+WAuJ8Dcj4Ma6U/aTSQwGLNtYETDVHPS/K/aZg=; b=LbsooUmkEt+fOCux5JWeqqAKQrcyK7V/wa9jBvWnfszHsf44a2USivwQiezA8S9Yml QFKRitpej6VIifUjPDnn/OqSQnDSxVRsAw2hGs7lxqnXhIFvM4nNygOXDyztr4gz5TEQ AuUuj/YDScfKh+dNbSsJaYtPxg90GcqKN8GcCAZhx5NLdIFeWw/QhfwWeoC6nudO5WPM wKAIvQNYUzjv/fyOSIiAqe/v0uP1UHj0TIDRCTu7Fj+nhqikepWKaWMQLgHVDJqyUKfR LaFbLaS6oe3IKl1R/OYwojav2AbtDlERlBMvWvjDPJ1nWaWdto/ZL0eUhtLq9iElreql r96A== X-Gm-Message-State: AOJu0YyRfvjpjHEKhxdotahhKpIykcVBNT4ritqyVw2A0I6QIzV2p+6T iCdCmFUveJLsdh6Ol+fykD6REOqS8bfR4R2cCmDTedfC X-Google-Smtp-Source: AGHT+IHv1IUPP1NofSjovgQPki3JlAMOD+jV3fshnMhbtek4G4frA/4wlsUbGklnfZ+truMCUkq2NH0NaGL4q5MY36Y= X-Received: by 2002:adf:e28b:0:b0:314:1230:29b0 with SMTP id v11-20020adfe28b000000b00314123029b0mr2727019wri.52.1691821169936; Fri, 11 Aug 2023 23:19:29 -0700 (PDT) List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 References: <202308111121.37BBLX0J064263@donotpassgo.dyslexicfish.net> In-Reply-To: From: Joe Schaefer Date: Sat, 12 Aug 2023 02:19:19 -0400 Message-ID: Subject: Re: can sftp be made multi-threaded? To: freebsd-hackers@freebsd.org Content-Type: multipart/alternative; boundary="000000000000db8d7f0602b3cf9f" X-Spamd-Result: default: False [-2.96 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-0.98)[-0.979]; NEURAL_HAM_SHORT(-0.98)[-0.977]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20221208]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; FROM_HAS_DN(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; ARC_NA(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::42e:from]; DKIM_TRACE(0.00)[gmail.com:+]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_DN_NONE(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; RCVD_COUNT_ONE(0.00)[1]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MLMMJ_DEST(0.00)[freebsd-hackers@freebsd.org] X-Spamd-Bar: -- X-Rspamd-Queue-Id: 4RN9VW5nDCz3W43 --000000000000db8d7f0602b3cf9f Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Just evangelizing xargs -P again. Hope it helps. On Fri, Aug 11, 2023 at 9:07 PM void wrote: > On Fri, Aug 11, 2023 at 12:51:25PM -0400, Joe Schaefer wrote: > >% split -n $(nproc) foo.pdf; ls x* | xargs -P 0 -J % scp % > > user@bar.example.com:%; rm x*; ssh user@bar.example.com sh -c =E2=80=9C= cat x* > > >foo.pdf; rm x*=E2=80=9D > > Thanks for that, I'll try it. > > -- > > --000000000000db8d7f0602b3cf9f Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Just evangelizing xargs -P again. Hope it helps.

On F= ri, Aug 11, 2023 at 9:07 PM void <void@f-= m.fm> wrote:
On Fri, Aug 11, 2023 at 12:51= :25PM -0400, Joe Schaefer wrote:
>% split -n $(nproc) foo.pdf; ls x* | xargs -P 0 -J % scp %
> user@bar.example.com:%; rm x*; ssh user@bar.example.com sh -c =E2=80=9Ccat x* ><= br> >foo.pdf; rm x*=E2=80=9D

Thanks for that, I'll try it.

--

--000000000000db8d7f0602b3cf9f--