Re: can sftp be made multi-threaded?

From: Juraj Lutter <otis_at_FreeBSD.org>
Date: Wed, 09 Aug 2023 12:49:48 UTC

> On 9 Aug 2023, at 14:40, void <void@f-m.fm> wrote:
> 
> Hello hackers@
> 
> Can sftp be made multi-threaded? Would rsync-over-ssh accomplish the same thing?
> 
> The issue I'm having is with large backups taking ages to transfer
> even with both source and destination being on gigabit fibre.
> 
> It looks like sftp is single-threaded and the bandwidth per thread is
> something like 5-50 Mbps and it's nowhere near saturating the bandwidth. Would multi-threaded sftp (if it were possible)
> or rsync-over-ssh work multi-threaded on a single huge backup file?

Have you played with misc/mbuffer from ports? It might do what you are looking for (provided that sftp alone isn’t sufficient).


—
Juraj Lutter
otis@FreeBSD.org