40Gbps http client benchmark

[Steven Hartland]

I'm not sure it will help you at those levels, but have you tried boom?
https://github.com/rakyll/boom

On 06/08/2016 19:03, Eugene Grosbein wrote:
> Hi!
>
> Is there any high performance benchmark acting as http client for 
> outer http server
> capable to receive 40Gbps without overwhelming CPU with insane number 
> of syscalls?
>
> I've tried benchmarks/wrk version 4.0.2 and it works just fine upto 
> 20Gbps
> for my hardware: two 6-core (HT disabled) Intel(R) Xeon(R) CPU E5-2620 
> v3 @ 2.40GHz
> with two dual-port ix(4) 82599ES 10-Gigabit SFI/SFP+ Network Connection
> combined to single lagg interface (lagghash l4).
>
> But each worker pthread of wrk generates too many kqueue() system calls
> polling for incoming data and eats 100% of its CPU core and cannot 
> receive more.
> Or, it may be some kqueue() kernel level lock contention, I do not know.
> More worker threads, more overloaded CPU cores, no increase of 
> transfer over about 20Gbps.
>
> I transfer 1MByte-sized files for the benchmark (tried 8MB-sized too).
> I set sysctl net.inet.tcp.recvspace=4194304 (4MB).
> I've even patched wrk to to use read buffer sized 4MB instead of its 
> compiled-in
> default 8k, as it does not change default socket options other than 
> TCP_NODELAY:
>
> --- src/wrk.h.orig      2016-08-06 23:20:16.205906000 +0700
> +++ src/wrk.h   2016-08-06 23:20:20.460579000 +0700
> @@ -18,7 +18,7 @@
>  #include "ae.h"
>  #include "http_parser.h"
>
> -#define RECVBUF  8192
> +#define RECVBUF  4194304
>
>  #define MAX_THREAD_RATE_S   10000000
>  #define SOCKET_TIMEOUT_MS   2000
>
> Nothing helps to decrease consumed system time and ktrace(1) assures
> that's because of kevent() calls.
> _______________________________________________
> freebsd-net at freebsd.org mailing list
> https://lists.freebsd.org/mailman/listinfo/freebsd-net
> To unsubscribe, send any mail to "freebsd-net-unsubscribe at freebsd.org"