[libmicrohttpd] Bench-marking issue

[silvioprog]

Hello masters,

I'm doing some bench-markings comparing performance of popular libraries like MHD (my favorite ❤), libsoup (failed in basic tests), mongoose (fastest), nginx (echo module), kore, etc. etc. etc., however, I'm not sure about the configuration I used in MHD application. Please check the results below (mongoose/mhd/soup):

Mongoose:

Running 30s test @ http://127.0.0.1:8080/

  12 threads and 400 connections

  Thread Stats   Avg      Stdev     Max   +/- Stdev

    Latency     3.20ms    3.01ms 206.15ms   99.82%

    Req/Sec    10.58k     1.24k   24.71k    96.61%

  3793415 requests in 30.08s, 365.39MB read

Requests/sec: 126094.30

Transfer/sec:     12.15MB

MHD:

Running 30s test @ http://127.0.0.1:8080/

  12 threads and 400 connections

  Thread Stats   Avg      Stdev     Max   +/- Stdev

    Latency     8.71ms    6.11ms 318.04ms   99.59%

    Req/Sec     3.90k   360.50     8.74k    96.45%

  1390656 requests in 30.07s, 132.63MB read

Requests/sec:  46250.87

Transfer/sec:      4.41MB

Soup:

Running 30s test @ http://127.0.0.1:8080/

  12 threads and 400 connections

  Thread Stats   Avg      Stdev     Max   +/- Stdev

    Latency    55.37ms  206.43ms   1.97s    92.87%

    Req/Sec     4.85k     6.93k   18.41k    76.75%

  510046 requests in 30.03s, 67.13MB read

  Socket errors: connect 0, read 0, write 0, timeout 97

Requests/sec:  16982.12

Transfer/sec:      2.23MB

Attached all files used to test them (mongoose.c can be downloaded from https://github.com/cesanta/mongoose). My environment:

Xubuntu 16.04 64 bits (6 GB RAM / SSD Kingston)

Linux silvioprog-dev 4.4.0-59-generic #80-Ubuntu SMP Fri Jan 6 17:47:47 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux

$ pkg-config libsoup-2.4 glib-2.0 libmicrohttpd --modversion

2.52.2

2.48.1

0.9.52

configure: libmicrohttpd 0.9.52 Configuration Summary:

  Cross-compiling:   no

  Operating System:  linux-gnu

  Threading lib:     posix

  Use thread names:  yes

  Inter-thread comm: eventfd

  libcurl (testing): yes

  Target directory:  /usr/local

  Messages:          yes

  Basic auth.:       yes

  Digest auth.:      yes

  Postproc:          yes

  HTTPS support:     yes (using libgnutls and libgcrypt)

  poll support:      yes

  epoll support:     yes

  build docs:        yes

  build examples:    yes

So, I have a question: is my configuration ideal for benchmark testing? (I'm not sure about soup/mongoose configuration too, but it seems OK).

Build and test instruction are in the attached file too.

Thank you!

--

Silvio Clécio

bench.tar.gz
Description: GNU Zip compressed data