Some benchmark result

[Kabie]

Setup

Client and server on the same virtual machine with 4 cores.

Linux karch 4.7.0-1-ARCH #1 SMP PREEMPT Mon Aug 8 22:05:58 CEST 2016 x86_64 GNU/Linux

Erlang/OTP 19 [erts-8.0.2] [source] [64-bit] [smp:4:4] [async-threads:10] [hipe] [kernel-poll:false]
Interactive Elixir (1.3.2) - press Ctrl+C to exit (type h() ENTER for help)

Server

PORT=4000 MIX_ENV=prod iex -S mix  # phoenix with phoenix.server

Client

wrk -c100 -t4 -d30s -s multi-request-json.lua http://localhost:4000/

Results

Cowboy

HTTP/1.1 200 OK
content-length: 5
content-type: text/html
date: Thu, 18 Aug 2016 14:48:03 GMT
server: Cowboy

hello

Running 30s test @ http://localhost:4000/
  4 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     3.51ms    4.46ms  95.44ms   86.93%
    Req/Sec    11.27k     1.97k   23.50k    67.05%
  1348450 requests in 30.09s, 155.85MB read
Requests/sec:  44806.58
Transfer/sec:      5.18MB

Running 30s test @ http://localhost:4000/
  4 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     3.54ms    4.44ms  80.65ms   86.47%
    Req/Sec    11.18k     1.89k   17.95k    66.61%
  1336418 requests in 30.10s, 154.46MB read
Requests/sec:  44403.72
Transfer/sec:      5.13MB

Running 30s test @ http://localhost:4000/
  4 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     3.53ms    4.96ms 113.24ms   89.12%
    Req/Sec    11.34k     1.98k   21.15k    67.47%
  1356735 requests in 30.10s, 156.80MB read
Requests/sec:  45077.00
Transfer/sec:      5.21MB

Plug

HTTP/1.1 200 OK
cache-control: max-age=0, private, must-revalidate
content-length: 5
date: Thu, 18 Aug 2016 14:47:31 GMT
server: Cowboy

hello

Running 30s test @ http://localhost:4000/
  4 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     3.93ms    4.95ms  92.96ms   87.02%
    Req/Sec     9.96k     1.71k   17.91k    68.72%
  1192212 requests in 30.10s, 168.49MB read
Requests/sec:  39612.61
Transfer/sec:      5.60MB

Running 30s test @ http://localhost:4000/
  4 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     4.05ms    5.24ms 112.57ms   87.12%
    Req/Sec    10.01k     1.77k   19.99k    69.22%
  1197678 requests in 30.10s, 169.26MB read
Requests/sec:  39790.38
Transfer/sec:      5.62MB

Running 30s test @ http://localhost:4000/
  4 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     3.98ms    5.06ms 122.06ms   87.09%
    Req/Sec     9.97k     1.67k   15.82k    66.61%
  1194345 requests in 30.09s, 168.79MB read
Requests/sec:  39687.32
Transfer/sec:      5.61MB

Maru

HTTP/1.1 200 OK
cache-control: max-age=0, private, must-revalidate
content-length: 5
content-type: text/plain; charset=utf-8
date: Thu, 18 Aug 2016 14:52:17 GMT
server: Cowboy

index

Running 30s test @ http://localhost:4000/
  4 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     3.83ms    5.46ms 159.18ms   89.95%
    Req/Sec     9.65k     1.80k   19.96k    68.20%
  1153403 requests in 30.09s, 208.16MB read
Requests/sec:  38331.07
Transfer/sec:      6.92MB

Running 30s test @ http://localhost:4000/
  4 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     3.73ms    4.64ms 109.63ms   87.49%
    Req/Sec     9.67k     1.80k   18.03k    67.67%
  1157085 requests in 30.09s, 208.82MB read
Requests/sec:  38459.80
Transfer/sec:      6.94MB

Running 30s test @ http://localhost:4000/
  4 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     3.75ms    4.74ms  93.48ms   87.89%
    Req/Sec     9.59k     1.72k   22.32k    69.03%
  1146631 requests in 30.10s, 206.94MB read
Requests/sec:  38096.69
Transfer/sec:      6.88MB

Phoenix

HTTP/1.1 200 OK
cache-control: max-age=0, private, must-revalidate
content-length: 5
content-type: text/plain; charset=utf-8
date: Thu, 18 Aug 2016 14:57:25 GMT
server: Cowboy

index

Running 30s test @ http://localhost:4000/
  4 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     4.36ms    5.83ms 177.19ms   88.22%
    Req/Sec     8.79k     1.58k   16.96k    69.22%
  1051209 requests in 30.10s, 189.71MB read
Requests/sec:  34927.90
Transfer/sec:      6.30MB

Running 30s test @ http://localhost:4000/
  4 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     3.99ms    4.72ms  79.26ms   86.77%
    Req/Sec     8.88k     1.48k   13.80k    67.83%
  1061022 requests in 30.05s, 191.49MB read
Requests/sec:  35308.72
Transfer/sec:      6.37MB

Running 30s test @ http://localhost:4000/
  4 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     4.11ms    5.05ms 111.93ms   87.30%
    Req/Sec     8.94k     1.59k   28.17k    70.86%
  1069482 requests in 30.10s, 193.01MB read
Requests/sec:  35535.16
Transfer/sec:      6.41MB

Thanks @Kabie