Sinatra is slower than Camping

[camping]

Sinatra is slower than Camping

[rtomayko]

Yeah. The rps for sinatra definitely looks low. Could be the static file check on each request. There's also MethodOverride, ShowExceptions and a few other middleware added by default. I'll play with tuning it sometime this weekend and see what I can figure out.

[DAddYE]

Added here http://github.com/DAddYE/web-frameworks-benchmark also benches with rendering. Some results:

  # Advanced render
  Padrino => 731.75 rps
  Sinatra => 706.52 rps
  Merb    => 480.03 rps
  Rack    => 253.23 rps
  Rails   => 207.85 rps
  Ramaze  => 177.13 rps
  Camping => 155.96 rps
  # Basic render
  Merb    => 1512.85 rps
  Rack    => 1502.72 rps
  Padrino => 1390.95 rps
  Sinatra => 1113.27 rps
  Camping => 960.18 rps
  Rails   => 337.53 rps
  Ramaze  => 256.69 rps

There are few reason why sinatra seems slower one of them is for example logger.

Then there are one small pseudo-critical problem (but is not here the place).

[DAddYE]

Updated results.

[judofyr]

Just so everybody knows: In these rendering examples, Camping uses Markaby while the others uses Haml. I believe Camping is faster than Sinatra when we'll get Haml support (see #18).

[judofyr]

With the latest gem install camping --source http://gems.judofyr.net/ and my benchmark fork, it gets even worse:

# Text render
Rack => 2737.31 rps
Camping => 2008.31 rps
Sinatra => 1378.25 rps

# Template render
Rack => 2616.19 rps
Camping => 1489.69 rps
Sinatra => 978.52 rps

# More advanced example
Rack => 1284.13 rps
Camping => 1255.25 rps
Sinatra => 797.33 rps

[judofyr]

Hm, apparently Sinatra should run faster with:

disable :static 
disable :logging

I tried it on the more_advanced example and couldn't really notice a difference. Oh well, some of you Sinatra guys will have to figure that out.

[rtomayko]

I tuned the text_render Sinatra benchmark a bit. Before:

Rack => 3415.93 rps
Sinatra => 1990.83 rps

After:

Rack => 3284.83 rps
Sinatra => 2550.25 rps

Here are the changes

[rtomayko]

Tuned the more_advanced Sinatra benchmark a bit too. Before:

Rack => 1900.21 rps
Sinatra => 899.0 rps

After:

Rack => 1873.83 rps
Sinatra => 1107.38 rps

Changes here

[judofyr]

Excellent. I've merged your changes, fixed Rack performance and updated Camping to 2.1: http://github.com/judofyr/web-frameworks-benchmark. I've sent the Padrino guys a pull-request, so hopefully they will redo the benchmark.

Closing this for now!