jkrauze/bra-sample

Sample usage of Batch Request API for benchmarking purpose

Batch Request API Benchmark

Having 100 items stored.

Tests:

• Getting 10000 objects
  1. 10000x GET /items/54
  2. 10000x POST /bra-v0 requesting GET /items/54
  3. 1000x POST /bra-v0 requesting 10x GET /items/54
  4. 100x POST /bra-v0 requesting 100x GET /items/54
• Getting 100000 objects
  1. 100000x GET /items/54
  2. 100000x POST /bra-v0 requesting GET /items/54
  3. 10000x POST /bra-v0 requesting 10x GET /items/54
  4. 1000x POST /bra-v0 requesting 100x GET /items/54
  5. 100x POST /bra-v0 requesting 1000x GET /items/54

Tests will be run:

1. Without concurrency
2. With 10 concurrent threads
3. With 100 concurrent threads

and

1. On HashMap based repository (/items in SampleController)
2. On Reactive MongoDB repository (/mongo-items in SampleMongoController)

Before each test run docker containers will be recreated.

Running tests

To recreate tests execute run.sh bash script.

Results

• Without concurrency on HashMap repository

  • 10k elements
    1. 10000x ORIG: Done in 7.320s
    2. 10000x1 BRA: Done in 12.255s
    3. 1000x10 BRA: Done in 1.558s
    4. 100x100 BRA: Done in 0.658s
  • 100k elements
    1. 100000x ORIG: Done in 56.638s
    2. 100000x1 BRA: Done in 81.478s
    3. 10000x10 BRA: Done in 13.962s
    4. 1000x100 BRA: Done in 6.063s
    5. 100x1000 BRA: Done in 5.067s

• With 10 concurrent threads on HashMap repository

  • 10k elements
    1. 10000x ORIG: Done in 3.841s
    2. 10000x1 BRA: Done in 8.347s
    3. 1000x10 BRA: Done in 1.134s
    4. 100x100 BRA: Done in 0.416s
  • 100k elements
    1. 100000x ORIG: Done in 20.699s
    2. 100000x1 BRA: Done in 28.972s
    3. 10000x10 BRA: Done in 5.928s
    4. 1000x100 BRA: Done in 3.018s
    5. 100x1000 BRA: Done in 2.617s

• With 100 concurrent threads on HashMap repository

  • 10k elements
    1. 10000x ORIG: Done in 3.018s
    2. 10000x1 BRA: Done in 6.854s
    3. 1000x10 BRA: Done in 1.230s
    4. 100x100 BRA: Done in 0.621s
  • 100k elements
    1. 100000x ORIG: Done in 17.862s
    2. 100000x1 BRA: Done in 24.352s
    3. 10000x10 BRA: Done in 5.685s
    4. 1000x100 BRA: Done in 2.690s
    5. 100x1000 BRA: Done in 2.496s

• Without concurrency on MongoDB repository

  • 10k elements
    1. 10000x ORIG: Done in 12.056s
    2. 10000x1 BRA: Done in 15.192s
    3. 1000x10 BRA: Done in 2.766s
    4. 100x100 BRA: Done in 1.571s
  • 100k elements
    1. 100000x ORIG: Done in 100.900s
    2. 100000x1 BRA: Done in 125.835s
    3. 10000x10 BRA: Done in 25.682s
    4. 1000x100 BRA: Done in 15.231s
    5. 100x1000 BRA: Done in 14.134s

• With 10 concurrent threads on MongoDB repository

  • 10k elements
    1. 10000x ORIG: Done in 5.763s
    2. 10000x1 BRA: Done in 8.559s
    3. 1000x10 BRA: Done in 2.099s
    4. 100x100 BRA: Done in 1.631s
  • 100k elements
    1. 100000x ORIG: Done in 34.893s
    2. 100000x1 BRA: Done in 44.710s
    3. 10000x10 BRA: Done in 15.834s
    4. 1000x100 BRA: Done in 10.889s
    5. 100x1000 BRA: Done in 11.151s

• With 100 concurrent threads on MongoDB repository

  • 10k elements
    1. 10000x ORIG: Done in 5.470s
    2. 10000x1 BRA: Done in 8.950s
    3. 1000x10 BRA: Done in 2.684s
    4. 100x100 BRA: Done in 1.920s
  • 100k elements
    1. 100000x ORIG: Done in 27.902s
    2. 100000x1 BRA: Done in 37.519s
    3. 10000x10 BRA: Done in 15.109s
    4. 1000x100 BRA: Done in 11.024s
    5. 100x1000 BRA: Done in 10.889s