denji/awesome-http-benchmark

HTTP(S) benchmark tools, testing/debugging, & restAPI (RESTful)

HTTP(S) benchmark tools, testing/debugging, & restAPI (RESTful)

Located in alphabetical order (not prefer)

HTTP(S) Benchmark Tools

• ab – slow in single-threaded can be made more efficient by taskset, written in C

• ali – Generate HTTP load and plot the results in real-time, written in Go (golang)

• apib – most of the features of ApacheBench (ab), also designed as a more modern replacement, written in C

• autocannon – fast HTTP/1.1 benchmarking tool written in Node.js

• baloo – Expressive end-to-end HTTP API testing made easy, written in Go (golang)

• baton – HTTP load testing, written in Go (golang)

• Bencher - A suite of continuous benchmarking tools designed to catch performance regressions in CI

• bombardier – Fast crossplatform HTTP benchmarking tool, written in Go (golang)

• cassowary – is a modern HTTP(S), intuitive & cross-platform load testing tool, written in Go (golang)

• curl-loader – performance loading of various application services and traffic generation, written in C

• ddosify – High-performance load testing tool, written in Go (golang)

• drill – Drill is a HTTP load testing application inspired by Ansible syntax, written in Rust

• fasthttploader – benchmark (kinda ab) with autoadjustment and charts based on fasthttp library, written in Go (golang)

• fbender – A load-testing command line tool for generic network protocols (HTTP, DNS, DHCP, …), written in Go (golang)

• fortio – load testing library and command line tool and web UI. Allows to specify a set query-per-second load and record latency histograms and other useful stats, written in Go (golang)

• gatling – High performance load testing framework based on Scala, Akka and Netty, written in Scala

• go-wrk – a HTTP benchmarking tool based in spirit on the excellent wrk tool (wg/wrk), written in Go (golang)

• goad – Goad is an AWS Lambda powered, highly distributed, load testing tool, written in Go (golang)

• gobench – HTTP/HTTPS load testing and benchmarking tool, written in Go (golang)

• gohttpbench – ab-like benchmark tool run on multi-core cpu, written in Go (golang)

• goloris – Slowloris for NGINX DoS attack, written in Go (golang)

• goose - A modern, high-performance and flexible distributed HTTP(S) load testing tool, written in Rust

• h2load - benchmarking tool for HTTP/2 and HTTP/1.1. It supports SSL/TLS and clear text for all supported protocols, written in C/C++

• hey – HTTP(S) load generator, ApacheBench (ab) replacement, formerly known as rakyll/boom, written in Go (golang)

• htstress – multithreading high-load bechmarking services (>5K rps), written in C/Linux

• httperf – difficult configuration, slow and single threaded, written in C

• httping - Ping with HTTP requests, see http://www.vanheusden.com/httping/, written in C

• httpit - A rapid http(s) benchmark tool, written in golang

• inundator – A simple and high-throughput HTTP flood program, written in C/Linux

• jmeter – Apache JMeter™, pure application designed to load test performance both on static and dynamic resources, written in Java

• k6 - A modern load testing tool scriptable in ES6 JS with support for HTTP/1.1, HTTP/2.0 and WebSocket, written in Go (golang)

• locust – easy-to-use, distributed load testing tool with real-time web UI. Simulates a swarm of concurrent users, the behavior of each of them is defined by your python code. Written in Python

• lor-axe – A multi-threaded, low-bandwidth HTTP Slowloris DoS tool that handles connections and sockets in parallel, written in Rust

• mgun – A modern tool for load testing HTTP servers, written in Go (golang)

• molotov - A simple Python 3.7+ tool to write load tests

• NBomber – Modern and flexible load testing framework for Pull and Push scenarios, designed to test any system regardless a protocol (HTTP/WebSockets/AMQP etc) or a semantic model (Pull/Push), written in F# (F Sharp)

• Netling – Netling is a load tester client for easy web testing., written in C# (C Sharp)

• oha – HTTP load generator, inspired by rakyll/hey with tui animation, written in Rust

• pewpew - Flexible HTTP command line stress testing tool for websites and web services, written in Go (golang)

• plow – A high-performance HTTP benchmarking tool with real-time web UI and terminal displaying, written in Go (golang)

• pounce – event-driven with a similar interface as wrk but with the ambition to potentially achieve lower latency and higher throughout, written in C

• rewrk – A more modern http framework benchmarker supporting HTTP/1 and HTTP/2 benchmarks, written in Rust.

• reqstress – a benchmarking&stressing tool that can send raw HTTP requests, written in Go (golang).

• salvo - A simple HTTP(S) load testing tool like boom, but based on molotov. Python

• siege – multithreaded concurrent connections and slow single-user, written in C

• slapper – Simple load testing tool with real-time updated histogram of request timings, written in Go (golang)

• slow_cooker – A load tester focused on lifecycle issues and long-running tests, service with a predictable load and concurrency level for a long period of time, written in Go (golang)

• slowhttptest – Application Layer DoS attack simulator, written in C++

• sniper – powerful & high-performance http load tester, written in Go (golang)

• thrash – HTTP Micro Benchmarker, written in Go (golang)

• tsung – Simulate stress users in order to test the scalability and performance of IP based client/server applications HTTP, WebDAV, SOAP, PostgreSQL, MySQL, LDAP and Jabber/XMPP servers, written in Erlang

• vegeta – HTTP load testing tool and library, written in Go (golang)

• weighttp – multithreaded, but slower than htstress without keepalive, written in C

• welle – ab (Apache Benchmark) like tool, written in Rust

• wrk – multithreaded, but doesn't offer concurrent connections and a keepalive switch, written in C/Lua

• wrk2 – constant throughput, correct latency recording variant of wrk, written in C/Lua

    Concurrent connections are enabled with:
      -c, --connections <N>  Connections to keep open
    And keepalive (which is default) can be disabled using:
      -H "Connection: close"
  

• yandex-tank – Load and performance benchmark tool, written in Python/C|C++|Asm (phantom)

Toolkit for testing/debugging HTTP(S) and restAPI (RESTful)

• bat – Go implement CLI, cURL-like tool for humans, written in Go (golang)
• curl – Powerful features command-line tool for transferring data specified with URL syntax, written in C
  • Online curl command line builde
• curlconverter – convert curl commands to python, javascript, php
• hoppscotch - API request builder
• DeepfakeHTTP – is a web server that uses HTTP dumps as a source for responses, written in Java
• httpie – client, user-friendly curl replacement with intuitive UI, JSON support, syntax highlighting, wget-like downloads, extensions, written in Python
  • curlie – If you like the interface of HTTPie but miss the features of curl, curlie is what you are searching for. Curlie is a drop-in replacement for httpie that use curl to perform operations, written in Go (golang)
  • xh – Yet another HTTPie clone, written in Rust
• httpstat - It's like curl -v, with colours
• hurl - Hurl is a command line tool that runs HTTP requests defined in a simple plain text format
• insomnia - simple, beautiful, and free Desktop REST API client (Mac, Windows, and Linux)
• jaggr – JSON Aggregation CLI, Jaggr can be used to integrate vegeta with jplot, written in Go (golang)
• jq – is a lightweight and flexible command-line JSON processor, written in C
• https://github.com/marmelab/awesome-rest
• https://github.com/stepci/awesome-api-clients
• https://github.com/mrmykey/awesome-http-clients

SaaS/PaaS

• BlazeMeter – offers a cross-enterprise test automation framework for the entire technical team (developers, devops, ops and QA) throughout the product development lifecycle. Run continuous or ‘on demand’ testing for APIs, mobile apps and websites. Run from the cloud, on-premise or as a hybrid solution. Use with JMeter & Selenium WebDriver & integrate with your existing CI, CD & APM tools.
• NewRelic – software analytics tool suite used by developers, ops, and software companies to understand how your applications are performing in development and production
• NGINX Amplify – Visually identify performance bottlenecks, overloaded servers, or potential DDoS attacks. Improve and optimize NGINX performance with intelligent advice and recommendations. Get alerts when something is wrong with the delivery of your application. Plan capacity and performance for web applications. Keep track of systems running NGINX ¹
• k6.io - Open source load testing tool and SaaS for engineering teams. Powerful scripting and lots of CI/CD integration.
• RedLine13 - Cloud Based Load Testing to run JMeter, Gatling, or custom code load test plans at scale using low cost instance pricing.

awesome-http-benchmark's Issues

finshir repository deleted/moved

Searching GitHub for finshir only shows https://github.com/isgasho/finshir. I can't tell whether isgasho/finshir is the official repository for this code now, or just an existing fork that GitHub decided to make the new parent repository on deletion of the Gymmasssorla finshir repository.

The finshir entry should either be deleted or pointed to this new location.

I would have created a pull request, but didn't know whether you preferred removing the entry entirely (because the code may no longer be actively developed), or just updating the URL 🙂

Add Taurus

https://gettaurus.org/

Add blueperf

https://github.com/blueperf/

Reference source

https://github.com/istio/tools/tree/release-1.4/perf/benchmark

https://istio.io/docs/ops/deployment/performance-and-scalability/#synthetic-end-to-end-benchmarks

Use popularity/last update

Order by or at least show popularity and/or last update.
Whats the use of having a huge list? It doesn't help making a decision on what to use!

add graphql-bench

here is another benchmark for graphql:
(https://github.com/hasura/graphql-bench)

Add soapui

https://github.com/SmartBear/soapui

ab: slow and single threaded?!?

From my experience, ab is very high performance / lightweight, much more so than most other tools I tried. You can also choose how many requests run parallely/concurrently. ....I wonder where you got the statement "slow and single threaded" from. It seems plain wrong to me.

Add isotope

https://github.com/istio/tools/tree/release-1.4/isotope

Reference source

https://github.com/istio/tools/tree/release-1.4/perf/benchmark

https://istio.io/docs/ops/deployment/performance-and-scalability/#synthetic-end-to-end-benchmarks

user error, ignore

my fault.

Pounce

https://github.com/fredrikwidlund/pounce is a new version of my old "pounce" project that is currently in the list.

Kind regards,
Fredrik

Add flagger/loadtester

https://docs.flagger.app/how-it-works#load-testing

Add ngrinder

http://naver.github.io/ngrinder/

Siege multi-threaded capability

Hi, I'm considering using siege and it's noted as being "slow and single threaded". I'm not sure about how slow it actually is, however the website linked indicate that it's multi-threaded. It even has a concurrency flag (-c). Even the linux man page says this in the introduction to the utility:

Siege is a multi-threaded http load testing and benchmarking utility. It was designed to let web developers measure the performance of their code under duress. It allows one to hit a web server with a configurable number of concurrent simulated users.

Note: I haven't been able to test this yet to validate for myself first hand, however.

p.s. It's worth noting next to this utility that it has the ability to utilize manually specified lists of URL's. That's a key feature for my use case, since I could define URL's based on sitemap.xml to help ensure that causes induces as much load as possible. This is particularly useful in websites like mine that utilize heavy caching for frequently requested content (making utilities that just pound the same URL or variations of the same URL essentially useless).

Add oha

https://github.com/hatoo/oha

A few nodejs based benchmarking tools are missing

Not a selfless issue, since it includes my own, but the other tools are also very useful.

• https://github.com/matteofigus/api-benchmark
• https://github.com/bvanderlaan/api-bench-runner
• https://github.com/jeffbski/bench-rest
• https://github.com/Idrinth/api-bench

Not sure if adding them is desired, since there is a similar PR open (#41 ) and has been for a while

Add Molotov

https://github.com/loads/molotov