kgryte/benchmark.io

JavaScript benchmarking library.

benchmark.io's Issues

No globals

Express-like.

Browser chart

Moving beyond cross-browser bar charts. Histogram. Line chart. Descriptive stats. D3.js. Figure.io.

Ability to create benchmark gists

A better website than JSPerf

Bootstrap it. Make it pretty. Live viz.

Benchmark badge!

Like travis or coveralls.

Ability to specify a range of values to benchmark

Not sure how this would work. But the ability to specify, e.g., a numeric range for a particular input variable and run benchmarks for each value. One example: how does a function scale with input array size?

Output to file

Reporters. See Istanbul, where option to specify output directory.

Complete statistics

Not just ops/sec, but data sets for each run and incremental statistics/distributions.

Browserify to dist.

Part of build process.

Output as structured JSON

Platform, Suite --> benchmarks --> benchmark --> data, stats.

Cli

Clock per operation

Clock each loop, as well as total run time. Will need to correct for additional time caused by clocking at each loop, but can be calibrated during the warm-up phase.

Store each loop time in an array. Allow visualization of loop times and allow for removing outliers; e.g., calculate the midmean.

Run in Node or in the browser.

See Mocha and Matcha.

Stream results in real-time

e.g., populate a histogram.

Cross-browser benchmarking

Similar to JSPerf.

Pretty print.

A la Mocha.

HTTP benchmarking functionality

Possibly a plugin. See ab.