Placeholder repo for issues
ocaml-bench / bench Goto Github PK
View Code? Open in Web Editor NEWPlaceholder repo for issues
Placeholder repo for issues
Is there a way for bench.ocamllabs.io to point at a pull-request with some opam config variables?
The dropdown on the changes tab of bench.ocamllabs.io will not handle a very large number of commits.
More generally we don't seem to be able to browse every commit easily from the front end.
Are there ways to highlight that a given benchmarking run is 'not reliable' using the statistics of the run?
(NB: this can be hard in general if a given run is clean but randomness is outside of it, for example what we saw with ASLR)
Having to hit a permalink button before cut-and-paste is pretty old-school.
Are we able to fix it so that you can cut-and-paste the link you see and send it to other people? Right now people are sometimes sending links where others will not be able to view the data they are seeing.
Is it possible to download the raw data from bench.ocamllabs.io so that people can make their own tools that use the data?
can we integrate the sandmark macro benchmark output into the website?
Can we get benchmarking data for arm64 and ppc machines integrated into the website?
Want to be able to visualize the GC output (minor collections, major collections, compactions, etc.) and other timeseries data (e.g. perf cycles, perf branch miss predicts, perf L2 data miss, etc.)
The git log output in the changes tab is overwriting the table making things hard to see unless you have a large screen.
When comparing multiple versions on the compare page, the normalisation becomes an arbitrary choice that will affect your interpretation.
Is it possible to add a log-mode plot where we fix this (stedolan has ideas here)
Is it possible to add compilation times to bench.ocamllabs.io?
This looks like it will need:
It would be useful to be able to sort the comparison data over all benchmarks to list them by speedup/slowdown.
One option is to make the javascript graphs sortable.
An alternative option is to output an HTML table of benchmark_name x executable_normalized_value
which can then be sorted independent of the javascript bar chart.
Are we able to specify the data format that all benchmarking experiments should produce which allows the decoupling of the downstream analysis and visualisation from benchmarking production?
For 4.08 can we track flambda-OClassic & flambda-O3
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.