Comments (9)
Original comment by [email protected]
on 11 Jan 2010 at 10:15
- Added labels: Milestone-0.5
- Removed labels: ****
from caliper.
I was playing with the visualization of this. I wanted to render a scatter plot
on the
server, but unfortunately I ran into an AppEngine bug.
http://code.google.com/p/googleappengine/issues/detail?id=2645
Should that bug ever get fixed, I've attached the code that'll build the
appropriate
scatter plot. Until then, I'm going to experiment with <canvas>
Original comment by [email protected]
on 16 Jan 2010 at 6:44
- Added labels: ****
- Removed labels: ****
Attachments:
from caliper.
I've adopted the <canvas> tag to render box plots, but I don't know how I feel
about
the UI.
I want something that is:
- useful in describing the variability of a measurement
- non intimidating for non-statisticians
- pretty
What I've got is not particularly stellar in any category, but it's a start.
Advice is
welcome; screenshots are attached.
PS - I also updated the client to create multiple measurements; this code is
horribly
lame and should be shot.
Original comment by [email protected]
on 17 Jan 2010 at 9:32
- Added labels: ****
- Removed labels: ****
Attachments:
- [Picture 75.png](https://storage.googleapis.com/google-code-attachments/caliper/issue-3/comment-3/Picture 75.png)
- [Picture 74.png](https://storage.googleapis.com/google-code-attachments/caliper/issue-3/comment-3/Picture 74.png)
from caliper.
It works!
Original comment by limpbizkit
on 17 Jan 2010 at 8:51
- Changed state: Started
- Added labels: ****
- Removed labels: ****
Attachments:
- [Picture 76.png](https://storage.googleapis.com/google-code-attachments/caliper/issue-3/comment-4/Picture 76.png)
from caliper.
Done.
The only thing I'm unhappy with is the console UI's fidelity in displaying
multiple
measurements. Currently it's just displaying the median; but we could do
something
fancy (at a risk of being complex)
foo [--|-]----|
bar [-|--]
baz |-[--|--]
quux |---[---|--]--|
Original comment by limpbizkit
on 18 Jan 2010 at 8:34
- Changed state: Fixed
- Added labels: ****
- Removed labels: ****
from caliper.
Here's a question: why have a console UI at all? It'll continually be that one
more
thing we have to think about (as it is in this example).
Original comment by [email protected]
on 19 Jan 2010 at 4:30
- Added labels: ****
- Removed labels: ****
from caliper.
We'll definitely want a way to get good plaintext from benchmark reports, since
that's
what can get pasted into code reviews, bug reports, and email messages. I was
thinking
the web app should even have a "copy as text" button somewhere.
Original comment by [email protected]
on 19 Jan 2010 at 5:49
- Added labels: ****
- Removed labels: ****
from caliper.
I'm not sure that pasting around text results is such a good idea! If a url is
pasted instead, the information can
be visualized better, can be seen in context with other runs, etc. I think
that's the use case we should spend
time supporting a pleasant, streamlined way.
Original comment by [email protected]
on 19 Jan 2010 at 6:30
- Added labels: ****
- Removed labels: ****
from caliper.
> Here's a question: why have a console UI at all?
because there are lots of people who live in the shell.
personally, i'd make a few changes:
1. i wouldn't bother with ASCII-art graphs.
2. i might show scale factors like "2.3x" instead (though this might lead to me
wanting a way to @Annotate the method that represents my baseline).
3. i would always use the same time units. switching between ms and us is all
well
and good, but it's a pain for this kind of use because it makes the output less
directly comparable.
4. i'd include a timestamp showing when the run was performed, and i'd include a
duration showing how long the benchmark run took.
5. i might include a hash of the test source, so i could easily distinguish
results i
shouldn't necessarily be comparing.
as for copy & paste, i'll always want to copy & paste some text form, because
it's
the only thing i trust to last and because it's an extra level of indirection
(which
is fine for "show more detail" but not for an overview in a check-in comment).
the
web's a nice optional extra, but that's all.
Original comment by [email protected]
on 19 Jan 2010 at 7:11
- Added labels: ****
- Removed labels: ****
from caliper.
Related Issues (20)
- AllocationInstrumentationTest#intrinsics fails on x86 HOT 2
- gcBeforeEachOptionIsReallyNecessary test failed HOT 1
- Method not found: org.apache.commons.math.stat.descriptive.rank.Percentile.setData HOT 2
- site examples not in sync with code release HOT 3
- Unittest Failures in AllocationInstrumentTest, ArbitraryMeasurmentInstrumentTest, BadUserCodeTest, RuntimeInstrumentTest
- Release 1.0-beta2; provide "local only" site option; better documentation of the runner API HOT 1
- java.lang.LinkageError duplicate class definition HOT 1
- 'Objects' column shows decimal points, but doesn't need to. HOT 1
- Guava confliction HOT 1
- Configuration options confusion
- Support for micro benchmarks on data structures
- Caliper should allow adding names to runs after the fact
- How to use Caliper in 2014-08 in reality
- Examples doesn't compile HOT 1
- Track the order of columns in the URL HOT 1
- Unrecognized benchmark methods are silently ignored HOT 2
- Factorial example fails HOT 2
- InteleavedReader error: java.io.IOException: Mark invalid HOT 1
- Illegal char <:> in the log filename causes failure
- Making ObjectExplorer more usable externally by making things public
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from caliper.