datastax/fallout

Distributed System Testing as a Service

fallout's Issues

Add ability to annotate individual test runs (via UI) with free text (short description)

Apologies for having a very vague request but I hope it makes sense.

Some Fallout tests are run against different backends, configurations, but the configuration itself may exist outside of Fallout. For example, service running in a test cluster may be differently configured across test runs, but there is no indication in Fallout results as Fallout configuration or test was not changed.
Or even if settings were changed, finding related settings may require lots of knowledge about test case internals.

If there was a way to add some sort of free-desc snippet ("annotation" or whatever it is called) to include in test artifacts / HTML, this would allow an easy way to add relevant contextual information for anyone reading the results.
I was thinking of a simple text box, to be passed as argument through test start call, to be passed along with test configuration. But I have no idea how feasible this would be.

Run test that provissioner is sshonly failed

fallout build is lastest.

My YAML:

ensemble:
server:
node.count: 1
provisioner:
name: sshonly
properties:
host: 10.4.116.46
user.name: root
user.password: Root123
configuration_manager:
- name: noop
client: server
workload:
phases:
- noop:
module: sleep
properties:
duration: 1s
checkers:
nofail:
checker: nofail

Run the test. Stat is Failed(SETTING_UP)
Check fallout-errors.log

I have a existed_k8s cluster and run a cassandra perfermance test and dtest on it. Could you have example test yaml file for cassandra using Dtest? Thanks!