Comments (6)
@anacrolix yeah, this is absolutely lovely. i'm definitely a YAML fan, and it's a drop in replacement so i'm totally okay with that. as far as the "steps" go, i don't want to recreate docker, so i'd want to limit the instruction set to a well specified DSL. that's what i'm interested in establishing.
my gut feeling is that for sake of learning what we want to do and getting something done quickly, we start by just exposing a programmatic API for controlling daemons via the control protocol. this API will include:
- environment variables for consul access
- command line options/environment variables detailing which "segment" of the network they are to control (this will correlate to a service in consul)
- seamless api for leveraging these inputs to create daemon clients
- simple api for performing basic tasks over a collection of daemon clients
- churn (kill and redeploy task group)
- periodic DHT queries (fixed / random CIDs)
- peer discovery
from testlab.
from testlab.
Could we use Consul's service segmentation to simulate network partitions? It would be nice when testing e.g. circuit relay to know that two nodes can't communicate directly and have that enforced by the test setup.
from testlab.
YAML might be better suited, particularly for embedding snippets of stuff for other languages (bash etc.), keys, parts of scenarios etc., and the fact that humans will be writing these?
As a potential writer of scenarios I'd expect to be able to describe:
global_config:
# some stuff like run name, permissions, consul and coordinator service configurations etc.
nodes:
- num: 50
network: &nat # some nat nonsense
steps:
- &install |
go get dht
some_other_install
- |
generate_data
run_dht
metrics: # how to generate metrics
- num: 500
<<: *nat # run the same nat as the above guys
steps:
- *install
- |
run_dht_to_get_data
metrics:
Probably some synchronization will be necessary so nodes are in expected states before certain steps run. Some variance between nodes might be necessary, for example exposing an instance ID as an environment variable or something so instances can deterministically generate random data/keys/peer IDs etc.
Is this the kind of input you're after?
from testlab.
@yusefnapora interesting idea! partitions are not yet on the roadmap, but would love some more ideas on that matter!
from testlab.
@yusefnapora @bigs just making sure you are aware the service segmentation is an enterprise feature of Consul and not a part of the open source version. Not saying it isn't worth paying for, just that we will have to pay.
from testlab.
Related Issues (9)
- `exec` driver makes it difficult to deploy testlab, use `docker` instead
- TL;DR of Nomad Tasks for writing new Node types
- Edits to the sudoers file fail to remain HOT 1
- Where are the docs? HOT 1
- Instructions on how to setup Nomad/Consul et al for testlab
- Use lightweight VM Distribution HOT 2
- How-to write a Scenario docs
- Nomad must be run as root for 'exec' driver to work HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from testlab.