bhaskara/lab_assistant

Utility for running experimental scripts with varying parameters and collecting results in an organized directory tree

This is a command-line tool that facilitates running computational experiments with varying parameters and collecting and organizing the results.

The main requirement is that your experiment is a program runnable from the command line, and the parameters can be set using command line arguments. lab_assistant will take care of running on all parameter combinations you specify, collecting the results of stdout and stderr (and any other output files you specify) and putting them in an organized directory structure.

lab_assistant's Issues

Allow multiple trials of a given configuration

In this case each trial would get its own numbered subdirectory under the directory for the configuration.

print elapsed time and output size as each experiment runs

Add 'cat' command

Options include:

• printing top N or bottom N lines of each exp
• filtering by date
• filtering by tag?

allow attaching tags to experiments

Tee process stdout/stderr to screen in addition to file

Make the latest links relative rather than absolute

Make syntax git-like with subcommand followed by args