Quick start help needed - surely useful for other new users

[fnpdaml]

Quick start help needed - surely useful for other new users

[lacava]

• time limit is only supported for cluster jobs (slurm or LSF clusters). in last year's competition we updated methods to have runtime limits, but this hasn't made its way to the master branch yet.
• scaling is a parameter of evaluate_model:

  srbench/experiment/evaluate_model.py

  Line 24 in 47da695

  def evaluate_model(dataset, results_path, random_state, est_name, est,

[lacava]

hi @fnpdaml :

• to use your own datasets, you want to check out / modify read_file in read_file.py: https://github.com/cavalab/srbench/blob/4cc90adc9c450dad3cb3f82c93136bc2cb3b1a0a/experiment/read_file.py

• if your datasets follow the convention of https://github.com/EpistasisLab/pmlb/tree/master/datasets, i.e. they are in a pandas dataframe with the target column labelled "targert", you can call read_file directly just passing the filename like you would with any of the PMLB datasets.

• read_file is called in evaluate_model here:

  srbench/experiment/evaluate_model.py

  Line 39 in 4cc90ad

  features, labels, feature_names = read_file(dataset)

hope that helps

[fc59283]

Hi and thanks for that again!
(I also use the above account interchangeably)

I had to do 3 things:

1. Indeed generate my data in a pandas dataframe with the target column labelled "target";
   [I'm fitting a groundtruth: "eq1.tsv"]

2. Then it seemed easier just to mimic the PMLB layout - created the corresponding "metadata.yaml" and "summary_stats.tsv" files;

3. Compress my data to "eq1.tsv.gv" - and only now it worked.

But a few issues with "analyze.py":

"--time_limit" seems to have no control on the time it is allowed to run.
(set 5min, had to abort after 1 day)

My data was a 2nd order equation and was not discovered. However, several methods seemed to converge on the same, but different (from the original) answer - is there normalization going on, and where is this controlled and recorded?

Many thanks!

[fc59283]

(bump)

• Any ideas about these questions?