Set output_folder to path outside of ml repo

[erikr]

Set output_folder to path outside of ml repo

[paolodi]

A current workaround for this is to manually signal the output folder to tf.sh via the -m flag. For example, if the desired output folder is /data/models/output,
./scripts/tf.sh -m /data/output /home/user/ml/ml4cvd/recipes.py --mode train --output_folder /data/models/output

./scripts/tf.sh -m /data/models/output /home/user/ml/ml4cvd/recipes.py \
                --mode train \
                --output_folder /data/models/output

would mount /data/models/output as a shared volume in Docker and the results will be accessible after the run.

I agree that realizing that the results are gone only after the run is complete is a bit annoying. I'll see if we can at least release a warning when the user is running the risk of this happening. Also, saving output results outside the repo is a good practice, as it makes startup time faster, so we should encourage it by making it easier.

[erikr]

Thanks for the workaround, I will try to use that for now!

[erikr]

Paolo, in your example above, did you mean to suggest mounting the same directory as the user specifies for --output_folder, e.g.:

./scripts/tf.sh -m /data/models/output /home/user/ml/ml4cvd/recipes.py \
    --mode train \
    --output_folder /data/models/output

rather than:

./scripts/tf.sh -m /data/output /home/user/ml/ml4cvd/recipes.py \
    --mode train \
    --output_folder /data/models/output

I did the former and it worked!

[paolodi]

You're absolutely right, Erik, sorry for the typo!

[erikr]

Ok thanks -- I know it seems like a silly question but I know so little about Docker I wanted to be sure!

[erikr]

@paolodi I am not sure exactly what changed, but I no longer have to use -m flag to mount drives outside of the repo. Can this issue be closed?