Dealing with more data

[uwescience]

Dealing with more data

[arokem]

Thanks for taking a look and for the question. Yes - putting the data under the user home directory is a good idea. On other projects, we've developed systems for fetching large(ish) data from urls, validating the hash, and storing it in the user's home directory. That does seem to work well. For details see: https://github.com/nipy/dipy/blob/master/dipy/data/fetcher.py. It would actually be a good idea to refactor the data part here to do that, with the data repository on our library repository, or even better in Figshare. Maybe I will leave this issue open, until we get around to doing that.