broadinstitute/ml4ht_data_source

Multimodal data loader compatible with pytorch and tensorflow

ml4ht_data_source's Issues

multimodal multi-date inference

Currently all-loading-option inference is possible for single modality, single task models. It should be possible for multi-modal models

Easy way to use the output of exploration as date and sample id selector

Once you run explore_data_descriptions, you should be able to use the valid sample ids and dates for the later PipelineSampleGetter easily.

Once you run explore_pipeline_sample_getter you should be able to use the output to define a new PipelineSampleGetter which skips the failed sample ids and dates.

`DataDescription` that can return multiple modalities

Currently if you get multiple modalities from the same source, e.g. multiple columns from the same data frame, you have to have multiple DataDescriptions. It may be simplifying to have a DataDescription extension which can return a dictionary of arrays.

Repo rename to ML4HT ?

To alliterate with other ml4h repos: ml4hs, ml4h, ml4h_ccds...

Add examples folder

There should be a folder of examples.
The most important example is define and running a full data exploration pipeline.