hlzhang109/transtee

transtee's Issues

Problems about reproduced results

Based on your detailed code files, I try to reproduce the results about multiple treatmentments and dosages (TCGA) by directly running the commands you provided. I have some problems now and look forward to your help.

1. For baselines Drnet, Tarnet and VCnet, there is a big difference between the result in Table 5 and my reproduced one:
   This attached figure is the results on test dataset and validation dataset under Drnet:
   
   As for as I know, the last indicator represents AMSE and in different simulation experiments, the results are similar.
   So, I wonder are there some hyper-parameters should be tuned for these three baselines?

2. For your proposed TransTEE, I can obtain a similar result as you provided in Table 5 by running the command:
   python test_TransTEE.py --num_treatments=3 --treatment_selection_bias=2.0 --dosage_selection_bias=2.0 --batch_size=128 --h_dim=64 --h_inv_eqv_dim=64 --num_dosage_samples=5 --alpha=1.0 --model_name="TransTEE"
   But if I tune the hyper-parameters based on Table 8, the results are much worse.
   Are the parameter values in Table 8 not suitable for TCGA dataset in this scenario?

Dosage/data splits

Hi, your work is so great and thanks for your sharing!

I have a question about the Dosage/datas_simulation/get_split_indices fucntion (Line 131~138). The rest_indices should be split into train_indices and val_indices, but the values in train_indices and val_indices are limited to the range of [0, len(rest_indices)], other than the values in rest_indices. In that case, the train_indices and val_indices don't overlap, but they are overlapped with test_indices.

If there is anything wrong with my understanding, please point out. Thanks!

No module named 'models.DisCri'

In TransTEE/Continuous/models there is no file DisCri, so the main_batch.py cannot be run. Could this file please be added?

Problems about Continuous treatment

Hi,

Based on your detailed intructions, I try to reproduce the results on IHDP datasets and have some problems.

Under the setting Extrapolation (h=2), the results of TransTEE in Table 2 is 0.2745+/-0.14976, while I get 0.4783+/-0.3629. My results are aslo computed with 100 datasets under default parameters.

Then I adjust the epochs from the default 1500 to 2000 and 2500, the results are 0.3418+/-0.3019 and 0.2551+/-0.2370 separately. Although 0.2551 is close to your result, the standard deviation is much larger than yours.

In that case, could you give me some guidance about the result reproduction?