List index out of range

[gretelai]

List index out of range

[santhosh97]

Hey @Vathsa28 ! Would you mind providing more details about the size of your dataset and the parameters such as max sequence length, sample_len, the style of the dataframe? One thing that could happening is that the model might be producing NaN values due to mode collapse possibly and filtering those values out thus causing the size of the list to be modified. For better parameters, could you describe your dataset in more detail i.e how many features? how many attributes? time series length?

[Vathsa28]

Sure,
Features array(34720,50,2),
Attributes array(34720,14)
Time series length 50. Node2Vec embeddings.
We are using numpy arrays instead of dfs. Max seq len=50, sample len =5, batch size=100, and number of layers i made it 16 for both generator and discriminator with 400 units each.

[kboyd]

Thanks for the details, @Vathsa28!

Nothing jumps out to me from your setup that would lead to this error. So my general suggestion in this situation would be to try lower learning rates for both generator and discriminator. With smaller updates each batch, hopefully the model will be more well-behaved, though probably takes more epochs to learn effectively.

The other place I'd recommend experimenting is size of the networks. 16 layers and 400 units each is fairly large for DGAN. Compare that to the original DoppelGANger paper with the WWT dataset (of roughly similar size to yours) that used 1 layer with 100 units for the feature generator, 3 layers with 100 units each for the attribute generator, and 5 layers with 200 units each for the discriminator. I don't have any particular reasoning for why this would fix your error, but it's worth a try. And you can start with smaller networks with faster training, and only move to a larger network if your task genuinely requires the deeper and wider models.

[kboyd]

Closing this issue since it's been a month+. Please reopen if you're still seeing this error.