BTgymMultiData - Sync between different data stream

[JaCoderX]

BTgymMultiData - Sync between different data stream

[Kismuz]

@JacobHanouna ,

I can understand the logic of syncing different data stream of the same timeframe to keep everything in order. but not for different timeframes.

• sync for different timeframes is just not implemented. Only sensible approach I see here is to resmaple all streams to one common timeframe duration. In this particular case it will probably be upsampling daily data to minute timeframes (simply put, you'll end up with same repeated 1 min bar for entire single day).

[JaCoderX]

is there a true necessity for doing the intersection sync? I mean if I take it off or do some kind of sync by timeframe groups?

[JaCoderX]

@Kismuz,
Just for adding more information to the topic.

If I use the Backtrader native resample filter from within the Strategy class It sync and preform well with BTgym. So I know BTgym can handle working on different timeframes.

As a workaround I can upsample the data to 1 min outside of BTgym and then resample it back in the strategy.

This shows me that there is no fundamental reason why different timeframes shouldn't work together. plus the fact that the intersection sync happens only in BTgymMultiData made me question if it is really needed?

[Kismuz]

Intersection is just simplest method to ensure nn model gets consistent inputs on every timestep. I you can manage feeding different streams consistently by using backtrader resampling feature - it is just fine.

[JaCoderX]

As a workaround I can upsample the data to 1 min outside of BTgym and then resample it back in the strategy.

In the last couple of days I tested this workaround idea and it seem to work quite well.

IMO there is a valid case of working with data from different timeframes, simply because not all 'data as information' can be collected in such low timeframes. So for real world application it is necessary to have an option to use all available data even if from different time resolution.

For now the Backtrader resample option is a good workaround but it comes with a noticeable performance hit due to the fact that this expensive operation need to be done on every new sample.