Comments (8)
Thank you! That was really helpful. I'm training Social-GAN on an autonomous driving dataset and it would be a bad idea to ignore partial trajectories there. I've done zero padding as you suggested and started training.
from sgan.
You can remove the filtering and pad the sequence with zeros (in relative coordinates). The only caveat with this approach is you will have very limited history of the person and you can't predict a reliable trajectory with just 1 or 2 time step information.
from sgan.
Thank you for the reply. On the same lines, isn't it better to also consider the frame? If a pedestrian was present from frame # 5 to # 15. We can pad the frames 1-4 with the position at # 5 and frames 16-20 with the position at # 15. The intuition is that the pedestrian must have entered the scene at # 5 and left the scene at # 15. This might be better than padding with zeros and encountering huge jumps.
As long as the first frame of pedestrian is before frame # 8, the model need not have to predict when the pedestrian started walking.
from sgan.
See the updated comment. I meant relative coordinates.
from sgan.
But from what I understand, the relative coordinates also contain the first coordinate as the absolute one. Thereon it has delta x and delta y. So are you suggesting padding zeros for the frames prior to that one absolute coordinate?
from sgan.
Let us assume that seq_len is 5. We have a trajectory which is [0, 0, 0, 5, 6] (this is only the x-coordinate). Now, if we pad with initial position we will have [5, 5, 5, 5, 6]. The corresponding relative coordinates will be [0, 0, 0, 0, 1]. I meant this when I said pad with zeros in the relative coordinates. Sorry for the confusion but I think we both are on the same page.
Now, two cases are possible. Consider if this was part of observed sequence. As opposed to other trajectories the model does not have sufficient context to predict the future.
If the observed sequence was instead [0, 0, 0, 0, 0] and prediction was [0, 0, 0, 5, 6]. Then you are asking the model to basically predict when the person started walking (or entered the frame).
from sgan.
@jagjeet-singh I'm trying to expand Social-GAN into an automotive context, using the KITTI dataset. Do you have any suggestion based on your work? Thank you.
from sgan.
Can we simply set min_ped=len(peds_in_curr_seq)
to ensure that no neighbors are filtered?
from sgan.
Related Issues (20)
- How do I align the basic facts with the generated data in each iteration?
- Dataset preprocessing HOT 1
- Meaning of Datasets 'val'
- Save final model from checkpoint file
- ValueError: could not broadcast input array from shape (2,15) into shape (2,16) HOT 3
- KeyError: 'g_state' HOT 1
- How to get the predicted trajectory of target pedestrian?
- Can you provide the super parameters in the code? HOT 2
- EVALUATION PROBLEM HOT 1
- Possible problem with make_mlp function
- N
- N in SGAN-kVP-N
- How to make from ETH raw data to ETH pickle file?
- a porblem need to be solve HOT 11
- What version of torch and cuda should I use on windows
- how to run social gan in my project? tks
- How to test my own data?
- A problem in trajectories.py HOT 1
- tar: Error opening archive: Unrecognized archive format
- The meaning of each column in the dataset
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from sgan.