Comments (5)
Hi.
Yes. This repo use similar preprocess protocol as the Next model. For Social GAN, you can use the "obs_traj" and "pred_traj" in the preprocessed files (see here) since Social GAN only needs trajectory inputs. For Next-prediction, it needs more features other than the scene semantic features. Follow the preprocessing protocol for Next-prediction here. If you keep the training/testing split the same, you can compare them.
Sure! you can try adding more features to Multiverse and see whether it helps. But it will take more GPU memory and harder to train.
from multiverse.
@JunweiLiang Thanks for your reply!
Just to make sure if I understand it right. In preprocessing, the ActEv dataset and other features are processed and generated 3 .npz files in actev_preprocess directory. Since the Next model is trained in the same dataset, I only need to load the pre-trained model in the forking path dataset by running the multifuture inference here. Is that right?
And for Social GAN, I need to train it on ActEv dataset first, then test it on "next_x_v1_dataset_prepared_data/obs_data/traj_2.5fps" which only has testing dataset, to pass trajectory inputs into the model and start the evaluation. Does it also need to be run by multifuture inference?
from multiverse.
To run Next-prediction on the Multiverse dataset, you need to follow its preprocessing protocol to get all needed features into the testing npz files. For Social GAN, yes, you only need to run on the traj_2.5fps/ files. They are compatible with the SocialGAN repo.
from multiverse.
@JunweiLiang Hi, sorry for the delayed follow-up. I found an issue while testing sgan model, that it creates .pt files as checkpoints which is incompatible when running multifuture_inference.py. Could you show me how you evaluated that in your own evaluation?
And we don't need scene features like --scene_feat_path, and add --greedy instead, right?
Thanks a lot!
from multiverse.
For SGAN experiments, you should use their script evaluate_model.py. I think you need to modify it a bit to add an dataset_path
argument so you can run it like this:
python sgan/scripts/evaluate_model.py --dataset_path traj_2.5fps/test/ --model_path sgan-20V-20/checkpoint_with_model.pt
from multiverse.
Related Issues (20)
- Visualize the model output HOT 2
- Feeding more features into forking path dataset HOT 1
- How to visualize new videos in simaug project? HOT 1
- Cannot find the scene36_64_id2name_top10.json file for single future trajectory data (Garden of forking path) HOT 4
- Creating Whole Garden of forking path dataset as single future HOT 3
- How to visualize Actev datasets in Simaug? HOT 1
- How to run model on one test video ? HOT 1
- Error to train SimAug HOT 12
- Visualise Data HOT 7
- Where is deeplabv3 loacate? HOT 1
- Visualize semantic segmentation image? HOT 1
- Pretrained model can't download!! HOT 1
- Script not found!! HOT 1
- Reason why no use_gnn in Multimodal testing HOT 8
- Prepare training data? HOT 1
- The project website does not open HOT 14
- Additional material for simaug article HOT 3
- can next-prediction to simAug? HOT 1
- pygame Windows图像无法呈现 HOT 1
- No such file or directory HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from multiverse.