Comments (2)
I am really thrilled to receive your detailed reply! What you have mentioned is greatly valuable for me because I cannot get these first-hand experiences just by reading the documents. Thank you so much for your help!
Best,
Ziqi
from tuplan_garage.
Hi @ziqipang,
I appreciate your interest in our project!
The regular data of nuPlan contains the trajectory and positions of all agents in the scene, together with the expert route and traffic-light states. Regardless, the data size is enormous and even expands after unzipping. Therefore, for the complete training, validation, and test set, you need about 2.5TB.
For starting, you can use the nuPlan mini split or only the validation and test split (which might require some adaptations in the data loading). If you want to train ML planners heavily, I am unsure if you can avoid the large training split since there is currently no condensed trajectory dataset publicly available.
However, nuPlan has an internal method to “condense” a training set. Before training, the logs are converted into a feature cache where all input features and targets are precomputed into some custom tensor representation. The system you’re training on (e.g. a computation cluster) doesn’t need to access the complete dataset but only the feature cache, which is usually just a few GB in size. Therefore, you only need one local system (or one hard drive) that contains the complete dataset and use your feature cache everywhere else.
I hope that helps. Feel free to ask further questions!
from tuplan_garage.
Related Issues (20)
- AssertionError: Class to be of type <class 'pytorch_lightning.callbacks.base.Callback'>, but is <class 'omegaconf.dictconfig.DictConfig'>! HOT 2
- pdm_closed_planner trajectory's states have no dynamic information HOT 3
- How to accelerate simulation process HOT 1
- PDM-Hybrid that combined PDM-Closed with GC-PGP HOT 2
- Inconsistency between centerline and PDM-Closed trajectory HOT 4
- accelerate simulation by cuda HOT 3
- calculate inference time HOT 3
- time for training HOT 1
- Centerline and States encoding for PDM_Open and PDM_Offset models HOT 4
- Val14 Dataset HOT 1
- Visualization scripts release HOT 1
- L2 computation issue in open-loop settings HOT 1
- Issue eveluating HOT 4
- Train data and val14 data HOT 1
- about visualization HOT 2
- default_simulation planner HOT 4
- Confused about the checkpoint HOT 1
- Ray Workers Failing Due to Memory Pressure (OOM) in sim_plancnn.sh Script HOT 1
- Problems about the histograms and scenarios of nuboard HOT 6
- Closed-loop simulation error HOT 15
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from tuplan_garage.