Comments (1)
The CARLA leaderboard has a metric called driving score, which is an aggregate metric that tells you which of these models are better.
It is described in section 4.5 Metrics in the paper.
The driving score is not printed on screen but logged in the results.json file that the leaderboard produces.
Also we recommend using the result parser to analyse the json file as it fixes some bugs in the metric calculation.
from transfuser.
Related Issues (20)
- The maps of leaderboard HOT 1
- [Evaluation issue] Depth, Semantic image output issues and vehicle stopping HOT 4
- Accessing the gradient of the transfuser model in evaluation mode HOT 2
- How to Change vehicle model for evaluation HOT 6
- how to visualize the topdown image ? HOT 2
- Attention Map Visualizations- Obsolete version HOT 6
- May I ask if there is a download link for the dataset? The script may not be able to download HOT 1
- How to measure the affordances 'relative angle' and 'lateral distance' with respect to the waypoints HOT 2
- How to change camera positions before Evaluating HOT 2
- How to measure the target_vehicle_distance from label_raw.json HOT 1
- How to unnormalize the 'relative angle' from the data.json HOT 1
- Cross-Modal Attention Statistics HOT 2
- Attention Map visualization for Geometric Fusion HOT 10
- How to install GlobalRoutePlannerDAO? HOT 2
- Unable to recreate results by following the instructions given in the github Readme HOT 8
- Latent TransFuser Ablation study with MLPs HOT 1
- Questions regarding the fine-tuning of the pre-trained model HOT 1
- Error on Sensor based model applied to datagen HOT 3
- Evaluate the model on WSL HOT 6
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from transfuser.