Comments (3)
running the result parser should give you the same result csv file every time.
Can you send us the transfuser_longest6.json and the commands you used to run the result parser, so that we can reproduce the problem?
from transfuser.
from transfuser.
The result json also puts an average DS of the routes in this file at the end of the file.
However only the DS, RC, IS are correct in this file, the other metrics are calculated wrongly (that is why you need the result parser, it will recalculate them with the correct math).
The result parser should produce the same DS as written in there.
As far as I can see the result parser is deterministic, so I don't see how you can get different results.
Can you email me an example .json file where this happens ([email protected])?
I would like to reproduce the error to see what is going on.
Note that the result parser will average all .json files inside the folder you give him, so you should make sure that there is only 1 file (that contains all routes) or there are 36 (* repetiotion) .json files each containing 1 route.
from transfuser.
Related Issues (20)
- Transformation of bounding boxes from 3D to 2D HOT 1
- CARLA setup error and Running CARLA server without display for evaluation HOT 2
- Dataset for evaluation HOT 2
- my vehicle remains stationary all the time HOT 11
- I met an Error during evaluation. How can I solve it? HOT 8
- RuntimeError: A sensor took too long to send their data - Is it normal to have this message ? HOT 12
- weather changes every 3s on average HOT 2
- error while data collection HOT 4
- Parsing longest6 results Error HOT 2
- FOV in the data HOT 3
- Artifacts in the LiDAR image HOT 1
- 'AttributeError' and 'UnboundLocalError' when running local_evaluation.sh HOT 3
- How to autogenerate route viz on maps HOT 1
- The training effect is very poor! HOT 10
- The maps of leaderboard HOT 1
- [Evaluation issue] Depth, Semantic image output issues and vehicle stopping HOT 4
- Accessing the gradient of the transfuser model in evaluation mode HOT 2
- How to Change vehicle model for evaluation HOT 6
- how to visualize the topdown image ? HOT 2
- Attention Map Visualizations- Obsolete version HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from transfuser.