Questions about transfuser_longest6.json file parsing

[carryman97]

Questions about transfuser_longest6.json file parsing

[Kait0]

running the result parser should give you the same result csv file every time.
Can you send us the transfuser_longest6.json and the commands you used to run the result parser, so that we can reproduce the problem?

[carryman97]

When I run result_parser.py multiple times under the same project file, there will be two driving scores, 38 and 35 respectively. When I copy transfuser_longest6.json to another project file (this project is also "transfuser", I back it up I created multiple "transfuser" projects to facilitate more experiments), the driving score is 47.93, I don't know which one is real, can you directly see the real driving score through the transfuser_longest6.json file, thank you!W crazyman ***@***.***  

…

------------------ 原始邮件 ------------------ 发件人: "autonomousvision/transfuser" ***@***.***>; 发送时间: 2023年6月27日(星期二) 下午5:03 ***@***.***>; ***@***.******@***.***>; 主题: Re: [autonomousvision/transfuser] Questions about transfuser_longest6.json file parsing (Issue #174) running the result parser should give you the same result csv file every time. Can you send us the transfuser_longest6.json and the commands you used to run the result parser, so that we can reproduce the problem? — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: ***@***.***>

[Kait0]

The result json also puts an average DS of the routes in this file at the end of the file.
However only the DS, RC, IS are correct in this file, the other metrics are calculated wrongly (that is why you need the result parser, it will recalculate them with the correct math).
The result parser should produce the same DS as written in there.
As far as I can see the result parser is deterministic, so I don't see how you can get different results.
Can you email me an example .json file where this happens ([email protected])?
I would like to reproduce the error to see what is going on.

Note that the result parser will average all .json files inside the folder you give him, so you should make sure that there is only 1 file (that contains all routes) or there are 36 (* repetiotion) .json files each containing 1 route.