Difficulties recreating the dataset

[akselaase]

Difficulties recreating the dataset

[Kait0]

1. The names refer to the scenarios: e.g. dirt is scenario 1 where a dirt patch spawns on the road.
   If you look at the name of the folders in these folders you will see the corresponding scenario file.
2. Don't think they mean anything.
3. Hardcoded by some assistant in the dataset generation script. We didn't release it as it is specific for our compute cluster.
4. These are lane change routes, we don't use scenarios for them. We use an no_scenario.json file which looks like this:

 {
	"available_scenarios": [
		{
			
		}
	]
}

I'm currently trying to recreate your dataset locally

Trying to recreate the dataset with 1 computer might be too slow.
When we run these 3000 routes we parallelize them across ~100 GPUs in our compute cluster.
This gives almost linear speedup in dataset generation as the routes are all independent.

I'm basing all this on the assumption that the dataset is recreatable

It is, up to the specific routes that crashed during parallelization.
The CARLA traffic manager is also nondeterministic (and can't be seeded in this version of the simulator), so you will get a similar dataset but not the same one.

[akselaase]

That clears the confusion, thank you very much! And yes, my poor laptop wouldn't be too happy about creating this dataset itself, this all happens on our cluster.

Really appreciate the quick response!