Provide additonal examples of sample data

[maxwell8888]

Provide additonal examples of sample data

[derhuerst]

One question comes to mind: Are there any tools for breaking-up GTFS datasets out-of-memory, e.g. based on geographic region or subnetworks?

Not that I'm aware of but it would be pretty easy to code this up, the hard part would be providing a UI to allow users to select a region. Ofcourse you could just provide a separate CLI tool or something but that's not great for non technical users. At the end of the day it shouldn't be necessary since there is no fundamental reason the app shouldn't be able to handle these kinds of datasets.

It's not that straightforward, as such a tool will have to keep up with the ever-increasing complexity of GTFS and it's extensions, e.g. {levels,pathways,transfers}.txt, GTFS-Fares v2, GTFS-Flex.

OneBusAway's transformer CLI can be used, e.g. as follows:

{"op":"retain", "match":{"file": "stops.txt", "stop_lat": "r/50.8/54.05/", "stop_lon": "r/10.7/15.2/"}}

[maxwell8888]

This is because the app did not handle the case where shapes.txt is missing. I've just pushed a commit which adds a fallback to create trip paths from stop coordinates instead.

The second problem is that the Paris dataset is too large for the app. At the moment the app will struggle with datasets larger than 20mb. I tried to open the Paris dataset and crashed my laptop, but you are welcome to have a go yourself. Unfortunately improving the App to handle datasets larger datasets isn't something I have planned in the near future.

[woshilapin]

I don't know if it can help but I also noticed problems opening data from the entire Paris region (https://transport.data.gouv.fr/datasets/horaires-prevues-sur-les-lignes-de-transport-en-commun-dile-de-france-gtfs-datahub/#dataset-resources).

[Robinlovelace]

I've just pushed a commit which adds a fallback to create trip paths from stop coordinates instead.

Impressive work-around, many thanks for keeping this going, keen to see how it handles other GTFS datasets.

One question comes to mind: Are there any tools for breaking-up GTFS datasets out-of-memory, e.g. based on geographic region or subnetworks?

[woshilapin]

Well, it works on my machine, thanks for the reactivity

[maxwell8888]

Beautiful haha! Do you mind sharing what operating system you are using?

[maxwell8888]

I've just pushed a commit which adds a fallback to create trip paths from stop coordinates instead.

Impressive work-around, many thanks for keeping this going, keen to see how it handles other GTFS datasets.

One question comes to mind: Are there any tools for breaking-up GTFS datasets out-of-memory, e.g. based on geographic region or subnetworks?

Not that I'm aware of but it would be pretty easy to code this up, the hard part would be providing a UI to allow users to select a region. Ofcourse you could just provide a separate CLI tool or something but that's not great for non technical users. At the end of the day it shouldn't be necessary since there is no fundamental reason the app shouldn't be able to handle these kinds of datasets.

[Robinlovelace]

Not that I'm aware of but it would be pretty easy to code this up, the hard part would be providing a UI to allow users to select a region. Ofcourse you could just provide a separate CLI tool or something but that's not great for non technical users. At the end of the day it shouldn't be necessary since there is no fundamental reason the app shouldn't be able to handle these kinds of datasets.

I guess that's functionality that gtfs_manager could one day provide!

[woshilapin]

Beautiful haha! Do you mind sharing what operating system you are using?

Sure. I’m on Ubuntu 22.04.