Comments (4)
@zbouziane, From the logs it looks like you've uploaded a feed and the validation could not begin because the feed was missing from the local file system. Is this correct? Could you describe the steps you followed here in more detail and if the GTFS file is in fact missing from your data directory? Thanks.
from datatools-server.
In fact I have the file in the local file system:
/Users/zbouziane/Data/cataloguedev/gtfs/tampere-20170418T145943+02-10e9ec1c-a6c7-418e-95f9-9eb4d911f167.zip
But it cannot be downloaded from AWS:
14:59:44.366 [qtp891452239-20] ERROR c.c.d.manager.persistence.FeedStore - Error downloading from s3
Here are my steps:
Deployment:
$ cd datatools-ui
$ yarn
$ npm run deploy -- s3://cataloguedev/dist
The files are copied to AWS s3
$ cd ../datatools-server
$ mvn -DskipTests package
$ java -jar target/dt-6a27c88-dirty.jar configurations/default/env.yml configurations/default/server.yml
browsing http://localhost:4000
connexion
creating a first project : TAMPERE
Then in the project : http://localhost:4000/project/a2734c92-1e03-4612-89c8-ab5ac9aff13f creating a new feed: tampere
Uploading a GTFS file talmpere.zip to the feed
http://localhost:4000/feed/36ff9ece-e888-4a0d-9116-b28bde8b0156
No data to view for that feed (0 agency count, 0 route count, 0 trip count, 0 stop time count)
from datatools-server.
Config server.yml
application:
assets_bucket: cataloguedev
public_url: http://localhost:9000
port: 4000
data:
mapdb: /Users/zbouziane/Data/cataloguedev/mapdb
gtfs: /Users/zbouziane/Data/cataloguedev/gtfs
editor_mapdb: /Users/zbouziane/Data/cataloguedev/editor
regions: /Users/zbouziane/Data/cataloguedev/geojson
gtfs_s3_bucket: cataloguedev
s3_credentials_file: /Users/zbouziane/.aws/credentials
use_s3_storage: true
modules:
enterprise:
enabled: false
editor:
enabled: true
alerts:
enabled: false
use_extension: xyz
sign_config:
enabled: false
user_admin:
enabled: true
validator:
enabled: true
deployment:
enabled: false
gtfsapi:
enabled: true
load_on_fetch: false
load_on_startup: false
use_extension: xyz
update_frequency: 3600 # in seconds
extensions:
transitland:
enabled: true
api: https://transit.land/api/v1/feeds
transitfeeds:
enabled: true
api: http://api.transitfeeds.com/v1/getFeeds
key: your-api-key
from datatools-server.
It seems GTFSCache doesn't copy files from local system to AWS bucket!
from datatools-server.
Related Issues (20)
- Auth0-Endpoint deprecations: https://client.auth0.com/user/ssodata returns 404 HOT 3
- log4j not properly initialized
- Missing version of maven-jar-plugin
- Server API calls appears to be open to SQL injection HOT 1
- GTFS API GET routes not behind authentication
- Add GTFS GraphQL user permissions check to ensure user has access to feeds
- Build error: unreported exception com.conveyal.gtfs.util.InvalidNamespaceException HOT 2
- Brief period of downtime during deployment to multiple servers while graph is indexing HOT 3
- Auth0 tokeninfo is not available for new users HOT 5
- Request logging snags on non-JSON body
- Refactor authentication to use JWT verification HOT 2
- Clarify Auth0 error message when create user request fails
- Handle project/organization references when an organization is updated
- Problem with jackson when running data-tools server HOT 2
- Deleting a project/feedsource/feedversion should also delete respective namespaces in SQL database
- Send feed expiration notification to users subscribed to feed source
- Change request/response logging level to debug
- Pom blurb is filtering out logback.xml HOT 1
- NPEs during feed fetch operations
- FeedValidation error
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from datatools-server.