jszafran/eurostat-weekly-deaths-api

Application fetching weekly deaths data from Eurostat and exposing it via simple HTTP API (written in Golang).

eurostat-weekly-deaths-api's Issues

Add endpoint with metadata

Add endpoint with some metadata:

• timestamp at which data was fetched
• commit hash of deployed version

Fix labels endpoint - representation of < and > signs.

Load snapshot from S3 when can't connect to Eurostat

Fix git commit hash info.

Migrate app to fly-v2 apps

Create S3 bucket for keeping snapshots.

Create IAM user with permissions to read/write from snapshots bucket

Clean up database code management

Move db pool to either global var in main or use dependency injection.

Set proper title in Vue SPA

Add Vue 2 SPA with simple welcome page

Once all golangci-lint fixes are applied, include it in CICD process.

Switch sqlite to in-memory structure.

Dockerize app

Run tests in CICD pipeline

Add structured logging

Implement snapshots cleanup

Make a function to leave only X latest snapshots

Filter out week=99 data

Add a condition to filter out erroneous data (i.e. week=99). According to https://en.wikipedia.org/wiki/ISO_week_date, year contain either 52 or 53 weeks.

Add Makefile

Fix sorting results performance

To make the start of the application quicker

Add 404 page

Fix wrong content-type for api labels response

Update instructions for running program locally in README

Add snapshot manager.

Snapshot manager should be able to:

• read live data from Eurostat
• read/write snapshot from/to AWS S3
• read/write snapshot from/to local disk

Add sanity checks for missing labels

Add some sanity checks when building database to ensure that there are no missing labels for data fetched from Eurostat.

Refactor - add more tests

Improve errore messages

Add more meaningful error messages.

Restructure repo for future frontend code.

Move all backend Go code to separate directory and make sure that all references are updated.

Serve static 404 page instead of doing redirect

To fix frontend after recent deployment

Add linter to the project.

Return multiple errors in weekly_deaths endpoint instead of one by one

Add frontend for the application

Add a simple frontend that would present the data on line charts.

Add README

Add tests

Make cmd/build_database/main.go slimmer.

Add a private endpoint for refreshing data from Eurostat

Fix tests & go:embed in Github actions

Reduce RAM usage

Initial deploy to fly.io failed due to process being killed by OOM (out of memory) error. Reduce the usage (while still storing data in memory instead of database) so it can be deployed to fly.io with success.

Add code for creating index

Add code for dropping and creating a new index on weekly_deaths table and the columns used in query (country, age, gender, year).

Deploy to fly.io

Create a pipeline to deploy app to fly.io.

Add CICD process to deploy to FlyIO.

Provide entrypoint explicitly when deploying to Fly.io.

Fix problems caught by linter