yedhink/covid19-kerala-api-deprecated

Deprecated - A fast API service for retrieving day to day stats about Coronavirus(COVID-19, SARS-CoV-2) outbreak in Kerala(India).

covid19-kerala-api-deprecated's Issues

Add option to run Gin server in Debug mode via makefile

Currently gin is set to run in Release mode all the time via main.go. That needs to be optional and left out for the user, inorder to debug in development.

critical bug in python script - invalid generation of timestamp into iso format

The bug occurred in 10-04-2020.pdf since while parsing the pdf, there exists inconsistency in the 'date' text we are trying to extract for timestamp. It's given as '010/04/2020', where the 010 is erroneous for date. Manual string conversion to iso is problematic when day is not single digit.

Setting success key as bool value in json affects affects assertion to map[string]interface{} in location handler

setting success entry before unmarshalling and then asserting should fix it.

Data of 19-05-2020 is very badly inconsistent - might require manual intervention

The table data has very poorly laid out contents. Either skipping this particular date or manually adding the details from Annex1 is currently a quick fix since the website is not updating to latest data!

Add option to run python script on an arbitrary pdf file of choice passed as cmd line arg

Small refactoring of the code would be a necessity i think. Currently since the scripts 'js' variable is populated using the json already existing in data/data.json, the arbitrary file cant have a filename which resembles(eg:- 04-05-2020.pdf or 27-03-2020.pdf) dates/timestamps existing as part of the data.json. That also needs to be fixed.

Extract data from annexure-2 table - will provide number of deaths,number discharged and an awesome timeline.

Currently important stats like number of deaths, number of discharged are missing from our response data since annex-2 table hasn't been extracted.

Extracting data from annex-2 table will be a challenge. But the data from it can help to create a timeline data from starting till latest dates with number of deaths per district, total number of deaths, number of people discharged per district, number of total discharged etc.

The python script to extract json from pdf data is a mess - should it be refactored? Alternative libraries?

Currently the script works pretty well. But since the pdfs that we get from dhs kerala is very inconsistent, I had to use a lot of hacks to make the script work as intended. Also the pdftotext library used, is not very effective to all pdfs(say example pdf of date 02/12/2020). So what are your thoughts on refactoring the whole script? What other alternative libraries are there to extract tabular data from pdfs in a much better way? Also just manually adding the data for missing dates is the only solution(which destroys the purpose of this repo, but sitll)?

No data after 2020-05-01T

I tried the api https://covid19-kerala-api.herokuapp.com/api

I can find data till May 1st after that no data. Any issues?

Invalid date parameter should respond with err response

say date=08:04:2020 or date=08-04-20 etc should result in a err response with success=false of foll format:-

{
   "success" : false,
   "message": "Invalid Date Format as Parameter"
}

The location handler is a total mess - consider making it more modular

Avoid the if-else hell. It's getting hard to read now.

API NOT WORKING

Api not working

Major bug - the pdf has another inconsistency where "on today" in annex1 has prefix

Probably changing the regex to just an "in" check should fix this.

Add default json error response when endpoint is invalid

add about addition of 'success' key in json to readme

its' a bool value. Will have to explicitely mention its usecase too in readme

{
"success" : true | false,
...
}