in-core/pyincore-data

pyincore-data's Issues

make census util to create a dataset

currently, census util is only providing the download of the data. Add the conversion of this downloaded data to dataset to util.

Create conda recipe

Create a conda build recipe

Create a method to inject NSI data to database

Create a method to conversted NSI dataset to database with automated manner.

Create database for the NSI

create database and the database server for holding NSI

Create census viz

Create census viz utility. Currently, there are some visualization codes in census util. Refactor and modify then create a census viz utility class.

release datasets related to Combined Damage Loss

Structural loss ratios for each archetype

structural_cost_id = "63ff7b2b5c35c0353d5edeeb"

Content loss ratios for each damage state

content_cost_id = "63ff7b04a36332563d497cff"

Create release script for automatic docker build and push

Create a release script for building documentation docker and push.

create release 0.6.0

Create release 0.6.1

Create unit test for pyincore-data

Create a unit test for pyincore-data github action

Make census data output as geopackage

Currently the pyincore data's census data creation code make the data as shapefile. However, there are many fields that has the name more than 10 characters. Give another option to generate geopackage dataset so it doesn't loose the field title.

Create a general method for obtaining the census data

Create a general method for obtaining the census data for other pyincore analysis.

clean dependency

create release 0.5.1

create pyincore-data 0.5.2

Create a tool for converting NSI data to incore building inventory

create a tool for conversting NSI dataset to incore building inventory. This should involve the injection of the new fields and conversion of values and so on.

Moving functions from Housing Household Recovery from notebook to utils in Pyincore

@ywkim312 Could we have a quick discussion so I can know what functions and is there anything else I need to follow?

Update ipyleaflet

Ipyleaflet should be updated to higher than 0.16

Support user's data manipulation

Incore user Omar Sidek needs to know how to manipulate his data for the analyses. Meet with him and help the data manipulation process

Investigate the implication of offline pyincore client

Investigate to see if pyincore-data has anything to do with incore services and incore client
Related to IN-CORE/pyincore#451

Fix pytest in github action

The github action for pytest is broken. Fix it.

rename master branch to main

rename master branch to main.

Create github action for conda and pypi publish

Converting and revising README.md to README.rst

Converting and revising README.md to README.rst in order to publish the package to pypi

NSI data API to IN-CORE building inventory dataset

1. develop a database of NSI data (in IN-CORE building inventory dataset TYPE)
2. develop a API to acquire the bldg inventory with user's given area (either boundary polygon, or FIPS code)
3. develop pyincore-data method to acquire the bldg inventory with API from step 2

Update the dependency for Conda

Update the conda library dependency to fit with pyincore and pyincore-viz

Create an endpoint that queries the NSI dataset

Create a method or endpoint that serves the NSI dataset.

Merge master to develop

Merge master branch to develop branch

Fix sphinx build error

Documentation docker container building process has an error due to the sphinx update. Fix this.

Create github action for automatic docker build and push for docs

Create a github action for automatic docker build for docs container and push it

Create release 0.5.0

Figure out NSI data to fit with INCORE building inventory

The NSI data should be adjusted to fit into INCORE building inventory schema.
There are several fields are missing in NSI dataset and some fields have different field name from incore building inventory schema.
Analysis the NSI attribute table and find out how to modify the attribute table.

1. Find out the fields that exist in NSI but have different name from incore building inventory
2. Find out missing fields in NSI that building inventory needs to have
3. Find out if the actual field format is correct (e.g. string, decimal digit, and so on)
4. Find out the way of converting the data value if the field exist with the values with different expression or different unit.

Please use the attached shapefile to check the NSI attribute. If there is any missing

joplin.zip

The metadata for the fields are in here
https://www.hec.usace.army.mil/confluence/nsi/technicalreferences/latest/technical-documentation

Add parameters to Census utility

Hardwired Census API parameters are get_vars = 'GEO_ID,NAME,P005001,P005003,P005004,P005010' and for=block%20group:.
For Galveston analysis we also need get=GEO_ID,NAME,B25002_001E,B25002_001M,B25004_006E,B25004_006M and for=tract:. The best way is to create a class parameters for get and for.

Create release 0.4.0

create pyincore-data release 0.4.0

Create release 0.3.0

Create a pyincore-data release 0.3.0

Make pyincore-data build with legacy naming for pypi publish

Currently, the setup.py in pyincore-data's naming for pypi is automatically normalizing the naming based on pep 440 but this is sometimes not beneficial for the naming convention, such as releasing the rc version. Modify setup to allow the legacy naming of the pakcage.

Fix python package upload github action

Fix documentation docker

Fix documentation docker that doesn't have a content