makepath/census-parquet

Python tools for creating Parquet files from 2020 Census Data

census-parquet's Issues

cli command for generating synthetic people

Save outputs as Geoparquet

ReadMe needs to be updated

Several changes have been made (e.g., now available on conda forge, there are 3 output parquet files that have various features in each) and the ReadMe doesn't reflect these changes.

Race/ethnicity columns need to be added

run_census_parquet fails at stage 5

at 99% completed of "finalizing geo files" the following error occurs:

Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/dask/dataframe/io/parquet/arrow.py", line 56, in _append_row_groups metadata.append_row_groups(md) File "pyarrow/_parquet.pyx", line 628, in pyarrow._parquet.FileMetaData.append_row_groups RuntimeError: AppendRowGroups requires equal schemas.

run_census_parquet not executing new procedure

create new conda environment

conda create --name cp-test python=3.8
pip install -e .

run_census_parquet failed at stage 5 with old procedure.

run_census_parquet does not run updated process_blocks.py

Missing processing for us_nation_5m?

I might be missing it, but I don't see how the cb_2020_us_nation_5m.zip file is downloaded / processed. Just need to add it to download_boundaries.sh?