datadesk/california-coronavirus-scrapers

The open-source web scrapers that feed the Los Angeles Times California coronavirus tracker.

california-coronavirus-scrapers's Issues

variants scraper broken

https://github.com/datadesk/california-coronavirus-scrapers/actions/workflows/variant-proportions-states.yaml

variants by state scraper broken

https://github.com/datadesk/california-coronavirus-scrapers/actions/workflows/variant-proportions-states.yaml

demographics-race-by-county scraper is failing

https://github.com/datadesk/california-coronavirus-scrapers/actions/runs/1550313523

Add variant by month numbers to scraper

The state variant data page is at: https://www.cdph.ca.gov/Programs/CID/DCDC/Pages/COVID-19/COVID-Variants.aspx

It has added a new table of percentages over time.

Our goal is to scrape out this table and save it to a CSV. That could be inserted as a couple extra cells in the existing variant-toplines-ca notebook.

Variants scraper is busted

https://github.com/datadesk/california-coronavirus-scrapers/actions/workflows/variant-toplines-ca.yaml

Download state's skilled nursing dataset

https://data.ca.gov/dataset/covid-19-skilled-nursing-facility-data

lxml error when scraping variants from CDPH

The "Variant totals in CA" workflow fails when running the variant-topline-ca notebook. It's throwing an error because it can't find the lxml tool, which is needed by Pandas read_html() function. lxml is in the Pipfile and the notebook runs fine locally without errors.

Any ideas?

Demographics age scraper broken

https://github.com/datadesk/california-coronavirus-scrapers/actions/workflows/demographics-age.yaml

Scrape homeless impact data from state data portal

Here's an example that can be copied. Here's the data source.

Vaccine zip code endpoint may change weekly

We probably need to use beautifulsoup to find the url on that "Download All" button on this page

Follow up on maps

Killed map on tracker for following counties. waiting to hear back

Sutter
Sierra
Yuba

Column headers in portal feeds have gone all caps

demographics by state failing

https://github.com/datadesk/california-coronavirus-scrapers/actions/workflows/demographics-race-statewide.yaml

Refactor vaccine-breakthrough-cases to use state data portal

Rewrite this downloader to pull this data