datausa/datausa-api

API for accessing US data sets

datausa-api's Issues

hookup endowment quintiles table

• hook up table
• hook up crosswalk

You guys rocks!!!

You guys are awesome with this stuffs! I just want to say that! I don't know how to talk to You guys, so I make an issue here, sorry 😞. I really inspired by Your work guys, so I intended to make one! I'm willing to present it to my country/land here in Lombok. So I just clone your repository for learning purpose such as how You collect data, how You structure them and so on, any way datausa-site (this one is really big so I may be will clone it tomorrow at my campus, my cell phone plan is really limited 😅 ). A little bit about me, I am bachelor student of Informatics Engineering at local campus in Mataram (we here call it TI an abbreviation for Teknik Informatika), I don't study much about data, yes we have one class of Statistics but not digging too much. So i hope You guys give me some advice in purpose of so my journey to study and provide this system to my country/land having less obstacles, didn't mean i don't want them, I love challenges/obstacles!. But, you know 😄, just a little bit advice maybe. I don't know if you guys can read my English, it's not our native or second language here. But, I hope You guys can understand what i wrote here intuitively 😄. Thank you guys in advance!

triple-check that the Dartmouth data was ingested correctly

from Ann Perrin:

Can you check on the Medicare hospital inpatient spending data - make sure it's added and labeled correctly. We plan to use it for a story and would like to start as soon as possible. Let me know if there are any issues and timing.

ACS Race data missing at tract level

I'm attempting to get the percentage the population that is white (pop_white) at the tract level for all tracts in a particular city. The following query returns an empty array of data:

https://api.datausa.io/api/?show=geo&sumlevel=tract&force=acs_5yr.yg_race&limit=5

However, the pop_white data appears to be visible at the state level.

I'm able to get population data at the tract level (link), but tract level data appears to be unavailable.

update 2015 acs data

2015 acs 5 year will be released in december

fix bug with ipeds_occ for carnegie parent groupings

e.g. https://university-api.datausa.io/api/?sort=desc&show=ipeds_occ&university=DOC&required=num_noninstructional_staff&sumlevel=all&year=all&where=num_noninstructional_staff%3A%210

should be "08" instead of "8.0"

university branch ipeds.gradspct_ycu table has null year values

as seen in this API call:

...
"ipeds.gradspct_ycu": [null, 2015, 2014]
...

this is currently breaking the CIP profile pages. I can put a filter on the front-end to remove the null values, but thought this might be a data bug as well

remove negative dartmouth values

Similar to the issue with leg amputations, we need change negative values to null for certain Dartmouth variables. May be for more variables than this, but definitely for these (and I will continute to update this list if I find other variables):

• discharges_for_ambulatory_conditions_per_1000_total
• discharges_for_ambulatory_conditions_per_1000_black
• discharges_for_ambulatory_conditions_per_1000_white

error with pums.yc table

I'm getting geo attributes returned from this query,because it's not able to find "num_ppl_rca" in the yc table: https://sunbird-api.datausa.io/api/?show=cip&required=avg_wage,num_ppl_rca&sumlevel=all&year=latest

...how difficult is it to add rca values to that table?

update acs pums data for 2015

ACS PUMS 2015 scheduled to complete in January '16

add "keywords" column to university attribute table and hook it up to search

• add table column
• hook up to search
• rebuild index script

hookup attribute table for OPEID

add support for university sumlevel filtering

The ability to filter university based on the Carnegie classification hierarchy

update API documentation to include new health datasets

Readme

Could you modify the readme so the portion about the API points to the 'about' section on the site and the wiki?

add health insurance data from acs

location "05000US99999" on maps

@davelandry commented on Fri Apr 28 2017

Expected Behavior

All locations should have names.

Current Behavior

There is a weird "05000US99999" location visible on the map when looking at data from the Dartmouth Atlas. @jspeis do you know what this is? Should we be filtering this out of the data calls?

Steps to Reproduce (for bugs)

https://sunbird.datausa.io/map/?level=county&key=total_medicare_enrollees

Your Environment

• Browser Name: N/A
• Operating System and Version: N/A

"image_meta" column in non-geo attribute tables

This column image_meta needs to be added to the following tables, as well as being hooked up in the API and passed to the attribute calls:

• attrs.course
• pums_attrs.pums_naics
• pums_attrs.pums_soc

Is there an api for the images?

I'd like to use your location photos in a project I'm working on.

hookup retention rate table

connect new IPEDS enrollment tables

full/time part enrollment and enrollment by residence

show=cip,naics data call not working

https://sunbird-api.datausa.io/api/?show=cip,naics&required=num_ppl&sumlevel=all,all&year=all

hookup university tables

• grads by university
• tuition by university

new dataset priorities

Starting this github issue to serve as a central location for all new dataset ideas. These are the datasets that have been requested by the client for near-future inclusion on the site:

• Social Mobility

document freight data in API

return map pages in search API results

Expected Behavior

It would be really great if when using the search API and a user types a variable only available in a Map page, that result appears inline with the profile links (ie. "Map of Children in Single-Parent Households").

Current Behavior

The search API only returns profiles (and sections of profiles).

bea api not working

https://api.datausa.io/api/join/?required=year,industry_iocode,commodity_iocode,value_millions,industry_level&show=geo&limit=500 this api caall gives an error. It says {"error": "No tables can match the specified query."}. Please help.

update topic search terms for new health sections

mainly, the "obesity_diabetes" chart is being removed, so we need to change/remove those from the search.

ingest historical default rate data

Not necessary for current University launch on old architecture, but once we switch over to new architecture we should look at ingesting this. It looks like they use OPE_ID from 1996 onward: https://ifap.ed.gov/DefaultManagement/press/

document IPEDS operations and financial variables

Update documentation for IPEDS operational & financial variables

hookup new financial aid data tables

• aid tables
• income range attr

remove image_path from attribute results

Kicking Horse!

The attr call: https://api.datausa.io/attrs/geo/16000US3040580/

Returns the state image_path, but it has a beautiful image: https://datausa.io/profile/geo/16000US3040580/

update ipeds attributes for 2015 universities

income_range "3" attribute name contains extra comma

current name:
$48,001, - $75,000

should be:
$48,001 - $75,000

search universities by abbreviation

hookup new graduation rate tables

• add tables to API
• update documentation

add ability to "show=bls_naics" and "show=bls_soc"

ex. https://sunbird-api.datausa.io/api/?sort=desc&required=emp_2004_thousands%2Cemp_2014_thousands%2Cemp_2024_thousands&sumlevel=2&show=bls_naics

Broken queries

The examples at the bottom of the BLS page are broken:

https://github.com/DataUSA/datausa-api/wiki/BLS-API

Examples

http://api.datausa.io/api/?show=naics&sumlevel=all&naics=111&required=emp_2012_thousands
http://api.datausa.io/api/?show=soc&sumlevel=all&soc=110000&required=emp_2012_thousands

variable aware-search

allow users to search for variables such as obesity and diabetes.

add universities to profile search

import population by age bucket from acs

filtering API query by state

Does this API have a way to filter through all 50 states by order of name or alphabet, delivering only one result per state?

update IPEDS data to 2015

import dartmouth health data

query sumlevels, tables, geo by variable

This is more of a feature request than a report of a bug.

I have been hugely impressed with your API as I think it could be very useful for social scientists like myself that often use census and economic data and are frustrated with the census site. I especially like that you can specify a variable and a geographic sumlevel, and the results will be returned at the desired unit of analysis. This is a big step forward!

I have created a short guide for constructing queries in R to make your API accessible to scholars:

https://gist.github.com/lecy/0aa782a873cd174573f32d243233ca5b

The hardest part of using this data is that the validity of arguments varies by the underlying data source. So in one instance I can use "show=geo&sumlevel=msa" and in another instance I cannot, which is confusing for users and it makes it frustrating to figure out if you can get data at the desired level.

To address this problem I have included a couple of helper functions in the guide to allow the user to peek at attributes, and to print the set of valid cases based upon the logic view at "http://api.datausa.io/api/logic/?".

For example, I have formatted the query "http://api.datausa.io/api/logic/?show=geo&sumlevel=all" to print a bunch of tables that look like this:

getUsage( "geo" )
# TABLE: ygi_num_emp 
# DATA SOURCE: ACS 3-year Estimate 
# DEPARTMENT: Census Bureau 
# LINK: http://www.census.gov/programs-surveys/acs/ 
# 
# SUPPORTED SUMLEVELS: 
# 
# acs_ind:  0, 1, 2, all
# geo:  nation, state, msa, all
#
# ...67 more tables printed

The problem is that this use case searches by data attribute (show=geo) and references a data table (ygi_num_emp), but in the typical case the user would want to search for valid sumlevels associated with a specific variable. For example, can I find the number of philosophy majors by county?

Ideally there would be a way to specify an API query that submits a variable name and returns all valid attribute-sumlevel pairs (for example show=geo & sumlevel= nation, state, or msa).

It would be possible to create some functions to do this if the following queries are available:

• Return all data tables and their valid sumlevels
• Return all variables associated with a data table (even better if they include definitions)
• Return all valid sumlevels associated with an attribute

Please let me know if these functions currently exist, or can possibly be added.

broken SOC page from BLS growth ids

The top occupation in this chart has an id of 311000, which when appearing as text links to this page: https://datausa.io/profile/soc/311000/ ... which gets a 404!

It seems that the id should be 311010 and link to this page? https://datausa.io/profile/soc/311010/

add endpoint to compute nearest universities

IPEDS Enrollment wiki outdated

First, thank you for the work you're doing! It truly is remarkable what you've accomplished.

I'm currently trying to run a query for the enrollments from the IPEDS dataset. However, it returns {"error": "No tables can match the specified query."}

This is the query I'm currently using:

https://api.datausa.io/api/?show=university&sumlevel=all&year=latest&required=enrolled_total

Any help would be greatly appreciated!

return carnegie groups in university search to enable comparisons

Access ACS Data via API

Hello - I'm trying to access the ACS data (such as this commute means info), but it doesn't appear to be available via the DataUSA API. I have tried to make requests using Python's requests library, but either get a 404 response or (after adding headers to the call) get a bunch of uninterpretable hex.

Is it possible to pull down this data using the API? This is one of the calls I tried:

requests.get("http://banana.datausa.io/api/data?measure=Average Commute Time&drilldowns=Place", headers=headers)

I also tried putting the parameters in a dictionary and passing them that way.

I am using python 3.6.9 and requests 2.23