nycplanning/labs-factfinder

New York City Census Reporting Tool

NYC Population FactFinder 2020

Population FactFinder allows you to easily define study areas — by selecting Census Tracts, Census Blocks, Neighborhood Tabulation Areas (NTAs), Community Districts, and more — to produce detailed population profiles.

Requirements

You will need the following things properly installed on your computer.

• Git
• Node.js (with NPM) version tracked by .nvmrc
• Yarn
• Ember CLI

(You can use NVM to manage node versions on your computer)

Local development

• Clone this repo https://github.com/NYCPlanning/labs-nyc-factfinder.git
• Install Dependencies yarn
• Start the server yarn run start
  • If running labs-factfinder-api and labs-layers-api locally, instead start the server with yarn run start:local-api
• Run tests: yarn test

Architecture

Primary views:

• Selection - Allows the user to create a selection of geometries to view census/ACS data about.
• Explorer - Shows census/ACS data tables and charts for the selected geometries.

Backend services

• factfinder-api - An express api that handles search AND maps collections of selected geoids to an integer. Useful for persisting selections across browser sessions (also makes reports shareable)
• layers-api - A collection of feature layers to populate the map with data.

Contact us

You can find us on Twitter at @NYCPlanningTech, or comment on issues and we'll follow up as soon as we can. If you'd like to send an email, use [email protected]

labs-factfinder's Issues

User should be able to switch between selection and report views

User should be able to easily switch between map and profile views

User can access a user guide

User can download individual variables from report view

Example: if a user only wants to download "language spoken at home" instead of the full database or social profile.

User can see charts in profile of both profile area and comparison area

Charts will appear integrated within the profiles, showing both profile area and comparison area (includes MOEs and will flag statistically significant differences).

Always percent charts
Floating scale

User can toggle the selection view between tract and block selection

• Add toggle UI
• Add logic for moving between modes (when moving from block to tract, if any blocks in a tract are selected, select the tract. When moving back to block view, if a tract is selected, all blocks in tract will be selected)

User can see a reference map of selected area from report view

Reference map would appear in left panel of selected area

User can see tabs for different data types and high-level sections

Tabs include:
-Census
-Demographics (ACS)
-Social (ACS)
-Economics (ACS)
-Housing (ACS)

Extensive supporting layers (choropleths)

• Modeshare
• Income
• Etc

User can access a tutorial of the application

User can select a set of geometries based on radius from a lan/lon

User can see data for selected area in report view

User can select comparison area from prior selections within session

only in "standard" and "change comparison" report view (without reliability)

Highlighted geometries are clipped to tile boundary

To highlight on mousemove, we queryRenderedFeatures()and get the geometry of the feature that is under the mouse pointer. This is clipped to the tile boundary, however, and often shows only a partial geometry.

This issue on mapbox-gl-js presents a workaround that uses querySourceFeatures() to get the complete geometry. We should get this working, and apply the same fix to ZoLa.

mapbox/mapbox-gl-js#3871

User can select geometries based on variables.

Geographic filtering-- limit selectable areas on the map where geographies match user specifications (eg. user selected to limit geographies to those where Hispanic population is 50% or more)

Demographics Tab - User can see "change" report view

Data should appear gray if not reliable, even when MOEs and CVs are not shown in the view

User can search for intersection

User can build profile area by aggregating geographies within same geography type (eg. can aggregate census tracts OR aggregate NTAs but not census tracts AND NTAs)

Switch CI to deploy from master

User can see differences between selected area and comparison area (borough, city, etc)

Difference and percentage point difference will be shown and flagged when statistically significant

only in "standard" and "change comparison" report view (without reliability)

User can upload geographies to select report area

Demographics Tab - User can see "change comparison" report view

To account for future updates
-annual data updates
-content expansion
-additional functionality

User can select comparison area from a list of pre-defined high-order geographies (city and boros)

Default will be New York City.

only in "standard" and "change comparison" report view (without reliability)

User can overlay map layers to visualize/inform selection

Overlay layers like seen in zola
-Boro
-Community District
-Council District
-NTA
-PUMA
-Subways

User is first sees a citywide map of NYC showing NTAs & Subways

User can download full database

User would like to download data for all profiles at once

User can see summary information about their selection before generating the report

User can select tracts and blocks by various pre-defined geometries

Clear Selection Bug

Clear selection is buggy when switching between selector types.

To replicate:

• Load the app
• Select a tract
• Switch to blocks
• Unselect one of the blocks
• Click "clear selection"
• Everything should clear; but instead, the blocks are all selected as they were when you changed modes

User can identify estimates of change and estimates of differences that are statistically significant

By view:

• Standard (without reliability): significance labels appear to right of numeric difference and percentage point difference
• Standard (with reliability): not applicable
• Change over time (without reliability): significance labels appear to right of numeric difference and percentage point difference
• Change over time (with reliability): significance labels appear to right of numeric and percent change estimates
• Comparison change over time (without reliability): significance labels appear to right of numeric difference and percentage point difference
• Comparison change over time (with reliability): significance labels appear to right of numeric difference and percentage point difference estimates

User can select from a series of profile briefs

Profile briefs of selected variables

User can identify estimates with poor statistical reliability

Data associated with estimates of zero, top- and bottom-coded estimates, or Coefficients of Variation (CVs) of 20% or more are grayed out to signify poor statistical reliability

Applicable for standard, standard with reliability, and change over time (without reliability)

User can select comparison area from a list of pre-defined sub-boro geographies (NYC, Boros, PUMAs, NTAs)

only in "standard" and "change comparison" report view (without reliability)

Report output available to user in multiple formats

Output in multiple formats:

• print
• pdf (print)
• csv

User can provide feedback

Feedback mechanism-- link or email

Data Pipeline and loading

User can share a URL for a selection or a report

Demographics Tab - User can see "standard" report view

User can overlay choropleth maps to help guide the selection

User can see data for selected area and benchmark comparison area in report view

only in "standard" and "change comparison" report view (without reliability)

User can activate tooltips for more information throughout the app

Question mark buttons throughout application to provide explanations on terms or features to users

User can get more information about the app by navigating to an About page

User can select any number of geographies

"maximum selectable geographies" should not be less than 150. Current application limits users at 50.

User can search for address

Search should be easier to use than what is in the current application

User can search by subway line and station

User should be able to search for known geometries

Create microservice API for search typeahead, return results for PUMA & NTA

User should be able to quickly clear selection

There is a button somewhere that clears the selection in the selection service. The map should update to reflect the cleared selection

Find all Census Tracts within a given layer (tracts along a transit line)

User can select and deselect tracts or blocks in an ad-hoc manner

Select button should be easier to use than in current application.

Always active. Just need to click on geography.
Can scroll around map without having to turn select button off.

Create App Skeleton

• Create Ember App
• Add foundation, move settings file from Zola
• Add "Stock" Header
• Setup CircleCI for tests & up to date with develop
• Set develop to default branch
• Add a basic README
• Setup dokku app
• Setup automated deployment on updates to develop
• Add selection and report routes

Demographics Tab - User can view or hide reliability data

Ability to show/hide data reliability (MOE, CV, Percent MOE).

Data that is not reliable will still appear gray even when "data reliability" is switched off

Extract ember-jane from zola into a separate package

Create ember-jane repo & add to npm, add dependency to this project and create a simple map in the selection view.