Giter Site home page Giter Site logo

discuss's Introduction

Socrata QGIS Plugin

Created By Peter Moore

Requirements

Due to TLS security issues with older versions, the plugin requires QGIS3 or above.

Usage

The Socrata plugin is added the 'Web' menu.

Enter in the domain. Username and Password are optional fields.

You can use the "Get Maps" button to get a list of all map assets on the domain or conversely enter in the dataset ID if you have it.

By clicking OK the map will then be added to your project.

NOTES:

All maps on Socrata are in WGS84 and are retrieved through the GeoJSON endpoint.

discuss's People

Contributors

chrismetcalf avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

discuss's Issues

Platform updates to require SNI support on all TLS connections

On August 20th we updated the Socrata platform to require support for the SNI extension on all TLS connections. This may affect your code and you may need to update your system or environment to a newer version that supports SNI.

This issue will serve as location to track what versions of different libraries are necessary. If you're having problems upgrading to use SNI, comment here, and we'll help out.

We've also posted a changelog update to dev.socrata.com with more information

Known good version combinations:

  • Python 2: 2.7.9 and greater
  • Python 3: 3.2 and greater
  • Ruby: 2.0 and greater, via net/http
  • Java: 1.7 and greater
  • Perl: Since Net::SSLeay version 1.50 and IO::Socket::SSL version 1.56
  • PHP: Since version 5.6
  • ArcGIS: Version 10.4.1 includes Python 2.7.10, which works with SNI (confirmed by @timwis)

Dataset 'a9we-mtpn' was not found

I was trying to fetch a9we-mtpn from the SODA api, but I get back this error message:

{
  "message": "Dataset '_a9we-mtpn' was not found",
  "errorCode": "soda.dataset.not-found",
  "data": {
    "dataset": "_a9we-mtpn"
  }
}

I believe it is an issue on your side because even when I visit the dataset here:

https://dev.socrata.com/foundry/data.cityofnewyork.us/a9we-mtpn

and I use try it, I get the following issue on safari:

screen shot 2017-03-14 at 10 25 59 pm

I tried the same setup in chrome and it also broke.

Trying to hit the url directly here also did not work:

fetch dataset issues

Thanks for your time,
Dean

[data.iowa.gov/gq4y-pik4] Question about "Food Assistance Program Households Recipients and Allotments by Month and County"

API Docs: https://dev.socrata.com/foundry/data.iowa.gov/gq4y-pik4

Hi guys.
With respect to the new downloadable version of the CSV file the row containing primary_county_coordinates is concatenated as primary_county_long and then primary_county_lat
Should it not read primary_county_lat then primary_county_long.
If you agree and are planning to fix , could you also include a comma between the coordinates also. It would make mapping easier when pulling into Folium
FAPRev1.txt

[data.seattle.gov/kzjm-xkqj] Missing "state", "level", and "units" fields

The endpoint for the realtime 9/11 fire calls data doesn't expose information about whether or not the call is active or closed. However, the much-more-primitive site (hosted by city of seattle) located here indicates which units are/were dispatched, the state of the call, and the level.

Not sure this is the right place for feature requests like this, but I figure if anyone can has the right points of contact to feed this back to the city of seattle, they'd be here.

Getting Council Agenda data into Open Data Portal

Hi there, we're developing an Open City Council app that leverages your open data platform.

The City of Austin has a feed of their Council Agenda Items on their feed:
https://data.austintexas.gov/Government/Austin-City-Council-Agenda-Items/es7e-878h

But the City of Las Vegas does not:
https://opendata.lasvegasnevada.gov/browse?q=council&sortBy=relevance&utf8=%E2%9C%93

Both use the same SIRE agenda management system. Is there a way for Las Vegas to get its Agenda Item data from SIRE into Socrata Open Data?

[data.seattle.gov/3neb-8edu] e-Park API: status vs vacant

API Docs: https://dev.socrata.com/foundry/data.seattle.gov/3neb-8edu

Can you tell me how to interpret the status field, and how it differs from the vacant field? I see that status contains either a number or the value "open". I figured the number corresponded to the number of available parking spaces, and if that number was not known (and maybe only if the lot was known to not be full), then it would contain "open". However, I see that there is also a field called vacant, which contains a number that is close to, but not always the same as the number in status. And when the status is "open", there is still a number for vacant.

So, my questions are:

  • What, precisely, is status?
  • What, precisely, is vacant?
  • What does it mean when the status is "open"?
  • Why is there sometimes a difference between vacant and status?

moto.data.socrata.com - some datasets not fresh

  1. Nice work getting all these datasets with a mostly common schema !
  2. A couple of the big cities seem to be out-of-date and probably not as complete as others.
    For example on https://moto.data.socrata.com/browse?limitTo=datasets&utf8=โœ“&page=51
    Denver - https://moto.data.socrata.com/dataset/Denver-Police-Department/686w-bug2
    only 172,000 rows for period May 2012 through October 2015
    Los Angeles - https://moto.data.socrata.com/dataset/Los-Angeles-Police-Department/dbrj-jyyp
    only 375,000 rows for period May 2012 through October 2015
  3. Compare this to
    Portland, OR - https://moto.data.socrata.com/dataset/Portland-Police-Bureau/mmpn-q6w2
    1,425,000 rows for period May 2011 through today ( March 2016 )

Why the difference in size and currency ?

[data.cityofnewyork.us/dvnq-fhaa] Question about "DOB Violations"

API Docs: https://dev.socrata.com/foundry/data.cityofnewyork.us/dvnq-fhaa

Hi All,
Im getting the JSON data using the below Java code:
The program was running successfully for past few months. But suddenly for the past one week, Im getting the exception.

StringBuilder urlString = new StringBuilder("https://data.cityofnewyork.us/resource/dvnq-fhaa.json");
URL url = new URL(urlString.toString());
HttpsURLConnection conn = (HttpsURLConnection) url.openConnection();
			conn.setRequestMethod("GET");
			conn.setRequestProperty("Accept", "application/json");
			conn.setRequestProperty("X-App-Token", "XXXXXX");
if (conn.getResponseCode() != 200) {
				throw new RuntimeException("Failed : HTTP error code : " + conn.getResponseCode());
			}
BufferedReader br = new BufferedReader(new InputStreamReader((conn.getInputStream())));

Im getting the following exception :
java.net.SocketException: Connection reset
	at java.net.SocketInputStream.read(SocketInputStream.java:196)
	at java.net.SocketInputStream.read(SocketInputStream.java:122)
	at sun.security.ssl.InputRecord.readFully(InputRecord.java:442)
	at sun.security.ssl.InputRecord.read(InputRecord.java:480)
	at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:934)
	at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1332)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1359)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1343)
	at sun.net.www.protocol.https.HttpsClient.afterConnect(HttpsClient.java:563)
	at sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect(AbstractDelegateHttpsURLConnection.java:185)

Kindly help me, what went wrong. I couldnt understand. Any changes made in the API that is causing the issue? Because the program was successfully running. This exception is happening for the past one week only.
Thank you,
Marimuthu M

checkboxes - true, false, or null

We recently ran into an issue where we were getting errors on filtered views that include checkboxes in their filter (in this case, that the columns were not checked). The underlying dataset is private and the filtered views are public.

The dataset is populated by an ETL process that uses our SODA.NET library and the checkbox columns are defined as boolean properties. Our process was setting the boolean properties to true or false. everything appeared to be working correctly until we tested anonymous access to the filtered views via the API - the service returned status 500 errors.

Socrata support investigated it for some time and determined that the filtered view API call could not deal with the checkbox columns containing false values. Instead, the checkbox columns needed to contain true or null.

We recoded our ETL to specifically set the boolean properties to true or null and our filtered view API calls now work correctly. However, this raises a question about the API, or its documentation:

https://dev.socrata.com/docs/datatypes/checkbox.html#,

Either the API service should be updated to support false values as well as null or the documentation should reflect that only true or null values are allowed

[opendata.rdw.nl] 500 Server Error's

I'm getting daily 500 Server Errors when sending API calls to https://opendata.rdw.nl

Recent errors:
21-Mar-2016 15:43:01
21-Mar-2016 17:09:03
21-Mar-2016 17:18:24

Example API calls:
https://opendata.rdw.nl/resource/kmfi-hrps.xml?kenteken=28TVSH
https://opendata.rdw.nl/resource/m9d7-ebf2.xml?kenteken=HD507J

The API calls are working now, but on the datetimes above then gave a 500 Server Error.
Everyday I get 500 Server Errors on different API calls and different times.

Dallas RMS arrest report not updated

Hi,
I am querying the RMS arrest report dataset and it appears there are no new entries since August 18th. I see new arrest charges since August 18 in the arrest charges dataset so there had to be new arrests but no new entries are showing up. Any explanation as to why this could be happening or is there some problem with the Dallas RMS arrest dataset currently?

New case API

Hi, I am lead integration consultant for http://www.usefulfeedback.com. We provide on-demand complaint management software to a range of US finance customers. I notice that you publicize an API allowing access to resolved complaints - we wondered if you also had an API that would allow secure access to a feed of new complaints per organisation that we could access to automatically populate work queues for our clients?

[data.seattle.gov/pu5n-trf4] Wrong lat/lng

This query https://data.seattle.gov/resource/pu5n-trf4.json?$select=hundred_block_location,incident_location&$group=hundred_block_location,incident_location&$where=within_circle(incident_location,%2047.508145,-122.234978,%201)&$order=hundred_block_location shows that a bunch of city blocks were given the same incident_location

Results for first two block addresses where XX replaced with 00 using http://www.latlong.net/ Note when using XX instead of 00 I get the reported issue of the lat/lngs not being different.
47.512174,-122.247753
47.511724,-122.245971

API Docs: https://dev.socrata.com/foundry/data.seattle.gov/pu5n-trf4

C# and pwoershell gets error's TLS 1.2

Invoke-RestMethod : The underlying connection was closed: An unexpected error occurred on a send

I have used the example:
`$url = "https://opendata.rdw.nl/resource/m9d7-ebf2"
$apptoken = "YOURAPPTOKENHERE"

Set header to accept JSON

$headers = New-Object "System.Collections.Generic.Dictionary[[String],[String]]"
$headers.Add("Accept","application/json")
$headers.Add("X-App-Token",$apptoken)

$results = Invoke-RestMethod -Uri $url -Method get -Headers $headers`

I had to add:
[Net.ServicePointManager]::SecurityProtocol = [Net.SecurityProtocolType]::Tls12

can this by added by the example(s)

Fields Missing from ACRIS api

Hello ,
i've been working on Socrata API for ACRIS and i'm unable to find the following fields from the api

assesment date
collateral
file_number
map_sequence_number
message
pages
parcels
property_type
rptt_number
slid_num

any help is greatly appreciated
acris_shot

[data.baltimorecity.gov/m8g9-abgb] Question about "Calls for Service" (geocoding and description)

API Docs: https://dev.socrata.com/foundry/data.baltimorecity.gov/m8g9-abgb

Geocoding

Is any information about the geocoding process for this dataset available? There appear to be a number of valid human readable locations ("incidentLocation" column) that do not appear to be geocoded to a valid location ("location" column) and some invalid locations geocoded to a valid geographical location.

A list with entries that could not be assigned a neighborhood from the past day can be found at https://www.neighborhoodcallwatch.com/Uncategorized. 50 of the 118 entries do not have a location (either "(,)" or "(0.000000,0.000000)") and the remainder either have "100" or similar for the "incidentLocation" and a "location" that does not appear to correspond to a Baltimore City neighborhood (e.g., "2600 ROYAL OAK AV").

Sample problematic entries:

"MONDAWMIN MALL", a recognizable place, has been geocoded to "(0.000000,0.000000)" for call "P163321463" and "(39.318644,-76.654012)" for call "P163321732". "P163321463" appears to have occurred before "P163321732".

"1300 DOCK ST" was geocoded to "(,)" for calls "P163321083" and "P163321131".

"HQE" was geocoded to "(0.000000,0.000000)" for call "P163321606".

"100" was geocoded to "(39.3810499,-76.6572571)", which appears to be outside of city limits, for a number of calls, among them, "P163320024". Does 100 have a special meaning?

Description

Each call entry appears to have a description to summarize the issue ("description" column). However, the number of unique descriptions appear to be in the thousands when counted by year and close to one thousand when counted by month with some duplication/typos.

Is any information available with regard to the data normalization/a list of terms that should be expected for comparisons across time/areas?

Thanks!

data.medicare.gov/6e4e-y3f9 data type change?

Following the 12/18/2016 dataset update our process reading the 'Patient survey (HCAHPS) - State' (6e4e-y3f9) results started experiencing a deserialization error. It was isolated to the hcahps_answer_percent field.

We're using c# and NewtonSoft.Json to deserialize results. Our class had a decimal property for a number value, which now has a datatype of Text.

The 3 Patient survey (HCAHPS) datasets are inconsistent in the hcahps_answer_percent data type
'Patient survey (HCAHPS) - Hospital' (rmgi-5fhi) : hcahps_answer_percent [text]
'Patient survey (HCAHPS) - State' (6e4e-y3f9) : hcahps_answer_percent [text]
'Patient survey (HCAHPS) - National' (jk4x-yzqp) : hcahps_answer_percent [number]

Before the 12/18/2016 update I think the 'Patient survey (HCAHPS) - State' hcahps_answer_percent data type was number, as it is on the National dataset. It's now text, as it is on the Hospital dataset.

[data.cityofchicago.org/baqf-cmdv] Question about "West Nile Virus (WNV) Mosquito Test Results"

Hi, I'm having trouble accessing the WNV Mosquito dataset using the RSocrata interface.
The R command listed at the end of the webpage:
API Docs: https://dev.socrata.com/foundry/data.cityofchicago.org/baqf-cmdv

does not work:

df <- read.socrata("https://data.cityofchicago.org/resource/baqf-cmdv?$$app_token=MYTOKEN")

returns the error message "Error in read.socrata: text/plain not a supported data format."
I also tried other options, to no avail: the command below returns the same error

read.socrata("https://data.cityofchicago.org/resource/baqf-cmdv", app_token="s0ucmjE7RYtXUmMhwUYPI8Xdm")

while this:

read.socrata("https://data.cityofchicago.org/resource/baqf-cmdv.json")

returns "Error in rbind(deparse.level, ...) : numbers of columns of arguments do not match"

The python interface functions properly.

[data.sfgov.org/ktji-gk7t] Question about "Case Data from San Francisco 311 (SF311)"

API Docs: https://dev.socrata.com/foundry/data.sfgov.org/ktji-gk7t

The page has a helpful looking section called "External Integration" but the plotly portion is saying that the file is too big, and the Carto DB integration ends in an error, with the message to contact the great people at Carto and reference them the error message. Done. Carto quickly responded,

Hi Greg,

Thank you for reaching out. The import error is that the file is too large. The free plan associated with your email address has a max import file size of 150MB and a max import row size of 500,000. What is the size of the file you are attempting to import? Please note that CARTO will use the uncompressed version of the file as the import size.

Best,
Michelle

screenshot 2016-12-19 at 11 11 18

Here his what the plotly error looks like.

screenshot 2016-12-19 at 11 17 04

**Perhaps, as a workaround for the people who don't have a Plotly professional plan, you could limit the endpoint to filter just the last 50,000 rows for Carto and 1000 rows for Plotly ..., and give instructions for the cases where more is needed.

bests**

[data.cityofnewyork.us/ujkp-2x99] Question about "Benefits and Programs API"

API Docs: https://dev.socrata.com/foundry/data.cityofnewyork.us/ujkp-2x99

Please consider sending the data results without any HTML formatting. I'd love to be able to use the JSON file to make links to the appropriate forms for specific programs, but I will have to use JS to "deformat" the content before I use it in the page.

If the JSON file came with no formatting, I could use it as I wish and apply my own formatting to the result.

Any API method to get all links to dataset snapshots?

Is there a Socrata API method to get links to all dataset snapshots for a given API endpoint?

I can click on more views -> dataset snapshots to get these information.
It would be great if there's an API method.

I've also checked the headers, but it's not there.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.