opencleveland / drocer Goto Github PK
View Code? Open in Web Editor NEWScraper and parser of Cleveland City Council's records and the produced text.
Scraper and parser of Cleveland City Council's records and the produced text.
our documentation is a hot mess.
Goals:
There is commented out code in records.py beginning on line 1142 down to line 1165. There actually also appears to be commented out code on lines 663 to 675. Also on lines 765 to 812.
Not sure if this is actually used in some capacity, but, if it's not, it should be removed just for general code cleanliness.
nice to have.
this may be a separate project from the website, but:
a basic guide for people for people to ask:
A one-two pager for average residents with a 9th grade reading level to understand
what type of information is in city council, here, what do terms like resolution and ordinance mean; explaining the concept of 'emergency ordinance'
http://www.clevelandcitycouncil.org/about-city-council/legislative-process
(this page above is new, and a welcome addition to the city council website).
And clean up department-related code
convert the pdfs to plain text.
After this is done, we can begin finding patterns for particular data that we're looking for.
For some inspiration or already existing projects, see:
https://github.com/18F/doc_processing_toolkit
http://textract.readthedocs.org/en/latest/
http://www.unixuser.org/~euske/python/pdfminer
1] downloading the PDFs
2] parsing them to the raw text (https://github.com/opencleveland/drocer/blob/master/records.py ) in proper directories.
setting up an AWS account (or something else) to run this every so often.
Thanks to Meaghan, the PDFs are now named in a standardized format (ISO 8601) (i.e. 2015-08-03).
Need to update documentation and our google drive with these files.
sorta of meta-issue.
I searched "854-17" in the repository search at the top of the page; and no results were returned.
However, if you search "854-17" (without parenthesis) in your browser's search function; (I copy and pasted "854-17"and pasted into my browser - FF57 - search).
on
https://github.com/opencleveland/drocer/blob/master/2017/2017-07-19.txt ; several results will be returned in
elliot has a draft of this.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.