thatnerduknow / financial-disclosures Goto Github PK
View Code? Open in Web Editor NEWTwitter Bot Tracking every Congress members financial disclosure documents freely available through the STOCK act. Follow @CongressionalFD
Twitter Bot Tracking every Congress members financial disclosure documents freely available through the STOCK act. Follow @CongressionalFD
The current test suite relies too much on side effects. For example, the test suite for downloadAndProcessPDF()
is dependent on both an HTTP request and im.convert()
which produces side effects to the file system and is dependent on a working installation of imagemagick and ghostscript which we can't expect a runner like github actions to have in place. methods that have side effects need to be mocked in the tests at the very least with a stub
I really wanted to use mongodb from the start but my personal server doesn't support AVX instructions and I was in a hurry so I bodged together a solution backed by a JSON file located in the project directory. I won't be able to host application data on my home server however the pricing for mongodb cloud looks to be fairly sane and considering the amount of data we're talking about here it would be worth implementing it since I have more faith in typeORM than my solution ๐
This is causes by trying to run downloadAndProcessPDF()
within records.forEach()
. the way it should be done should look something like this
const arr = [1, 2, 3];
await arr.reduce(async (memo, i) => {
await memo;
await sleep(10 - i);
console.log(i);
}, undefined);
// 1
// 2
// 3
console.log("Finished async");
// Finished async
This should only allow one call to downloadAndProcessPDF()
at once
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.