rdamarapati/credit-analytics

credit-analytics's Issues

Project Requirements and Milestones

In the current project, after loading and linking the data, we were about to find out defaulters and the like. And then use this dataset to train some predictive models for future use, say 2012 data or 2013 data.

Now, you want these models to be built in integration with Hadoop?

Or they will be standalone models which we just take some results from the queries supplied to Hadoop and work on them?

Essentially, I request you to give me a full requirements doc (bullet points as in first mail would suffice) and the stage-wise deliverables (including what input we'd be giving and the processing and output you expect) for the current project, so that I can read up the required technologies whenever I get time.

Mapping HMDA -> "Respondent-ID" with FDIC "ID RSSD"

'HMDA Reporter Panel' file is the universe of all institutions that are reported under HMDA for the activity year.

HMDA Reporter Panel File Format- http://www.ffiec.gov/hmdarawdata/FORMATS/2011HMDAReporterPanel.pdf

HMDA Reporter Panel Data File - http://www.ffiec.gov/hmdarawdata/OTHER/2011HMDAReporterPanel.zip

Respondent RSSD ID - Format is right-justified and zero filled in HMDA Reporter Panel
ID RSSD - Format is just a number and is not zero filled in FDIC files.

So, we need to make the adjustment for the leading zeros when we compare and match the 'ID RSSD' in FDIC with 'Respondent RSSD ID' in HMDA files