colbyford/sparkitecture

A collection of “cookbook-style” scripts for simplifying data engineering and machine learning in Apache Spark.

Welcome to Sparkitecture!

Created by: Colby T. Ford, Ph.D.

PySpark Edition | A work in progress... | Created using GitBook.com

About

Sparkitecture is a collection of “cookbook-style” scripts for simplifying data engineering and machine learning in Apache Spark.

{% hint style="info" %} This is an open source project (GPL v3.0) for the Spark community. If you have ideas or contributions you'd like to add, submit a Feature Request or a write your code/tutorial/page and create a Pull Request in the GitHub repo. {% endhint %}

How to Cite

BibTex	Text Citation
@misc{sparkitecture, author = {Colby T. Ford}, title = {Sparkitecture - {A} collection of "cookbook-style" scripts for simplifying data engineering and machine learning in {Apache Spark}.}, month = oct, year = 2019, doi = {10.5281/zenodo.3468502}, url = {https://doi.org/10.5281/zenodo.3468502} }	Colby T. Ford. (2019, October) Sparkitecture - A collection of "cookbook-style" scripts for simplifying data engineering and machine learning in Apache Spark., (Version v1.0.0). Zenodo. http://doi.org/10.5281/zenodo.3468502

sparkitecture's Issues

sparkitecture - Logistic Regression

Under 'Define how you want the model to be evaluated',
metricName should be areaUnderROC