Giter Site home page Giter Site logo

naimakov / spark-notebook Goto Github PK

View Code? Open in Web Editor NEW

This project forked from prasadseemakurthi/spark-notebook

0.0 0.0 0.0 968 KB

Launch Apache Spark and Jupyter Notebook on Amazon Web Services.

Shell 10.52% Python 52.71% Jupyter Notebook 18.65% CSS 0.36% HTML 17.76%

spark-notebook's Introduction

Spark Notebook (Launcher)

Build Status

Spark Notebook (Launcher) is a web-based interface to install and start Apache Spark and Jupyter Notebook on Amazon Web Services' Elastic Map Reduce (EMR).

Requires Python 2.7 or 3.6.

Installation

  • Install required packages.
pip install -r requirements.txt

Usage

If the required packages are installed in a virtualenv, activate the virtualenv first.

source <env_name>/bin/activate
  1. Run ./run.py.
  2. A browser window will automatically open the URL: http://localhost:5000.

Please refer to docs for more details.

Environment

  1. Apache Spark 2.1.1 will be installed with Elastic Map Reduce 5.6.0.
  2. Continuum Anaconda Python 4.4.0 will be installed with Python 2 and Python 3 iPython Kernels.

Important Notes

Please keep the credentials file (by default, credentials.yaml) in a secure place. Especially, do NOT accidently upload it to any public GitHub repositories.

spark-notebook's People

Contributors

kevincoakley avatar arapat avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.