lorgine-li/genie

Distributed Big Data Orchestration Service

Genie

Introduction

Genie is a federated job orchestration engine developed by Netflix. Genie provides REST-ful APIs to run a variety of big data jobs like Hadoop, Pig, Hive, Spark, Presto, Sqoop and more. It also provides APIs for managing the metadata of many distributed processing clusters and the commands and applications which run on them.

Documentation

See the official website to find documentation about Genie and specific documentation for various releases.

Demo

Genie has demo instructions available for all 3.x.x releases. Please see the release you're interested in demoing on the releases page. Click on the release and then demo docs.

Builds

Genie builds are run on Travis CI here.

Branch	Build	Coverage
Master

Docker

Successful builds will also generate a docker image which is published to Docker Hub.

App Image

This is the image for the Spring Boot all in one jar. You can use docker pull netflixoss/genie-app:{version} to test the one you want.

You can run via docker run -t --rm -p 8080:8080 netflixoss/genie-app:{version}

WAR Image

This is the image that has Genie deployed as a WAR file within Tomcat. You can use docker pull netflixoss/genie-war:{version} to test the one you want.

You can run via docker run -t --rm -p 8080:8080 netflixoss/genie-war:{version}