tobilg/docker-livy

A Docker image for Livy, the REST Spark Server

docker-livy

A Docker image for Livy, the REST Spark Server.

Running

The image can be run with

docker run -p 8998:8998 -d tobilg/livy

which will expose the port 8998 on the Docker host for this image.

Details

Have a look at the official docs to see how to use the Livy REST API.

docker-livy's Issues

Error: Cannot find Livy REPL jars

Create an instance from example
docker run -p 8998:8998 -d tobilg/livy

Spark Example

>>> import json, pprint, requests, textwrap
>>> host = 'http://localhost:8998'
>>> data = {'kind': 'spark'}
>>> headers = {'Content-Type': 'application/json'}
>>> r = requests.post(host + '/sessions', data=json.dumps(data), headers=headers)
>>> r.json()
u'requirement failed: Cannot find Livy REPL jars.'

Push 0.2.0 to registry

Hey,

I didnt find version 0.2 in the public registry would be nice, to have this one tagged as 0.2 not as latest :).

Thanks,
Jendrik

Cannot execute statement and State as running forever

I followed this doc here
https://github.com/cloudera/hue/tree/master/apps/spark/java

and created session then sent in a simple {"code": "1+1"} via POST /sessions/{sessionId}/statements but what I got was this:

{
  "id": 0,
  "state": "running",
  "output": null
}

The Kitematic console shows this

192.168.59.1 - - - 10/Mar/2016:07:56:26 +0000 "GET /sessions/0/statements/0 HTTP/1.1" 200 40

I think this has to do with Livy but I am wondering if you ever got it to work?