Giter Site home page Giter Site logo

docker-presto's Introduction

docker-presto

CircleCI

Presto docker image based on alpine

  • Hadoop nativelib in plugin/hive-hadoop2/hadoop-apache2-2.7.4-5.jar is replaced with alpine built lib
# network 
docker network create vnet

# load docker env as needed
eval $(docker-machine env default)

# run containers
docker-compose up -d

$ docker-compose ps
    Name                 Command            State           Ports          
--------------------------------------------------------------------------
coordinator-1   entrypoint.sh coordinator   Up      0.0.0.0:8080->8080/tcp 
worker-1        entrypoint.sh worker        Up                             
worker-2        entrypoint.sh worker        Up

# Querying JMX
docker-compose exec worker-1 presto --server coordinator-1.vnet:8080 

presto> SHOW TABLES FROM jmx.current;
                                        Table
---------------------------------------------------------------------------------
 com.facebook.presto.execution.scheduler:name=nodescheduler                                                                                       
 com.facebook.presto.execution.scheduler:name=splitschedulerstats                                                                                 
 com.facebook.presto.execution:name=queryexecution
  :
  :

presto> SELECT node, vmname, vmversion FROM jmx.current."java.lang:type=runtime";
                 node                 |          vmname          | vmversion  
--------------------------------------+--------------------------+------------
 0cac4a52-5ce8-4962-90f9-56aa5dde23fc | OpenJDK 64-Bit Server VM | 25.181-b13 
 24cc4bf5-453d-48f6-8084-9c1e7af133fa | OpenJDK 64-Bit Server VM | 25.181-b13 
 fffa7505-a86d-4613-9f20-f5e779366fbd | OpenJDK 64-Bit Server VM | 25.181-b13 
(3 rows)

Query 20170105_045632_00017_ep8ih, FINISHED, 3 nodes
Splits: 4 total, 4 done (100.00%)
0:01 [3 rows, 210B] [4 rows/s, 342B/s]

presto> SELECT openfiledescriptorcount, maxfiledescriptorcount FROM jmx.current."java.lang:type=operatingsystem";
 openfiledescriptorcount | maxfiledescriptorcount 
-------------------------+------------------------
                    1222 |                1048576 
                    1231 |                1048576 
                    1277 |                1048576 
(3 rows)

Query 20170105_045816_00019_ep8ih, FINISHED, 3 nodes
Splits: 4 total, 4 done (100.00%)
0:01 [3 rows, 48B] [5 rows/s, 89B/s]

presto> exit

# CLUSTER OVERVIEW UI
open http://$(docker-machine ip default):8080

# cleanup
docker-compose stop
docker-compose rm -fv

docker-presto's People

Contributors

smizy avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.