Zookeeper, Drill and Hadoop HDFS docker containers based on Cent OS 7. Zookeeper cluster has 3 nodes. Drill cluster has 4 nodes. UDF directories are storing in HDFS.
Install Docker CE and cd to cloned repo root folder
-
Run
docker-compose -f local-setup.yml build
-
Run
docker-compose -f local-setup.yml up
-
Wait for 1-2 minutes as the cluster needs time for startup.
-
Run
docker swarm init --advertise-addr <MANAGER-IP>
, where MANAGER-IP is the ip-address of your host machine. You can add another machines to your swarm cluster and connect them via generated token. -
Create overlay network with
vnet
name. Rundocker network create -d overlay vnet
-
Run
docker stack deploy --compose-file swarm-setup.yml drillStack
-
Wait for 2-3 minutes as the cluster needs time for startup.