ggpeti/gcespark

infrastructure code for spark on gce

To do the following operations, first have Nix installed, and then run nix-shell.

To deploy a new version:

1. Download service account key, save it as account.json
2. Run terraform apply

To ssh into the host:

Run TERM=xterm ssh -i SECRET_private_key root@$(terraform output ip)

To check the host's static public IP address:

Run terraform output ip

To check if haproxy is running:

In the host, run the following: journalctl -u haproxy

To check all running services:

In the host, run the following: systemctl -t service

1. Deployer environment all the tools needed to deploy the system in our case terraform defined in shell.nix

2. Infrastructure all the resources rented from GCP compute instances, network addresses etc. defined in *.tf

3. Target environment all the software we run like spark, impala, etc. defined by templates/*.nix