marclamberti/airflow-materials-aws

Materials for the next course

airflow-materials-aws

Materials for the next course

airflow-materials-aws's Issues

Github default branch is now "main"

Need to update the helm fluxcd to include --set git.branch=main

helm upgrade -i flux fluxcd/flux \ --set [email protected]:marclamberti/airflow-eks-config \ --set git.branch=main \ --namespace flux

This has been a great class :) I am looking forward to more

Availability Zones

There are only two public/private subnets created when using the us-east-1 region. To create a public/private subnet for each, the AZs need to be explicitly stated in the cluster.yml file.

E.g. availabilityZones: ['us-east-1a', 'us-east-1b', 'us-east-1d']

Make a generic EFS commands script

Command eksctl get cluster | sed -n '2p' | sed -e 's/\s.*$//' might return an output that will fail for subsequent commands.
Example:

eksctl get cluster | sed -n '2p' | sed -e 's/\s.*$//'` 
airflow-2	 u

usage: aws [options] <command> <subcommand> [<subcommand> ...] [parameters]
To see help text, you can run:

  aws help
  aws <command> help
  aws <command> <subcommand> help

Unknown options: u

Also, watch command can be not present on other operation systems.

I will create a corresponding pull request with the fix.

Helm has moved their stable repo

The affected line is here. The new url for this repo is: https://charts.helm.sh/stable.

Thanks for putting together this course. It's been very helpful.