This script helps estimating cross az data transfer costs in EKS clusters.
The script is based on an existing AWS open solution. It simplifies operations by using your current AWS role directly from your shell session, and without using any iam:* permission...
- Runs With Your Current AWS Credentials: Uses the AWS credentials and settings you already have configured in your shell session. No need to configure special credentials just for the demo.
- Works Without Administrator Privileges: No need for IAM modification permissions - it's designed to work seamlessly with PowerUser access.
- Reuses Your EKS Authentication: Uses the active Kubernetes context in your shell to retrieve pod and node metadata.
- Simple Exectuion: Offers one-line execution with pipx or docker for all orchestration including cleanup.
Similar to the original solution, this project utilizes CloudFormation to provision flow logs and S3 buckets. However, it orchestrates everything using a script:
- Flow logs are temporarily enabled for the EKS VPC, and necessary S3 buckets are created via CloudFormation.
- Pod metadata, including the
app
label and node IP, is gathered. - After a configurable timeframe, flow logs are aggregated within Athena.
- The results are downloaded as a CSV file.
- Finally, the script cleans up any infrastructure changes made.
- Python version 3.6 or later
- Kubernetes Cluster API access in current shell
- An active AWS role in your current shell that has permissions to:
- Create flow logs
- Create S3 buckets
- Run Athena queries
Easiest way to run the script is with pipx. Pipx lets you run Python packages quickly in isolation:
python3 -m pip install --user pipx # install pipx if required
python3 -m pipx run quick-eks-cross-az --help
docker run -v ~/.kube/config:/kube/config -e KUBECONFIG=/kube/config -e AWS_ACCESS_KEY_ID -e AWS_SECRET_ACCESS_KEY -e AWS_SESSION_TOKEN asafamr123/quick-eks-cross-az --help
usage: cli.py [-h] [--minutes N] [--quiet | --no-quiet] [--verbose | --no-verbose] [--cleanup]
[--output OUTPUT] [--stack-name STACK_NAME]
Quick EKS Cross AZ Log. This script measures cross-AZ (Cross Availability Zone) traffic for EKS (Elastic
Kubernetes Service) using flow logs and data from the active Kubernetes context. It can be used to
estimate associated costs. Full docs are here: https://github.com/asafamr/quick-eks-cross-az
options:
-h, --help show this help message and exit
--minutes N set the duration for flow logs accumulation in minutes (default: 15)
--quiet, --no-quiet run without manual confirmation (default: False)
--verbose, --no-verbose
verbose log (default: False)
--cleanup clean up a previous interrupted run (default: False)
--output OUTPUT specify output file name (default: cross-az.csv)
--stack-name STACK_NAME
override CloudFormation stack name (default: quick-eks-cross-az