A very simple demonstration of how to use SparkSQL to transform data from a CSV to a PostgreSQL table.
docker build --rm --force-rm -t docker-airflow-spark:latest .
docker-compose up
Go to Connections > spark_default > Host (spark://spark), Port (7077)
Testing database: test
Airflow database: airflow