Giter Site home page Giter Site logo

terraform-module-aws-athena's Introduction

AWS Athena Module

This module provides an easy way to set up Athena queries.

The module can set up Athena database and table from an input S3 bucket and create-table SQL script.

If database and tables are already provisioned (for instance by AWS Glue), the module can be used to define a set of Athena queries.

The module is not responsible for the creation / lifecycle of S3 buckets - it is recommended that these are created using the separate module responsible for creating encrypted private S3 buckets.

Variables

Name Type Default Required Description
create_database string true A boolean that indicates if a new Athena database should be created.
database_name string Name of the existing database. Required if create_database variable is false
bucket_name string Name of the Athena database bucket. Required if create_database is true
database_force_destroy bool false A boolean that indicates all tables should be deleted from the database so that the database can be destroyed without error. The tables are not recoverable.
create_table_sql_path string A path to the file that contains create table sql
queries map A map of Athena query SQLs where key is the query name and the value is the path to the file containing the query
query_output_locations map A map of output locations (S3 URLs) for Athena queries. Keys are query names identical to the map above. If omitted, output locations need to be specified in queries.
query_output_buckets_kms_keys map A map of KMS keys used to encrypt data in Athena queries output S3 buckets. Keys are query names identical to the map above. Results will not be encrypted if the key for a query is not defined in the map.
query_template_parameters map A map of key value pairs used to customise Athena queries. These are typically environment/stage specific. If omitted, only available query template parameters will be db_name and env.
namespace string Namespace used for labeling resources
name string Name of the module / resources
stage string What staga are the resources for? staging, production?
tags map Map of tags to be applied to all resources

Outputs

Name Description
database_name Name of the Athena database
create_table_query_id Id of the create table query
create_table_query_name Name of the create table query
query_ids A map of query names and ids

terraform-module-aws-athena's People

Contributors

ljiljanaholden avatar semantic-release-bot avatar

Stargazers

 avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

terraform-module-aws-athena's Issues

Does not create table

Documentation references create_table_sql_path as an input field for create table, but no such variable exists.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.