Giter Site home page Giter Site logo

komminarlabs / terraform-aws-glue-job Goto Github PK

View Code? Open in Web Editor NEW
2.0 1.0 2.0 16 KB

Terraform module to create and manage a AWS Glue job

Home Page: https://registry.terraform.io/modules/komminarlabs/glue-job/aws/latest

License: Apache License 2.0

HCL 100.00%
aws glue-job terraform-module

terraform-aws-glue-job's Introduction

terraform-aws-glue-job

Terraform module to create and manage a AWS Glue job

Requirements

Name Version
terraform >= 0.13.0
aws >= 3.10

Providers

Name Version
aws >= 3.10

Inputs

Name Description Type Default Required
name The name of the Glue job string n/a yes
script_location The S3 path to the script that is executed by the job string n/a yes
tags A mapping of tags to assign to all resources map(string) n/a yes
command_name The name of the job command. Defaults to glueetl string "glueetl" no
connections A list with connections for this job list(string) [] no
default_arguments A map with default arguments for the job map(string) {} no
glue_version The Glue version to use string "2.0" no
max_capacity The maximum number of data processing units that can be allocated number null no
max_retries The maximum number of times to retry the failing job number 0 no
number_of_workers The number of workers that are allocated when the job runs string null no
python_version The Python version (2 or 3) being used to execute a Python shell job string "3" no
role_arn An optional Glue execution role string null no
role_policy A valid Glue IAM policy JSON document string null no
schedule A cron expression used to specify the schedule for the glue trigger string null no
schedule_active Whether the glue trigger should be active bool true no
trigger_type The type ('ON_DEMAND' or 'SCHEDULED') of the trigger string null no
worker_type The type ('Standard' or 'G.1X' or 'G.2X') of predefined worker that is allocated when the job runs string null no

Outputs

Name Description
arn The Glue job ARN
id The Glue job name
trigger_arn The Glue trigger ARN
trigger_id The Glue trigger name

Requirements

Name Version
terraform >= 1.3
aws >= 4.62.0

Providers

Name Version
aws >= 4.62.0

Modules

No modules.

Resources

Name Type
aws_cloudwatch_log_group.default resource
aws_glue_job.default resource
aws_glue_trigger.default resource
aws_iam_role.default resource
aws_iam_role_policy.default resource
aws_iam_role_policy_attachment.default resource
aws_iam_policy_document.default data source

Inputs

Name Description Type Default Required
name The name of the Glue job string n/a yes
script_location The S3 path to the script that is executed by the job string n/a yes
tags A mapping of tags to assign to all resources map(string) n/a yes
command_name The name of the job command. Defaults to glueetl string "glueetl" no
connections A list with connections for this job list(string) [] no
default_arguments A map with default arguments for the job map(string) {} no
glue_version The Glue version to use string "4.0" no
kms_key_id The kms key id of the AWS KMS Customer Managed Key to be used to encrypt the log data string null no
log_retention_days The cloudwatch log group retention in days number 365 no
max_capacity The maximum number of data processing units that can be allocated number null no
max_retries The maximum number of times to retry the failing job number 0 no
number_of_workers The number of workers that are allocated when the job runs string null no
python_version The Python version (2 or 3) being used to execute a Python shell job string "3" no
role_arn An optional Glue execution role string null no
role_policy A valid Glue IAM policy JSON document string null no
schedule A cron expression used to specify the schedule for the glue trigger string null no
schedule_active Whether the glue trigger should be active bool true no
security_configuration The name of the Security Configuration to be associated with the job string null no
trigger_type The type ('ON_DEMAND' or 'SCHEDULED') of the trigger string null no
worker_type The type ('Standard' or 'G.1X' or 'G.2X') of predefined worker that is allocated when the job runs string null no

Outputs

Name Description
arn The Glue job ARN
id The Glue job name
trigger_arn The Glue trigger ARN
trigger_id The Glue trigger name

terraform-aws-glue-job's People

Contributors

thulasirajkomminar avatar github-actions[bot] avatar

Stargazers

Walter Jhameson Xavier Pereira avatar Bryan Stober avatar

Watchers

 avatar

Forkers

dg0026

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.