Terraform module to create and manage a AWS Glue job
Name |
Version |
terraform |
>= 0.13.0 |
aws |
>= 3.10 |
Name |
Description |
Type |
Default |
Required |
name |
The name of the Glue job |
string |
n/a |
yes |
script_location |
The S3 path to the script that is executed by the job |
string |
n/a |
yes |
tags |
A mapping of tags to assign to all resources |
map(string) |
n/a |
yes |
command_name |
The name of the job command. Defaults to glueetl |
string |
"glueetl" |
no |
connections |
A list with connections for this job |
list(string) |
[] |
no |
default_arguments |
A map with default arguments for the job |
map(string) |
{} |
no |
glue_version |
The Glue version to use |
string |
"2.0" |
no |
max_capacity |
The maximum number of data processing units that can be allocated |
number |
null |
no |
max_retries |
The maximum number of times to retry the failing job |
number |
0 |
no |
number_of_workers |
The number of workers that are allocated when the job runs |
string |
null |
no |
python_version |
The Python version (2 or 3) being used to execute a Python shell job |
string |
"3" |
no |
role_arn |
An optional Glue execution role |
string |
null |
no |
role_policy |
A valid Glue IAM policy JSON document |
string |
null |
no |
schedule |
A cron expression used to specify the schedule for the glue trigger |
string |
null |
no |
schedule_active |
Whether the glue trigger should be active |
bool |
true |
no |
trigger_type |
The type ('ON_DEMAND' or 'SCHEDULED') of the trigger |
string |
null |
no |
worker_type |
The type ('Standard' or 'G.1X' or 'G.2X') of predefined worker that is allocated when the job runs |
string |
null |
no |
Name |
Description |
arn |
The Glue job ARN |
id |
The Glue job name |
trigger_arn |
The Glue trigger ARN |
trigger_id |
The Glue trigger name |
Name |
Version |
aws |
>= 4.62.0 |
No modules.
Name |
Description |
Type |
Default |
Required |
name |
The name of the Glue job |
string |
n/a |
yes |
script_location |
The S3 path to the script that is executed by the job |
string |
n/a |
yes |
tags |
A mapping of tags to assign to all resources |
map(string) |
n/a |
yes |
command_name |
The name of the job command. Defaults to glueetl |
string |
"glueetl" |
no |
connections |
A list with connections for this job |
list(string) |
[] |
no |
default_arguments |
A map with default arguments for the job |
map(string) |
{} |
no |
glue_version |
The Glue version to use |
string |
"4.0" |
no |
kms_key_id |
The kms key id of the AWS KMS Customer Managed Key to be used to encrypt the log data |
string |
null |
no |
log_retention_days |
The cloudwatch log group retention in days |
number |
365 |
no |
max_capacity |
The maximum number of data processing units that can be allocated |
number |
null |
no |
max_retries |
The maximum number of times to retry the failing job |
number |
0 |
no |
number_of_workers |
The number of workers that are allocated when the job runs |
string |
null |
no |
python_version |
The Python version (2 or 3) being used to execute a Python shell job |
string |
"3" |
no |
role_arn |
An optional Glue execution role |
string |
null |
no |
role_policy |
A valid Glue IAM policy JSON document |
string |
null |
no |
schedule |
A cron expression used to specify the schedule for the glue trigger |
string |
null |
no |
schedule_active |
Whether the glue trigger should be active |
bool |
true |
no |
security_configuration |
The name of the Security Configuration to be associated with the job |
string |
null |
no |
trigger_type |
The type ('ON_DEMAND' or 'SCHEDULED') of the trigger |
string |
null |
no |
worker_type |
The type ('Standard' or 'G.1X' or 'G.2X') of predefined worker that is allocated when the job runs |
string |
null |
no |