avinor/tau

Tau is a thin wrapper on top of terraform to manage multiple deployments, dependencies and secrets.

tau's Issues

Fmt recreated deleted files

Running fmt will create a file that is tagged as DELETE_

Support Windows

go-cmd library does not support Windows

Add flag to forward arguments to terraform

Add a flag that can forward arguments to terraform.

Migration option

Create some migration option for modules

Add possibility to manage lifecycle

Add a block to manage lifecycle of module. For instance to ignore destroy of certain resources etc

Hook support script in addition to command

Support script attribute that can be any script available with go-getter

Support for feature attribute for provider section

For azurerm provider feature attriubute must be set. Tau has no support for this.

Panic for tau init with terraform dependecy after version 0.12.10

From version 0.12.11 tau init panics for hashicorp registry modules with:

$tau init -f mymodule.hcl

- Loading module from terraform registry avinor/storage-account/azurerm, version 2.2.0
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x18 pc=0xdf2a67]

goroutine 19 [running]:
github.com/hashicorp/terraform-svchost/disco.(*userAgentRoundTripper).RoundTrip(0xc0007be040, 0xc0000b7f00, 0xc0007be040, 0xbfee610ba99090b9, 0x388c626b8)
       /home/xxxxx/go/pkg/mod/github.com/hashicorp/[email protected]/disco/http_transport.go:29 +0x67
net/http.send(0xc0000b6100, 0x12242a0, 0xc0007be040, 0xbfee610ba99090b9, 0x388c626b8, 0x17f2ae0, 0xc0004d4030, 0xbfee610ba99090b9, 0x1, 0x0)
       /usr/local/go/src/net/http/client.go:252 +0x453
net/http.(*Client).send(0xc0007b00f0, 0xc0000b6100, 0xbfee610ba99090b9, 0x388c626b8, 0x17f2ae0, 0xc0004d4030, 0x0, 0x1, 0x5)
       /usr/local/go/src/net/http/client.go:176 +0xff
net/http.(*Client).do(0xc0007b00f0, 0xc0000b6100, 0x0, 0x0, 0x0)
       /usr/local/go/src/net/http/client.go:718 +0x45f
net/http.(*Client).Do(...)
       /usr/local/go/src/net/http/client.go:586

Rewrite parsedfile / config.NewFile to work on strings

Using local source creates symlink and not copying files to temporary dir

When using a local source for module it will create a symlink to the folder in temporary directory instead of copying the files. This is a problem with go-getter not supporting copying files.

See hashicorp/go-getter#169

Find a way to handle deletion

Need a way for CI pipeline to handle deletion of resources. Either by prefixing files with "DESTROY" / "DELETE" and running destroy instead of apply, or handle that a file does not exist anymore

Implement hooks

Added the config.Hook model, but not implemented functionallity yet. Idea is to be able to define hooks for different events, like Prepare, Finish, etc, and optionally a set_env that will read output as KEY=VALUE and set environment variables when running terraform.

Support merging map input variables

If merging attributes that already exist it will fail. If it is a map it should try to just merge maps

Detailed exit code

Possibility to get detailed exit code; for instance for plan is there any changes or not

Terraform 0.13 Support - Version Inconsistency

Overview

The documentation states terraform a required terraform version >=0.13 but the implementation is bound to 0.12.

Expectation

The minimum required version requirement is consistent.

References

README.md

1. Tau requires terraform 0.13+

Version Check

tau/pkg/terraform/engine.go

Line 43 in f003d3c

case semver.Compare(version, "0.12") >= 0:

Rewrite how it uses temp directory

Now it creates a temp folder that is generated based on source that should be deployed. This leads to some unwanted side effects. It works fine as long as same resources are deployed every time. Like for local folder:

tau init
tau plan

However if in local folder there is a file called hub.hcl and only that should be deployed again, then running tau plan -f hub.hcl afterwards generates a new temp folder and halting because temp folder is not initialized.

Should instead change so temp folder name is based on source file. Then it will use same temp folder every time and would work in both scenarios.

Run dependency resolving in separate shell processes

If including a dependency that has different environment variables it will now use the env variables from source that included it. Need to run dependencies in separate environments with their own variables.

Create example code

Use example folder in modules to create example config for a module

Implement import

Implement import command wrapper

Add validate command

Validate configuration variables

Reuse code in commands

Too much duplicate code in commands. Reuse it better and make one command per terraform command, not a passthrough like now. Makes it easier to do minor customisations per command.

Allow to read input for terraform

go-cmd that is used for executing shell commands do not support reading input from commands. Need to look into how this can be done

Add tf plugin cache

Add cache for tf plugins

Only purge current file

When using -f argument it purges all folder. Only purge the one its running

Support including other merge targets

Supports _auto files today, also support including files manually from other folders.
Need to add additional variable name to source to tell which folder source is in

Fail if module does not exist

If terraform registry module is not found it does not fail anymore

Backends: Support AWS

Question

Most of the examples are focussing on Azure as the cloud service provider. Nevertheless tau seems to be generic.

I am wondering how I could integrate an AWS backend to store the terraform state?

References

• https://github.com/avinor/tau/blob/master/docs/single_backend.md

Hook script download git file not working

Referencing a single git file in hoot.script does not work, it will not download the file. Have to use raw http link. See hashicorp/go-getter#98

Write hook tests

Prettier output

Make output prettier and more understandable. Group output from one module together and maybe reduce the output or use other libraries to prettify