glympse/terraform-provider-nifi

Terraform provider for interacting with NiFi cluster

terraform-provider-nifi's Issues

Binary distribution

Would you be able to include binaries of this provider in GitHub releases? This would greatly simplify using the provider (right now it has to be built from source). Some CI/CD maybe be useful here. Thanks!

[feature request] Support for authorization via username/password

When Nifi has authentication enabled, using this plugin will be failed because access token is not passed when calling Nifi APIs. If config can be extended to include username and password, then call POST /access/token to get the access token, then pass the returned token as Authorization header when call Nifi APIs. The token lifetime lasts for 12 hours, token refresh handling may not be needed.

Docs?

Is there documentation on the resources exposed by this provider, other than by trolling through the examples or source code? "Syntax" refers only to how to connect to the provider.

Add comments attribute to process resources

These are particularly useful in the process and process_group resources.

Multiple process groups

I have multiple process groups around 26 of them, and I am not able to terraform apply them. Got this below errors

2020/01/22 18:33:19 [DEBUG] plugin: waiting for all plugin processes to complete...
26 error(s) occurred:

* nifi_processor.PCR_7GKCGW_EvaluateJsonPathFields: 1 error(s) occurred:

* nifi_processor.PCR_7GKCGW_EvaluateJsonPathFields: Failed to create Processor
  revision.#:                  "" => "<computed>"�[0m
�[0m�[1mnifi_process_group.PGP_AZ9EFC_Gateway: Creating...�[0m
  component.#:                 "0" => "1"
  component.0.name:            "" => "PGP_AZ9EFC_Gateway"
* nifi_process_group.PGP_JM77XQ_Fet: 1 error(s) occurred:

* nifi_process_group.PGP_JM77XQ_Fet: Failed to create Process Group
* nifi_process_group.PGP_KH3GUL_Other: 1 error(s) occurred:

  component.0.parent_group_id: "" => "1afc5761-016f-1000-9240-7bd5ebc04dfd"
  component.0.position.#:      "0" => "1"
  component.0.position.0.x:    "" => "1656"
  component.0.position.0.y:    "" => "1648"
  parent_group_id:             "" => "<computed>"
* nifi_process_group.PGP_KH3GUL_Other: Failed to create Process Group
2020/01/22 18:33:19 [DEBUG] plugin: terraform-provider-nifi: 2020/01/22 18:33:19 [ERR] plugin: plugin server: accept unix /tmp/plugin790107470: use of closed network connection
* nifi_process_group.PGP_S7PYXR_Ocm: 1 error(s) occurred:

* nifi_process_group.PGP_S7PYXR_Ocm: Failed to create Process Group
  revision.#:                  "" => "<computed>"�[0m
�[0m�[1mnifi_process_group.PGP_ACCAVN_Rating: Creating...�[0m
* nifi_process_group.PGP_U1EHWC_Syslog: 1 error(s) occurred:

* nifi_process_group.PGP_U1EHWC_Syslog: Failed to create Process Group
* nifi_process_group.PGP_Y0A0U7_Owl: 1 error(s) occurred:

  component.#:                 "0" => "1"
  component.0.name:            "" => "PGP_ACCAVN_Rating"
* nifi_process_group.PGP_Y0A0U7_Owl: Failed to create Process Group
* nifi_process_group.PGP_ERQEBM_Ui-alerts: 1 error(s) occurred:
....

Not supporting multiple process groups

Hello team,
I have created a component which will read the nifi template xml and dynamically generate the terraform script. It is working as expected when I create a one process group and deploy the components under that process group. I have multiple flows(and multiple template xmls) in nifi and when I created a separate flow from a separate template file and tried to deploy that using terraform, it identifies the similar elements in previously deployed flow and treats as a delta. In other words it deletes the elements in the first flow which are present in the first process group and deploys the new flow with the new components. Similar components in the second flow are treated as a delta.
Is this provider able to support only one flow. Or are we expected to generate the terraform script using flow.xml(which will contain the complete flow details) and always do a delete insert of the complete system. Please confirm. Thanking you in anticipation

Who can I reach out to to get the latest build of Glympse for Dynamics 365?

Cannot build with fresh Go/Glide install

I'm trying to build the development snapshot of the provider in a system with a fresh install of Go and Glide but it doesn't go well.

Given:
go version go1.9.2 linux/amd64
glide version 0.13.1

Trying to run the build.sh script results in this output:

[WARN] The name listed in the config file (github.com/glympse/terraform-provider-nifi) does not match the current location (.)
[INFO] Downloading dependencies. Please wait...
[INFO] --> Fetching github.com/hashicorp/terraform
[INFO] --> Fetching github.com/stretchr/testify
[INFO] --> Setting version for github.com/hashicorp/terraform to v0.9.0.
[INFO] --> Setting version for github.com/stretchr/testify to v1.1.4.
[INFO] Resolving imports
[INFO] --> Fetching bytes
[WARN] Unable to checkout bytes
[INFO] --> Fetching crypto/tls
[WARN] Unable to checkout crypto/tls
[INFO] --> Fetching encoding/json
[WARN] Unable to checkout encoding/json
[INFO] --> Fetching fmt
[WARN] Unable to checkout fmt
[INFO] --> Fetching io
[WARN] Unable to checkout io
[INFO] --> Fetching log
[WARN] Unable to checkout log
[INFO] --> Fetching net/http
[WARN] Unable to checkout net/http
[INFO] --> Fetching sync
[WARN] Unable to checkout sync
[INFO] --> Fetching time
[WARN] Unable to checkout time
[INFO] --> Fetching github.com/hashicorp/go-plugin
[INFO] --> Fetching net/rpc
[WARN] Unable to checkout net/rpc
[WARN] Unable to set version on bytes to . Err: Cannot detect VCS
[INFO] --> Fetching context
[WARN] Unable to checkout context
[INFO] --> Fetching errors
[WARN] Unable to checkout errors
[WARN] Unable to set version on fmt to . Err: Cannot detect VCS
[INFO] --> Fetching github.com/hashicorp/go-multierror
[INFO] --> Fetching github.com/mitchellh/copystructure
[INFO] --> Fetching github.com/mitchellh/mapstructure
[WARN] Unable to set version on log to . Err: Cannot detect VCS
[INFO] --> Fetching os
[WARN] Unable to checkout os
[INFO] --> Fetching reflect
[WARN] Unable to checkout reflect
[INFO] --> Fetching sort
[WARN] Unable to checkout sort
[INFO] --> Fetching strconv
[WARN] Unable to checkout strconv
[INFO] --> Fetching strings
[WARN] Unable to checkout strings
[WARN] Unable to set version on sync to . Err: Cannot detect VCS
[INFO] --> Fetching testing
[WARN] Unable to checkout testing
[WARN] Unable to set version on time to . Err: Cannot detect VCS
[INFO] --> Fetching archive/tar
[WARN] Unable to checkout archive/tar
[INFO] --> Fetching bufio
[WARN] Unable to checkout bufio
[INFO] --> Fetching compress/gzip
[WARN] Unable to checkout compress/gzip
[WARN] Unable to set version on context to . Err: Cannot detect VCS
[INFO] --> Fetching crypto/md5
[WARN] Unable to checkout crypto/md5
[INFO] --> Fetching encoding/gob
[WARN] Unable to checkout encoding/gob
[INFO] --> Fetching encoding/hex
[WARN] Unable to checkout encoding/hex
[WARN] Unable to set version on encoding/json to . Err: Cannot detect VCS
[WARN] Unable to set version on errors to . Err: Cannot detect VCS
[INFO] --> Fetching github.com/hashicorp/errwrap
[INFO] --> Fetching github.com/hashicorp/go-version
[INFO] --> Fetching github.com/hashicorp/hcl
[INFO] --> Fetching github.com/hashicorp/hil
[INFO] --> Fetching github.com/mitchellh/reflectwalk
[INFO] --> Fetching github.com/satori/go.uuid
[WARN] Unable to set version on io to . Err: Cannot detect VCS
[WARN] Unable to set version on io to . Err: Cannot detect VCS
[WARN] Unable to set version on os to . Err: Cannot detect VCS
[INFO] --> Fetching path/filepath
[WARN] Unable to checkout path/filepath
[WARN] Unable to set version on reflect to . Err: Cannot detect VCS
[INFO] --> Fetching regexp
[WARN] Unable to checkout regexp
[INFO] --> Fetching runtime/debug
[WARN] Unable to checkout runtime/debug
[WARN] Unable to set version on sort to . Err: Cannot detect VCS
[WARN] Unable to set version on strconv to . Err: Cannot detect VCS
[WARN] Unable to set version on strings to . Err: Cannot detect VCS
[WARN] Unable to set version on sync to . Err: Cannot detect VCS
[WARN] Unable to set version on testing to . Err: Cannot detect VCS
[ERROR] Error scanning bytes: cannot find package "." in:
/root/.glide/cache/src/https-bytes
[WARN] Unable to set version on crypto/tls to . Err: Cannot detect VCS
[ERROR] Error scanning encoding/json: cannot find package "." in:
/root/.glide/cache/src/https-encoding-json
[ERROR] Error scanning fmt: cannot find package "." in:
/root/.glide/cache/src/https-fmt
[ERROR] Error scanning io: cannot find package "." in:
/root/.glide/cache/src/https-io
[ERROR] Error scanning log: cannot find package "." in:
/root/.glide/cache/src/https-log
[WARN] Unable to set version on net/http to . Err: Cannot detect VCS
[ERROR] Error scanning sync: cannot find package "." in:
/root/.glide/cache/src/https-sync
[ERROR] Error scanning time: cannot find package "." in:
/root/.glide/cache/src/https-time
[WARN] Unable to set version on bufio to . Err: Cannot detect VCS
[INFO] --> Fetching crypto/subtle
[WARN] Unable to checkout crypto/subtle
[INFO] --> Fetching encoding/base64
[WARN] Unable to checkout encoding/base64
[INFO] --> Fetching encoding/binary
[WARN] Unable to checkout encoding/binary
[INFO] --> Fetching github.com/golang/protobuf
[INFO] --> Fetching github.com/hashicorp/go-hclog
[INFO] --> Fetching github.com/hashicorp/yamux
[INFO] --> Fetching github.com/mitchellh/go-testing-interface
[INFO] --> Fetching github.com/oklog/run
[INFO] --> Fetching golang.org/x/net
[INFO] --> Fetching google.golang.org/grpc
[INFO] --> Fetching hash
[WARN] Unable to checkout hash
[INFO] --> Fetching math
[WARN] Unable to checkout math
[INFO] --> Fetching net
[WARN] Unable to checkout net
[WARN] Unable to set version on net to . Err: Cannot detect VCS
[WARN] Unable to set version on os to . Err: Cannot detect VCS
[WARN] Unable to set version on os to . Err: Cannot detect VCS
[WARN] Unable to set version on path/filepath to . Err: Cannot detect VCS
[INFO] --> Fetching runtime
[WARN] Unable to checkout runtime
[INFO] --> Fetching syscall
[WARN] Unable to checkout syscall
[INFO] --> Fetching unicode
[WARN] Unable to checkout unicode
[WARN] Unable to set version on crypto/md5 to . Err: Cannot detect VCS
[INFO] --> Fetching crypto/sha1
[WARN] Unable to checkout crypto/sha1
[INFO] --> Fetching crypto/sha256
[WARN] Unable to checkout crypto/sha256
[WARN] Unable to set version on encoding/base64 to . Err: Cannot detect VCS
[WARN] Unable to set version on encoding/gob to . Err: Cannot detect VCS
[WARN] Unable to set version on encoding/hex to . Err: Cannot detect VCS
[INFO] --> Fetching github.com/apparentlymart/go-cidr
[INFO] --> Fetching github.com/hashicorp/go-uuid
[INFO] --> Fetching github.com/mitchellh/go-homedir
[INFO] --> Fetching github.com/mitchellh/hashstructure
[WARN] Unable to set version on math to . Err: Cannot detect VCS
[WARN] Unable to set version on net to . Err: Cannot detect VCS
[WARN] Unable to set version on regexp to . Err: Cannot detect VCS
[WARN] Unable to set version on hash to . Err: Cannot detect VCS
[ERROR] Error scanning context: cannot find package "." in:
/root/.glide/cache/src/https-context
[ERROR] Error scanning errors: cannot find package "." in:
/root/.glide/cache/src/https-errors
[WARN] Unable to set version on unicode to . Err: Cannot detect VCS
[WARN] Unable to set version on unicode to . Err: Cannot detect VCS
[INFO] --> Fetching github.com/hashicorp/go-getter
[WARN] Unable to set version on syscall to . Err: Cannot detect VCS
[INFO] --> Fetching flag
[WARN] Unable to checkout flag
[INFO] --> Fetching container/list
[WARN] Unable to checkout container/list
[INFO] --> Fetching crypto/rand
[WARN] Unable to checkout crypto/rand
[WARN] Unable to set version on crypto/sha1 to . Err: Cannot detect VCS
[INFO] --> Fetching database/sql/driver
[WARN] Unable to checkout database/sql/driver
[WARN] Unable to set version on encoding/binary to . Err: Cannot detect VCS
[WARN] Unable to set version on hash to . Err: Cannot detect VCS
[ERROR] Error scanning io/ioutil: cannot find package "." in:
/root/.glide/cache/src/https-io-ioutil
[ERROR] Error scanning os: cannot find package "." in:
/root/.glide/cache/src/https-os
[ERROR] Error scanning reflect: cannot find package "." in:
/root/.glide/cache/src/https-reflect
[ERROR] Error scanning sort: cannot find package "." in:
/root/.glide/cache/src/https-sort
[ERROR] Error scanning strconv: cannot find package "." in:
/root/.glide/cache/src/https-strconv
[ERROR] Error scanning strings: cannot find package "." in:
/root/.glide/cache/src/https-strings
[ERROR] Error scanning sync/atomic: cannot find package "." in:
/root/.glide/cache/src/https-sync-atomic
[ERROR] Error scanning testing: cannot find package "." in:
/root/.glide/cache/src/https-testing
[ERROR] Error scanning crypto/tls: cannot find package "." in:
/root/.glide/cache/src/https-crypto-tls
[ERROR] Error scanning net/http: cannot find package "." in:
/root/.glide/cache/src/https-net-http
[ERROR] Error scanning bufio: cannot find package "." in:
/root/.glide/cache/src/https-bufio
[INFO] --> Fetching encoding
[WARN] Unable to checkout encoding
[INFO] --> Fetching unsafe
[WARN] Unable to checkout unsafe
[WARN] Unable to set version on encoding to . Err: Cannot detect VCS
[WARN] Unable to set version on runtime to . Err: Cannot detect VCS
[WARN] Unable to set version on compress/gzip to . Err: Cannot detect VCS
[WARN] Unable to set version on math to . Err: Cannot detect VCS
[WARN] Unable to set version on net to . Err: Cannot detect VCS
[WARN] Unable to set version on net to . Err: Cannot detect VCS
[INFO] --> Fetching crypto/x509
[WARN] Unable to checkout crypto/x509
[ERROR] Error scanning net/rpc: cannot find package "." in:
/root/.glide/cache/src/https-net-rpc
[ERROR] Error scanning os/exec: cannot find package "." in:
/root/.glide/cache/src/https-os-exec
[ERROR] Error scanning os/signal: cannot find package "." in:
/root/.glide/cache/src/https-os-signal
[ERROR] Error scanning path/filepath: cannot find package "." in:
/root/.glide/cache/src/https-path-filepath
[ERROR] Error scanning crypto/md5: cannot find package "." in:
/root/.glide/cache/src/https-crypto-md5
[ERROR] Error scanning encoding/base64: cannot find package "." in:
/root/.glide/cache/src/https-encoding-base64
[ERROR] Error scanning encoding/gob: cannot find package "." in:
/root/.glide/cache/src/https-encoding-gob
[ERROR] Error scanning encoding/hex: cannot find package "." in:
/root/.glide/cache/src/https-encoding-hex
[WARN] Unable to set version on math to . Err: Cannot detect VCS
[WARN] Unable to set version on crypto/rand to . Err: Cannot detect VCS
[WARN] Unable to set version on hash to . Err: Cannot detect VCS
[ERROR] Error scanning math: cannot find package "." in:
/root/.glide/cache/src/https-math
[ERROR] Error scanning net: cannot find package "." in:
/root/.glide/cache/src/https-net
[ERROR] Error scanning regexp: cannot find package "." in:
/root/.glide/cache/src/https-regexp
[ERROR] Error scanning hash/crc32: cannot find package "." in:
/root/.glide/cache/src/https-hash-crc32
[ERROR] Error scanning unicode: cannot find package "." in:
/root/.glide/cache/src/https-unicode
[ERROR] Error scanning unicode/utf8: cannot find package "." in:
/root/.glide/cache/src/https-unicode-utf8
[WARN] Unable to set version on archive/tar to . Err: Cannot detect VCS
[INFO] --> Fetching archive/zip
[WARN] Unable to checkout archive/zip
[INFO] --> Fetching compress/bzip2
[WARN] Unable to checkout compress/bzip2
[WARN] Unable to set version on crypto/sha256 to . Err: Cannot detect VCS
[INFO] --> Fetching crypto/sha512
[WARN] Unable to checkout crypto/sha512
[WARN] Unable to set version on encoding to . Err: Cannot detect VCS
[INFO] --> Fetching github.com/aws/aws-sdk-go
[INFO] --> Fetching github.com/bgentry/go-netrc
[INFO] --> Fetching github.com/hashicorp/go-cleanhttp
[INFO] --> Fetching github.com/ulikunitz/xz
[ERROR] Error scanning syscall: cannot find package "." in:
/root/.glide/cache/src/https-syscall
[ERROR] Error scanning crypto/sha1: cannot find package "." in:
/root/.glide/cache/src/https-crypto-sha1
[ERROR] Error scanning encoding/binary: cannot find package "." in:
/root/.glide/cache/src/https-encoding-binary
[ERROR] Error scanning hash: cannot find package "." in:
/root/.glide/cache/src/https-hash
[ERROR] Error scanning encoding: cannot find package "." in:
/root/.glide/cache/src/https-encoding
[ERROR] Error scanning runtime: cannot find package "." in:
/root/.glide/cache/src/https-runtime
[ERROR] Error scanning compress/gzip: cannot find package "." in:
/root/.glide/cache/src/https-compress-gzip
[WARN] Unable to set version on net/http to . Err: Cannot detect VCS
[WARN] Unable to set version on net to . Err: Cannot detect VCS
[INFO] --> Fetching html/template
[WARN] Unable to checkout html/template
[INFO] --> Fetching text/tabwriter
[WARN] Unable to checkout text/tabwriter
[INFO] --> Fetching google.golang.org/genproto
[ERROR] Error scanning math/rand: cannot find package "." in:
/root/.glide/cache/src/https-math-rand
[ERROR] Error scanning net/http/httputil: cannot find package "." in:
/root/.glide/cache/src/https-net-http-httputil
[ERROR] Error scanning net/url: cannot find package "." in:
/root/.glide/cache/src/https-net-url
[ERROR] Error scanning math/big: cannot find package "." in:
/root/.glide/cache/src/https-math-big
[ERROR] Error scanning crypto/rand: cannot find package "." in:
/root/.glide/cache/src/https-crypto-rand
[ERROR] Error scanning hash/fnv: cannot find package "." in:
/root/.glide/cache/src/https-hash-fnv
[ERROR] Error scanning archive/tar: cannot find package "." in:
/root/.glide/cache/src/https-archive-tar
[ERROR] Error scanning crypto/sha256: cannot find package "." in:
/root/.glide/cache/src/https-crypto-sha256
[ERROR] Error scanning encoding/xml: cannot find package "." in:
/root/.glide/cache/src/https-encoding-xml
[INFO] --> Fetching github.com/go-ini/ini
[INFO] --> Fetching path
[WARN] Unable to checkout path
[WARN] Unable to set version on path to . Err: Cannot detect VCS
[WARN] Unable to set version on crypto/x509 to . Err: Cannot detect VCS
[WARN] Unable to set version on hash to . Err: Cannot detect VCS
[INFO] --> Fetching golang.org/x/text
[ERROR] Error scanning net/http/httptrace: cannot find package "." in:
/root/.glide/cache/src/https-net-http-httptrace
[ERROR] Error scanning net/textproto: cannot find package "." in:
/root/.glide/cache/src/https-net-textproto
[INFO] --> Fetching text/template
[WARN] Unable to checkout text/template
[ERROR] Error scanning path: cannot find package "." in:
/root/.glide/cache/src/https-path
[ERROR] Error scanning crypto/x509: cannot find package "." in:
/root/.glide/cache/src/https-crypto-x509
[INFO] --> Fetching github.com/jmespath/go-jmespath
[INFO] --> Fetching crypto/hmac
[WARN] Unable to checkout crypto/hmac
[ERROR] Error scanning hash/crc64: cannot find package "." in:
/root/.glide/cache/src/https-hash-crc64
[WARN] Unable to set version on container/list to . Err: Cannot detect VCS
[ERROR] Error scanning container/list: cannot find package "." in:
/root/.glide/cache/src/https-container-list
[ERROR] Failed to retrieve a list of dependencies: Error resolving imports
The command '/bin/sh -c GOPATH=/usr/lib/go ./build.sh' returned a non-zero code: 1

I'm not very familiar with Go, so is there something I'm missing?

[bug] Internal validation of the provider failed!

I am trying to run the example under terraform-provider-nifi/examples/local_flow and I am getting the below Error:

$ terraform apply
var.nifi_host
  NiFi instance where the flow should be created

  Enter a value: localhost:8080/nifi

var.nifi_root_process_group_id
  ID of process group where flow resources should be created

  Enter a value: root


Error: nifi_connection.generate_to_merge_1: "component.0.destination.0.group_id": required field is not set



Error: nifi_connection.generate_to_merge_1: "component.0.source.0.group_id": required field is not set



Error: nifi_connection.merge_1_to_merge_2: "component.0.destination.0.group_id": required field is not set



Error: nifi_connection.merge_1_to_merge_2: "component.0.source.0.group_id": required field is not set



Error: nifi_connection.merge_2_to_merge_2: "component.0.destination.0.group_id": required field is not set



Error: nifi_connection.merge_2_to_merge_2: "component.0.source.0.group_id": required field is not set



Error: provider.nifi: Internal validation of the provider failed! This is always a bug
with the provider itself, and not a user issue. Please report
this bug:

1 error(s) occurred:

* resource nifi_remote_process_group: transportProtocol: Field name may only contain lowercase alphanumeric characters & underscores.

Steps to Reproduce

Run the example in the path terraform-provider-nifi/examples/local_flow

I am on Mac OS 10.11.6 and using Terraform v0.11.3 and go1.9.4 darwin/amd64.