ansible-playbook fails

[ibm]

ansible-playbook fails

[przem123]

Tried to continue with the next steps but the operator-sdk command is missing:

[root@worker01 ibm-spectrum-scale-csi-operator]# export OPERATOR_DIR="$IBM_DIR/ibm-spectrum-scale-csi-operator"
[root@worker01 ibm-spectrum-scale-csi-operator]# cd ${OPERATOR_DIR}/stable/ibm-spectrum-scale-csi-operator-bundle/operators/ibm-spectrum-scale-csi-operator
[root@worker01 ibm-spectrum-scale-csi-operator]# export GO111MODULE="on"
[root@worker01 ibm-spectrum-scale-csi-operator]# operator-sdk build csi-scale-operator
-bash: operator-sdk: command not found

[przem123]

I made some progress.
Could install the operator sdk from
https://github.com/operator-framework/operator-sdk/blob/master/doc/user/install-operator-sdk.md

You need to mention in the readme how to install the operator sdk.

Then I faced another issue

root@worker01 ibm-spectrum-scale-csi-operator]# operator-sdk build csi-scale-operator
Error: failed to build operator binary: (failed to exec []string{"go", "build", "-o", "/root/go/src/github.com/IBM/ibm-spectrum-scale-csi-operator/stable/ibm-spectrum-scale-csi-operator-bundle/operators/ibm-spectrum-scale-csi-operator/build/_output/bin/ibm-spectrum-scale-csi-operator", "-gcflags", "all=-trimpath=/root/go/src/github.com/IBM/ibm-spectrum-scale-csi-operator/stable/ibm-spectrum-scale-csi-operator-bundle/operators", "-asmflags", "all=-trimpath=/root/go/src/github.com/IBM/ibm-spectrum-scale-csi-operator/stable/ibm-spectrum-scale-csi-operator-bundle/operators", "github.com/IBM/ibm-spectrum-scale-csi-operator/stable/ibm-spectrum-scale-csi-operator-bundle/operators/ibm-spectrum-scale-csi-operator/cmd/manager"}: exec: "go": executable file not found in $PATH)
Usage:

Again, you dont mention that I need to install and set up go. I used the latest version from golang.org

[przem123]

I can see now missing docker. I have only podman in my openshift environment 4.2. Can you enable podman as well?

[root@worker01 ibm-spectrum-scale-csi-operator]# operator-sdk build csi-scale-operator
go: downloading github.com/operator-framework/operator-sdk v0.10.0
go: downloading sigs.k8s.io/controller-runtime v0.1.10
go: downloading k8s.io/client-go v0.0.0-20181213151034-8d9ed539ba31
go: downloading k8s.io/apimachinery v0.0.0-20181127025237-2b1284ed4c93
go: extracting sigs.k8s.io/controller-runtime v0.1.10
go: extracting k8s.io/client-go v0.0.0-20181213151034-8d9ed539ba31
go: extracting k8s.io/apimachinery v0.0.0-20181127025237-2b1284ed4c93
go: downloading github.com/gogo/protobuf v1.3.0
go: downloading k8s.io/api v0.0.0-20181213150558-05914d821849
go: extracting github.com/operator-framework/operator-sdk v0.10.0
go: downloading github.com/go-logr/zapr v0.1.1
go: downloading github.com/go-logr/logr v0.1.0
go: downloading github.com/spf13/pflag v1.0.3
go: downloading github.com/pkg/errors v0.8.1
go: downloading golang.org/x/oauth2 v0.0.0-20190402181905-9f3314589c9a
go: downloading k8s.io/kube-state-metrics v1.6.0
go: downloading go.uber.org/zap v1.9.1
go: extracting github.com/go-logr/zapr v0.1.1
go: extracting github.com/go-logr/logr v0.1.0
go: downloading gopkg.in/yaml.v2 v2.2.2
go: extracting github.com/pkg/errors v0.8.1
go: downloading github.com/prometheus/client_golang v0.9.3-0.20190127221311-3c4408c8b829
go: extracting github.com/spf13/pflag v1.0.3
go: extracting golang.org/x/oauth2 v0.0.0-20190402181905-9f3314589c9a
go: extracting k8s.io/api v0.0.0-20181213150558-05914d821849
go: extracting go.uber.org/zap v1.9.1
go: extracting gopkg.in/yaml.v2 v2.2.2
go: extracting k8s.io/kube-state-metrics v1.6.0
go: downloading go.uber.org/multierr v1.1.0
go: downloading github.com/coreos/prometheus-operator v0.29.0
go: extracting github.com/prometheus/client_golang v0.9.3-0.20190127221311-3c4408c8b829
go: downloading github.com/Azure/go-autorest v11.7.0+incompatible
go: extracting go.uber.org/multierr v1.1.0
go: downloading github.com/gophercloud/gophercloud v0.0.0-20190408160324-6c7ac67f8855
go: downloading github.com/prometheus/client_model v0.0.0-20190129233127-fd36f4220a90
go: downloading github.com/golang/protobuf v1.3.1
go: downloading github.com/appscode/jsonpatch v0.0.0-20190108182946-7c0e3b262f30
go: downloading github.com/prometheus/common v0.2.0
go: extracting github.com/gogo/protobuf v1.3.0
go: extracting github.com/Azure/go-autorest v11.7.0+incompatible
go: downloading github.com/beorn7/perks v0.0.0-20180321164747-3a771d992973
go: downloading golang.org/x/crypto v0.0.0-20190404164418-38d8ce5564a5
go: downloading golang.org/x/net v0.0.0-20190404232315-eb5bcb51f2a3
go: extracting github.com/prometheus/client_model v0.0.0-20190129233127-fd36f4220a90
go: downloading k8s.io/klog v0.3.1
go: extracting github.com/prometheus/common v0.2.0
go: extracting github.com/appscode/jsonpatch v0.0.0-20190108182946-7c0e3b262f30
go: downloading k8s.io/kubernetes v1.11.8-beta.0.0.20190124204751-3a10094374f2
go: downloading github.com/prometheus/procfs v0.0.0-20190403104016-ea9eea638872
go: extracting github.com/golang/protobuf v1.3.1
go: extracting github.com/beorn7/perks v0.0.0-20180321164747-3a771d992973
go: downloading gopkg.in/inf.v0 v0.9.1
go: extracting github.com/coreos/prometheus-operator v0.29.0
go: extracting github.com/gophercloud/gophercloud v0.0.0-20190408160324-6c7ac67f8855
go: extracting golang.org/x/net v0.0.0-20190404232315-eb5bcb51f2a3
go: extracting k8s.io/klog v0.3.1
go: downloading go.uber.org/atomic v1.3.2
go: extracting gopkg.in/inf.v0 v0.9.1
go: downloading go.opencensus.io v0.20.0
go: downloading github.com/dgrijalva/jwt-go v3.2.0+incompatible
go: extracting github.com/prometheus/procfs v0.0.0-20190403104016-ea9eea638872
go: extracting go.uber.org/atomic v1.3.2
go: downloading contrib.go.opencensus.io/exporter/ocagent v0.4.11
go: extracting github.com/dgrijalva/jwt-go v3.2.0+incompatible
go: downloading golang.org/x/time v0.0.0-20190921001708-c4c64cad1fd0
go: extracting golang.org/x/crypto v0.0.0-20190404164418-38d8ce5564a5
go: downloading github.com/imdario/mergo v0.3.7
go: extracting contrib.go.opencensus.io/exporter/ocagent v0.4.11
go: extracting golang.org/x/time v0.0.0-20190921001708-c4c64cad1fd0
go: downloading github.com/matttproud/golang_protobuf_extensions v1.0.1
go: extracting github.com/imdario/mergo v0.3.7
go: downloading github.com/gregjones/httpcache v0.0.0-20181110185634-c63ab54fda8f
go: downloading github.com/sirupsen/logrus v1.4.1
go: extracting go.opencensus.io v0.20.0
go: extracting github.com/gregjones/httpcache v0.0.0-20181110185634-c63ab54fda8f
go: downloading github.com/census-instrumentation/opencensus-proto v0.2.0
go: extracting github.com/matttproud/golang_protobuf_extensions v1.0.1
go: downloading github.com/davecgh/go-spew v1.1.1
go: extracting github.com/sirupsen/logrus v1.4.1
go: downloading github.com/googleapis/gnostic v0.2.0
go: downloading github.com/mxk/go-flowrate v0.0.0-20140419014527-cca7078d478f
go: downloading github.com/hashicorp/golang-lru v0.5.1
go: extracting github.com/davecgh/go-spew v1.1.1
go: downloading google.golang.org/grpc v1.19.1
go: downloading github.com/go-openapi/spec v0.19.0
go: downloading sigs.k8s.io/yaml v1.1.0
go: extracting github.com/mxk/go-flowrate v0.0.0-20140419014527-cca7078d478f
go: extracting github.com/census-instrumentation/opencensus-proto v0.2.0
go: extracting github.com/hashicorp/golang-lru v0.5.1
go: downloading google.golang.org/api v0.3.0
go: downloading github.com/grpc-ecosystem/grpc-gateway v1.8.5
go: downloading github.com/json-iterator/go v1.1.6
go: downloading k8s.io/kube-openapi v0.0.0-20180711000925-0cf8f7e6ed1d
go: extracting sigs.k8s.io/yaml v1.1.0
go: downloading github.com/google/gofuzz v1.0.0
go: extracting github.com/go-openapi/spec v0.19.0
go: extracting github.com/json-iterator/go v1.1.6
go: downloading github.com/peterbourgon/diskv v2.0.1+incompatible
go: downloading github.com/golang/groupcache v0.0.0-20190129154638-5b532d6fd5ef
go: extracting google.golang.org/grpc v1.19.1
go: extracting k8s.io/kube-openapi v0.0.0-20180711000925-0cf8f7e6ed1d
go: extracting github.com/grpc-ecosystem/grpc-gateway v1.8.5
go: downloading github.com/go-openapi/jsonpointer v0.19.0
go: extracting github.com/google/gofuzz v1.0.0
go: extracting github.com/peterbourgon/diskv v2.0.1+incompatible
go: downloading github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd
go: extracting github.com/golang/groupcache v0.0.0-20190129154638-5b532d6fd5ef
go: extracting github.com/go-openapi/jsonpointer v0.19.0
go: extracting github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd
go: downloading golang.org/x/sys v0.0.0-20190405154228-4b34438f7a67
go: downloading github.com/emicklei/go-restful v2.9.3+incompatible
go: downloading golang.org/x/text v0.3.2
go: extracting github.com/googleapis/gnostic v0.2.0
go: downloading github.com/go-openapi/swag v0.19.0
go: downloading github.com/spf13/afero v1.2.2
go: downloading google.golang.org/genproto v0.0.0-20190404172233-64821d5d2107
go: extracting github.com/emicklei/go-restful v2.9.3+incompatible
go: extracting github.com/go-openapi/swag v0.19.0
go: extracting github.com/spf13/afero v1.2.2
go: downloading github.com/google/btree v1.0.0
go: extracting golang.org/x/sys v0.0.0-20190405154228-4b34438f7a67
go: downloading github.com/mailru/easyjson v0.0.0-20190403194419-1ea4449da983
go: extracting github.com/google/btree v1.0.0
go: downloading github.com/modern-go/reflect2 v1.0.1
go: extracting github.com/modern-go/reflect2 v1.0.1
go: extracting github.com/mailru/easyjson v0.0.0-20190403194419-1ea4449da983
go: downloading github.com/go-openapi/jsonreference v0.19.0
go: extracting github.com/go-openapi/jsonreference v0.19.0
go: downloading github.com/PuerkitoBio/purell v1.1.1
go: extracting github.com/PuerkitoBio/purell v1.1.1
go: downloading github.com/PuerkitoBio/urlesc v0.0.0-20170810143723-de5bf2ad4578
go: extracting github.com/PuerkitoBio/urlesc v0.0.0-20170810143723-de5bf2ad4578
go: extracting google.golang.org/genproto v0.0.0-20190404172233-64821d5d2107
go: extracting golang.org/x/text v0.3.2
go: downloading github.com/pborman/uuid v1.2.0
go: downloading cloud.google.com/go v0.37.2
go: extracting github.com/pborman/uuid v1.2.0
go: downloading github.com/google/uuid v1.1.1
go: extracting github.com/google/uuid v1.1.1
go: extracting cloud.google.com/go v0.37.2
go: extracting google.golang.org/api v0.3.0
go: downloading golang.org/x/sync v0.0.0-20190227155943-e225da77a7e6
go: extracting golang.org/x/sync v0.0.0-20190227155943-e225da77a7e6
go: extracting k8s.io/kubernetes v1.11.8-beta.0.0.20190124204751-3a10094374f2
go: finding github.com/operator-framework/operator-sdk v0.10.0
go: finding k8s.io/client-go v0.0.0-20181213151034-8d9ed539ba31
go: finding sigs.k8s.io/controller-runtime v0.1.10
go: finding k8s.io/apimachinery v0.0.0-20181127025237-2b1284ed4c93
go: finding k8s.io/api v0.0.0-20181213150558-05914d821849
go: finding github.com/spf13/pflag v1.0.3
go: finding github.com/go-openapi/spec v0.19.0
go: finding k8s.io/kube-openapi v0.0.0-20180711000925-0cf8f7e6ed1d
go: finding github.com/go-logr/zapr v0.1.1
go: finding github.com/gogo/protobuf v1.3.0
go: finding github.com/go-logr/logr v0.1.0
go: finding go.uber.org/zap v1.9.1
go: finding github.com/prometheus/client_golang v0.9.3-0.20190127221311-3c4408c8b829
go: finding github.com/go-openapi/jsonpointer v0.19.0
go: finding github.com/go-openapi/jsonreference v0.19.0
go: finding github.com/coreos/prometheus-operator v0.29.0
go: finding github.com/google/gofuzz v1.0.0
go: finding github.com/gophercloud/gophercloud v0.0.0-20190408160324-6c7ac67f8855
go: finding github.com/pkg/errors v0.8.1
go: finding k8s.io/klog v0.3.1
go: finding gopkg.in/yaml.v2 v2.2.2
go: finding github.com/go-openapi/swag v0.19.0
go: finding github.com/Azure/go-autorest v11.7.0+incompatible
go: finding golang.org/x/oauth2 v0.0.0-20190402181905-9f3314589c9a
go: finding github.com/golang/protobuf v1.3.1
go: finding golang.org/x/time v0.0.0-20190921001708-c4c64cad1fd0
go: finding github.com/googleapis/gnostic v0.2.0
go: finding github.com/gregjones/httpcache v0.0.0-20181110185634-c63ab54fda8f
go: finding github.com/imdario/mergo v0.3.7
go: finding gopkg.in/inf.v0 v0.9.1
go: finding github.com/golang/groupcache v0.0.0-20190129154638-5b532d6fd5ef
go: finding github.com/peterbourgon/diskv v2.0.1+incompatible
go: finding golang.org/x/crypto v0.0.0-20190404164418-38d8ce5564a5
go: finding github.com/PuerkitoBio/purell v1.1.1
go: finding github.com/spf13/afero v1.2.2
go: finding github.com/mailru/easyjson v0.0.0-20190403194419-1ea4449da983
go: finding golang.org/x/net v0.0.0-20190404232315-eb5bcb51f2a3
go: finding github.com/emicklei/go-restful v2.9.3+incompatible
go: finding github.com/sirupsen/logrus v1.4.1
go: finding go.uber.org/atomic v1.3.2
go: finding cloud.google.com/go v0.37.2
go: finding k8s.io/kube-state-metrics v1.6.0
go: finding go.uber.org/multierr v1.1.0
go: finding github.com/modern-go/reflect2 v1.0.1
go: finding github.com/appscode/jsonpatch v0.0.0-20190108182946-7c0e3b262f30
go: finding sigs.k8s.io/yaml v1.1.0
go: finding github.com/json-iterator/go v1.1.6
go: finding github.com/pborman/uuid v1.2.0
go: finding github.com/hashicorp/golang-lru v0.5.1
go: finding contrib.go.opencensus.io/exporter/ocagent v0.4.11
go: finding github.com/prometheus/client_model v0.0.0-20190129233127-fd36f4220a90
go: finding github.com/beorn7/perks v0.0.0-20180321164747-3a771d992973
go: finding k8s.io/kubernetes v1.11.8-beta.0.0.20190124204751-3a10094374f2
go: finding go.opencensus.io v0.20.0
go: finding github.com/prometheus/common v0.2.0
go: finding github.com/dgrijalva/jwt-go v3.2.0+incompatible
go: finding github.com/davecgh/go-spew v1.1.1
go: finding github.com/mxk/go-flowrate v0.0.0-20140419014527-cca7078d478f
go: finding github.com/PuerkitoBio/urlesc v0.0.0-20170810143723-de5bf2ad4578
go: finding golang.org/x/sys v0.0.0-20190405154228-4b34438f7a67
go: finding github.com/prometheus/procfs v0.0.0-20190403104016-ea9eea638872
go: finding github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd
go: finding golang.org/x/text v0.3.2
go: finding github.com/google/btree v1.0.0
go: finding github.com/google/uuid v1.1.1
go: finding github.com/matttproud/golang_protobuf_extensions v1.0.1
go: finding github.com/census-instrumentation/opencensus-proto v0.2.0
go: finding google.golang.org/api v0.3.0
go: finding google.golang.org/grpc v1.19.1
go: finding google.golang.org/genproto v0.0.0-20190404172233-64821d5d2107
go: finding github.com/grpc-ecosystem/grpc-gateway v1.8.5
go: finding golang.org/x/sync v0.0.0-20190227155943-e225da77a7e6
INFO[0032] Building OCI image csi-scale-operator        
Error: failed to output build image csi-scale-operator: (failed to exec []string{"docker", "build", "-f", "build/Dockerfile", "-t", "csi-scale-operator", "."}: exec: "docker": executable file not found in $PATH)
Usage:
  operator-sdk build <image> [flags]

Flags:
      --go-build-args string      Extra Go build arguments as one string such as "-ldflags -X=main.xyz=abc"
  -h, --help                      help for build
      --image-build-args string   Extra image build arguments as one string such as "--build-arg https_proxy=$https_proxy"
      --image-builder string      Tool to build OCI images. One of: [docker, podman, buildah] (default "docker")

Global Flags:
      --verbose   Enable verbose logging

[przem123]

I will continue with the installation, but please write how to fix the ansible playbook and docker dependency on Openshift 4.

Also, mention in the readme how to install operator-sdk and go.

[przem123]

*Hint: Off course, I can install docker on my worker nodes, but this is not something I would like to do since I have podman there.

[whowutwut]

@przem123 Welcome! and Thank you for opening these issues so we get some real world feedback. Appreciate it very much. If you could, can you edit the above posts and wrap the code block text with three back ticks? ``` That would help format the code block in markdown to improve readability. 👍

Sorry for the delay in response, as we are still in a holiday in the U.S until tomorrow. But let me try and address some of your comments/questions

Also, you should mention in the readme that ansible package needs to be preinstalled. I had to install it manually before with yum install ansible.

Yes, that is required, does providing an ansible playbook imply that ansible needs to be installed? (no sarcasm here) But i guess since you hit it, we may want to explicitly state this.

Regarding operator-sdk and the go dependency... it looks like the playbook failed so tasks were not run to completion. These things were not created successfully. operator-sdk should have been installed with this task: https://github.com/IBM/ibm-spectrum-scale-csi-operator/blob/master/ansible/common/dev-env.yaml#L29 and then go gets installed after it. @mew2057 We may want to improve on the documentation and explicitly say something like

If the playbook doesn't run correctly, do not continue.

So @przem123, let me ask you a question, Are you looking to

1. Deploy the operator/driver, or
2. Develop and make changes and contribute back to the project? (which we of course welcome!)

If the 1st, I am (we are) working on improving the documentation where we describe more of a flow of deployment of the code with the container images pushed to quay.io, end goal (very soon) is to use OLM that pulls these images and NOT ask users to clone/build/deploy manually. Is this more in line with what you are looking for?

[przem123]

Thanks @whowutwut, I adjusted my comments.

Yes, pulling the image directly to podman without building it would be the best solution for me.

As for now I have this issue with the playbook and missing podman support. I would like to try the operator in my Openshift 4.2 environment. So if you could tell me when I could expect the support for this, then I could retry the installation.

[mew2057]

Yeah, @vhu we might want to enhance the documentation for the failure case. I think the failure might be literally that operator-sdk requires docker to run, although I thought that the playbook should install docker for the development environment?

Since we've been working in a fairly limited scope for development environments this might be weakness in the automation for multiple environments.

[smitaraut]

Closing this issue as we have moved to multi-stage builds.