docker-compose up failed

[mirantis]

docker-compose up failed

[nhlfr]

That usually means that libvirtd is running on host. We will try to isolate containerized libvirt from the one on host, but currently the only option is to stop libvirtd on host.

[pskrzyns]

@nhlfr What about bolt part ? cause i saw that bolt support was merged but I can still see endpoint=http://etcd:2379. Did you apdated composer ?

[pskrzyns]

After removing libvirt and qemu form host:

(.env) root@gklab-97a-173:~/virtlet/src/github.com/Mirantis/virtlet/contrib/docker-compose# docker-compose up
Starting dockercompose_etcd_1
dockercompose_libvirt_1 is up-to-date
dockercompose_virtlet_1 is up-to-date
Attaching to dockercompose_libvirt_1, dockercompose_etcd_1, dockercompose_virtlet_1
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:20:38.220116       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:20:39.803341       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:20:40.385590       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:20:41.124494       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:20:42.326060       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:20:44.332849       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:20:47.890940       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:20:54.663555       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:21:07.862834       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:21:33.815041       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:22:25.447281       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:24:39.087554       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:24:39.794822       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:24:40.456695       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:24:41.235895       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:24:42.459052       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:24:44.502479       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:30:58.471555       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:30:58.962706       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:30:59.555060       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:31:00.418260       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:31:01.557410       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:31:03.524648       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:31:07.124174       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:33:52.135353       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:33:53.599444       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:33:54.171983       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:33:55.015487       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:33:56.240488       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:39:33.160250       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:39:35.640918       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:39:36.141088       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:39:36.945434       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:39:38.050715       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:39:40.004678       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:39:43.560264       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:39:50.312428       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:40:03.459829       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:40:29.445444       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
etcd_1     | 2016-09-29 13:40:31.796988 I | etcdmain: etcd Version: 3.0.10
etcd_1     | 2016-09-29 13:40:31.797248 I | etcdmain: Git SHA: 546c0f7
etcd_1     | 2016-09-29 13:40:31.797253 I | etcdmain: Go Version: go1.6.3
etcd_1     | 2016-09-29 13:40:31.797258 I | etcdmain: Go OS/Arch: linux/amd64
etcd_1     | 2016-09-29 13:40:31.797263 I | etcdmain: setting maximum number of CPUs to 48, total number of available CPUs is 48
etcd_1     | 2016-09-29 13:40:31.797268 W | etcdmain: no data-dir provided, using default data-dir ./etcd0.etcd
etcd_1     | 2016-09-29 13:40:31.797482 N | etcdmain: the server is already initialized as member before, starting as etcd member...
etcd_1     | 2016-09-29 13:40:31.797864 I | etcdmain: listening for peers on http://0.0.0.0:2380
etcd_1     | 2016-09-29 13:40:31.797899 I | etcdmain: listening for client requests on 0.0.0.0:2379
etcd_1     | 2016-09-29 13:40:31.797923 I | etcdmain: listening for client requests on 0.0.0.0:4001
etcd_1     | 2016-09-29 13:40:31.805391 I | etcdserver: name = etcd0
etcd_1     | 2016-09-29 13:40:31.805403 I | etcdserver: data dir = etcd0.etcd
etcd_1     | 2016-09-29 13:40:31.805422 I | etcdserver: member dir = etcd0.etcd/member
etcd_1     | 2016-09-29 13:40:31.805427 I | etcdserver: heartbeat = 100ms
etcd_1     | 2016-09-29 13:40:31.805431 I | etcdserver: election = 1000ms
etcd_1     | 2016-09-29 13:40:31.805435 I | etcdserver: snapshot count = 10000
etcd_1     | 2016-09-29 13:40:31.805444 I | etcdserver: advertise client URLs = http://0.0.0.0:2379,http://0.0.0.0:4001
etcd_1     | 2016-09-29 13:40:31.807263 I | etcdserver: restarting member 2006f2ad47deea09 in cluster 77c597fe24ed2ce3 at commit index 484
etcd_1     | 2016-09-29 13:40:31.807345 I | raft: 2006f2ad47deea09 became follower at term 5
etcd_1     | 2016-09-29 13:40:31.807360 I | raft: newRaft 2006f2ad47deea09 [peers: [], term: 5, commit: 484, applied: 0, lastindex: 484, lastterm: 5]
etcd_1     | 2016-09-29 13:40:31.812206 I | etcdserver: starting server... [version: 3.0.10, cluster version: to_be_decided]
etcd_1     | 2016-09-29 13:40:31.816893 I | membership: added member 2006f2ad47deea09 [http://0.0.0.0:2380] to cluster 77c597fe24ed2ce3
etcd_1     | 2016-09-29 13:40:31.817047 N | membership: set the initial cluster version to 3.0
etcd_1     | 2016-09-29 13:40:31.817087 I | api: enabled capabilities for version 3.0
etcd_1     | 2016-09-29 13:40:32.507729 I | raft: 2006f2ad47deea09 is starting a new election at term 5
etcd_1     | 2016-09-29 13:40:32.507774 I | raft: 2006f2ad47deea09 became candidate at term 6
etcd_1     | 2016-09-29 13:40:32.507787 I | raft: 2006f2ad47deea09 received vote from 2006f2ad47deea09 at term 6
etcd_1     | 2016-09-29 13:40:32.507817 I | raft: 2006f2ad47deea09 became leader at term 6
etcd_1     | 2016-09-29 13:40:32.507834 I | raft: raft.node: 2006f2ad47deea09 elected leader 2006f2ad47deea09 at term 6
etcd_1     | 2016-09-29 13:40:32.509130 I | etcdserver: published {Name:etcd0 ClientURLs:[http://0.0.0.0:2379 http://0.0.0.0:4001]} to cluster 77c597fe24ed2ce3
etcd_1     | 2016-09-29 13:40:32.509171 I | etcdmain: ready to serve client requests
etcd_1     | 2016-09-29 13:40:32.509270 I | etcdmain: ready to serve client requests
etcd_1     | 2016-09-29 13:40:32.510625 N | etcdmain: serving insecure client requests on 0.0.0.0:4001, this is strongly discouraged!
etcd_1     | 2016-09-29 13:40:32.510725 N | etcdmain: serving insecure client requests on 0.0.0.0:2379, this is strongly discouraged!
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:41:21.016338       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
libvirt_1  | /usr/sbin/libvirtd: error while loading shared libraries: libvirt-admin.so.0: cannot open shared object file: Permission denied
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0929 13:43:03.811629       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}

docker ps
CONTAINER ID        IMAGE                       COMMAND                  CREATED             STATUS                              PORTS               NAMES
4d450e21689c        dockercompose_virtlet       "/usr/local/bin/virtl"   24 minutes ago      Restarting (1) About a minute ago                       dockercompose_virtlet_1
209516901ac3        dockercompose_libvirt       "/start.sh"              24 minutes ago      Restarting (127) 2 minutes ago                          dockercompose_libvirt_1
594d0dd5c604        quay.io/coreos/etcd         "/usr/local/bin/etcd "   24 minutes ago      Up 4 minutes                        2379-2380/tcp       dockercompose_etcd_1
~# netstat -ntpl
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      1428/sshd       
tcp6       0      0 :::22                   :::*                    LISTEN      1428/sshd 

[jellonek]

As for endpoint - look on 2a63385 it will be reused by calico networking.

[jellonek]

libvirt-admin.so.0 looks like selinux or apparmor problem - are they disabled on host?

[pskrzyns]

Ok, i reinstaled ubuntu on the node, where I'm trying run virtlet, disabled apparmor.
Only addtitional packages are virtualenv and docker.
Still virtlet is failing

Step 15 : CMD /usr/local/bin/virtlet -logtostderr=true -libvirt-uri=qemu+tcp://libvirt/system -etcd-endpoint=http://etcd:2379
 ---> Running in 8b03cfb28b8c
 ---> 554df03a7da4
Removing intermediate container 8b03cfb28b8c
Successfully built 554df03a7da4
WARNING: Image for service virtlet was built because it did not already exist. To rebuild this image you must use `docker-compose build` or `docker-compose up --build`.
Creating dockercompose_libvirt_1
Creating dockercompose_etcd_1
Creating dockercompose_virtlet_1
Attaching to dockercompose_etcd_1, dockercompose_libvirt_1, dockercompose_virtlet_1
etcd_1     | 2016-09-30 17:56:04.160233 I | etcdmain: etcd Version: 3.0.10
etcd_1     | 2016-09-30 17:56:04.160334 I | etcdmain: Git SHA: 546c0f7
etcd_1     | 2016-09-30 17:56:04.160351 I | etcdmain: Go Version: go1.6.3
etcd_1     | 2016-09-30 17:56:04.160356 I | etcdmain: Go OS/Arch: linux/amd64
etcd_1     | 2016-09-30 17:56:04.160361 I | etcdmain: setting maximum number of CPUs to 48, total number of available CPUs is 48
libvirt_1  | 2016-09-30 17:56:04.210+0000: 25870: info : libvirt version: 1.3.1, package: 1ubuntu10.2 (Ryan Harper <[email protected]> Thu, 30 Jun 2016 10:09:45 -0500)
etcd_1     | 2016-09-30 17:56:04.160367 W | etcdmain: no data-dir provided, using default data-dir ./etcd0.etcd
libvirt_1  | 2016-09-30 17:56:04.210+0000: 25870: info : hostname: 24fd8d7d1dc3
etcd_1     | 2016-09-30 17:56:04.160476 I | etcdmain: listening for peers on http://0.0.0.0:2380
etcd_1     | 2016-09-30 17:56:04.160517 I | etcdmain: listening for client requests on 0.0.0.0:2379
etcd_1     | 2016-09-30 17:56:04.160541 I | etcdmain: listening for client requests on 0.0.0.0:4001
etcd_1     | 2016-09-30 17:56:04.161945 I | etcdserver: name = etcd0
etcd_1     | 2016-09-30 17:56:04.161968 I | etcdserver: data dir = etcd0.etcd
libvirt_1  | 2016-09-30 17:56:04.210+0000: 25870: warning : virLogParseOutputs:1206 : Ignoring invalid log output setting.
etcd_1     | 2016-09-30 17:56:04.161974 I | etcdserver: member dir = etcd0.etcd/member
etcd_1     | 2016-09-30 17:56:04.161979 I | etcdserver: heartbeat = 100ms
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
etcd_1     | 2016-09-30 17:56:04.161983 I | etcdserver: election = 1000ms
virtlet_1  | E0930 17:56:04.514240       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
etcd_1     | 2016-09-30 17:56:04.161987 I | etcdserver: snapshot count = 10000
etcd_1     | 2016-09-30 17:56:04.161996 I | etcdserver: advertise client URLs = http://0.0.0.0:2379,http://0.0.0.0:4001
etcd_1     | 2016-09-30 17:56:04.162004 I | etcdserver: initial advertise peer URLs = http://0.0.0.0:2380
etcd_1     | 2016-09-30 17:56:04.162028 I | etcdserver: initial cluster = etcd0=http://0.0.0.0:2380
etcd_1     | 2016-09-30 17:56:04.163803 I | etcdserver: starting member 2006f2ad47deea09 in cluster 77c597fe24ed2ce3
etcd_1     | 2016-09-30 17:56:04.163854 I | raft: 2006f2ad47deea09 became follower at term 0
etcd_1     | 2016-09-30 17:56:04.163870 I | raft: newRaft 2006f2ad47deea09 [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]
etcd_1     | 2016-09-30 17:56:04.163878 I | raft: 2006f2ad47deea09 became follower at term 1
etcd_1     | 2016-09-30 17:56:04.166881 I | etcdserver: starting server... [version: 3.0.10, cluster version: to_be_decided]
etcd_1     | 2016-09-30 17:56:04.167497 I | membership: added member 2006f2ad47deea09 [http://0.0.0.0:2380] to cluster 77c597fe24ed2ce3
dockercompose_virtlet_1 exited with code 0
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0930 17:56:04.514240       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0930 17:56:04.918399       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
etcd_1     | 2016-09-30 17:56:05.164192 I | raft: 2006f2ad47deea09 is starting a new election at term 1
etcd_1     | 2016-09-30 17:56:05.164248 I | raft: 2006f2ad47deea09 became candidate at term 2
etcd_1     | 2016-09-30 17:56:05.164257 I | raft: 2006f2ad47deea09 received vote from 2006f2ad47deea09 at term 2
etcd_1     | 2016-09-30 17:56:05.164274 I | raft: 2006f2ad47deea09 became leader at term 2
etcd_1     | 2016-09-30 17:56:05.164283 I | raft: raft.node: 2006f2ad47deea09 elected leader 2006f2ad47deea09 at term 2
etcd_1     | 2016-09-30 17:56:05.164743 I | etcdserver: published {Name:etcd0 ClientURLs:[http://0.0.0.0:2379 http://0.0.0.0:4001]} to cluster 77c597fe24ed2ce3
etcd_1     | 2016-09-30 17:56:05.164759 I | etcdmain: ready to serve client requests
etcd_1     | 2016-09-30 17:56:05.164844 I | etcdmain: ready to serve client requests
etcd_1     | 2016-09-30 17:56:05.164955 I | etcdserver: setting up the initial cluster version to 3.0
etcd_1     | 2016-09-30 17:56:05.165068 N | membership: set the initial cluster version to 3.0
etcd_1     | 2016-09-30 17:56:05.165112 I | api: enabled capabilities for version 3.0
etcd_1     | 2016-09-30 17:56:05.167470 N | etcdmain: serving insecure client requests on 0.0.0.0:4001, this is strongly discouraged!
etcd_1     | 2016-09-30 17:56:05.167567 N | etcdmain: serving insecure client requests on 0.0.0.0:2379, this is strongly discouraged!
dockercompose_virtlet_1 exited with code 0
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0930 17:56:04.514240       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0930 17:56:04.918399       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0930 17:56:05.480088       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
dockercompose_virtlet_1 exited with code 0
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0930 17:56:04.514240       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0930 17:56:04.918399       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0930 17:56:05.480088       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0930 17:56:06.255541       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
dockercompose_virtlet_1 exited with code 0
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0930 17:56:04.514240       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0930 17:56:04.918399       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0930 17:56:05.480088       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0930 17:56:06.255541       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0930 17:56:07.395372       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
dockercompose_virtlet_1 exited with code 0
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0930 17:56:04.514240       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0930 17:56:04.918399       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0930 17:56:05.480088       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0930 17:56:06.255541       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0930 17:56:07.395372       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
virtlet_1  | libvirt: XML-RPC error : unable to connect to server at 'libvirt:16509': Connection refused
virtlet_1  | E0930 17:56:09.363078       1 virtlet.go:45] Initializing server failed: &errors.errorString{s:"unable to connect to server at 'libvirt:16509': Connection refused"}
libvirt_1  | libvirt: Storage Driver error : Storage pool not found: no storage pool with matching name 'default'
libvirt_1  | Traceback (most recent call last):
libvirt_1  |   File "/cleanup.py", line 77, in <module>
libvirt_1  |     main()
libvirt_1  | Cleaning up VMs
libvirt_1  | All VMs cleaned
libvirt_1  |   File "/cleanup.py", line 60, in main
libvirt_1  |     pool = conn.storagePoolLookupByName("default")
libvirt_1  |   File "/usr/lib/python2.7/dist-packages/libvirt.py", line 4575, in storagePoolLookupByName
libvirt_1  |     if ret is None:raise libvirtError('virStoragePoolLookupByName() failed', conn=self)
libvirt_1  | libvirt.libvirtError: Storage pool not found: no storage pool with matching name 'default'
dockercompose_libvirt_1 exited with code 0
libvirt_1  | 2016-09-30 17:56:04.210+0000: 25870: info : libvirt version: 1.3.1, package: 1ubuntu10.2 (Ryan Harper <[email protected]> Thu, 30 Jun 2016 10:09:45 -0500)
libvirt_1  | 2016-09-30 17:56:04.210+0000: 25870: info : hostname: 24fd8d7d1dc3
libvirt_1  | 2016-09-30 17:56:04.210+0000: 25870: warning : virLogParseOutputs:1206 : Ignoring invalid log output setting.
libvirt_1  | Cleaning up VMs
libvirt_1  | All VMs cleaned
libvirt_1  | libvirt: Storage Driver error : Storage pool not found: no storage pool with matching name 'default'
libvirt_1  | Traceback (most recent call last):
libvirt_1  |   File "/cleanup.py", line 77, in <module>
libvirt_1  |     main()
libvirt_1  |   File "/cleanup.py", line 60, in main
libvirt_1  |     pool = conn.storagePoolLookupByName("default")
libvirt_1  |   File "/usr/lib/python2.7/dist-packages/libvirt.py", line 4575, in storagePoolLookupByName
libvirt_1  |     if ret is None:raise libvirtError('virStoragePoolLookupByName() failed', conn=self)
libvirt_1  | libvirt.libvirtError: Storage pool not found: no storage pool with matching name 'default'
libvirt_1  | 2016-09-30 17:56:10.802+0000: 26720: info : libvirt version: 1.3.1, package: 1ubuntu10.2 (Ryan Harper <[email protected]> Thu, 30 Jun 2016 10:09:45 -0500)
libvirt_1  | 2016-09-30 17:56:10.802+0000: 26720: info : hostname: 24fd8d7d1dc3
libvirt_1  | 2016-09-30 17:56:10.802+0000: 26720: warning : virLogParseOutputs:1206 : Ignoring invalid log output setting.
dockercompose_virtlet_1 exited with code 0

[jellonek]

Closing as doublet for #51