Error: conflict at mount destination /var/lib/mysql: duplicate mount destination

[containers]

Error: conflict at mount destination /var/lib/mysql: duplicate mount destination

[DocLM]

Hi @remyd1 I had the same issue with podman on Fedora 30. I found out that the issue was caused by podman 1.3.1-1 (update reached stable repository yesterday) after downgrading to 1.2.0-2.git3bd528e.fc30 it worked fine. Hope that can help you.

[muayyad-alsadi]

would you please elaborate more on how you run it and how you shutdown it and how you removed your db and how you relaunch it.

full commands and full output is appreciated

[remyd1]

Hi @muayyad-alsadi ,

In fact, it worked at the first time. Now it does not work anymore. So, reproducing is not easy; I am still working on the same project wicopa, on the develop branch.

09:14 $ podman ps
CONTAINER ID  IMAGE  COMMAND  CREATED  STATUS  PORTS  NAMES
✔ ~/wicopa [develop|✔] 
09:14 $ podman images
REPOSITORY         TAG   IMAGE ID       CREATED         SIZE
k8s.gcr.io/pause   3.1   da86e6ba6ca1   17 months ago   747 kB
✔ ~/wicopa [develop|✔] 
09:20 $ podman volume ls
✔ ~/wicopa [develop|✔] 
09:14 $ which podman-compose 
alias podman-compose='python ~/podman-compose/podman-compose.py'
	/usr/bin/python
✔ ~/wicopa [develop|✔] 
09:14 $ podman-compose build
podman build -t wicopa_web -f .docker/web/Dockerfile .docker/web
STEP 1: FROM alpine:3.9
Getting image source signatures
Copying blob e7c96db7181b done
Copying config 055936d392 done
Writing manifest to image destination
Storing signatures
STEP 2: LABEL Author remyd1 - https://github.com/remyd1
--> f774e3f280535ea37343f79bdb7687a02a1a5ea56fa09042fad4e4c973264800
STEP 3: RUN apk --update add php-apache2 php7-session php7-mysqli git && rm -f /var/cache/apk/*
fetch http://dl-cdn.alpinelinux.org/alpine/v3.9/main/x86_64/APKINDEX.tar.gz
fetch http://dl-cdn.alpinelinux.org/alpine/v3.9/community/x86_64/APKINDEX.tar.gz
(1/23) Installing ca-certificates (20190108-r0)
(2/23) Installing nghttp2-libs (1.35.1-r0)
(3/23) Installing libssh2 (1.8.2-r0)
(4/23) Installing libcurl (7.64.0-r1)
(5/23) Installing expat (2.2.6-r0)
(6/23) Installing pcre2 (10.32-r1)
(7/23) Installing git (2.20.1-r0)
(8/23) Installing php7-common (7.2.18-r0)
(9/23) Installing libuuid (2.33-r0)
(10/23) Installing apr (1.6.5-r0)
(11/23) Installing apr-util (1.6.1-r5)
(12/23) Installing pcre (8.42-r1)
(13/23) Installing apache2 (2.4.39-r0)
Executing apache2-2.4.39-r0.pre-install
(14/23) Installing ncurses-terminfo-base (6.1_p20190105-r0)
(15/23) Installing ncurses-terminfo (6.1_p20190105-r0)
(16/23) Installing ncurses-libs (6.1_p20190105-r0)
(17/23) Installing libedit (20181209.3.1-r0)
(18/23) Installing libxml2 (2.9.9-r1)
(19/23) Installing php7-apache2 (7.2.18-r0)
(20/23) Installing php7-openssl (7.2.18-r0)
(21/23) Installing php7-mysqlnd (7.2.18-r0)
(22/23) Installing php7-mysqli (7.2.18-r0)
(23/23) Installing php7-session (7.2.18-r0)
Executing busybox-1.29.3-r10.trigger
Executing ca-certificates-20190108-r0.trigger
OK: 38 MiB in 37 packages
--> 01a4c7d1a51b54f211812d4ebace024e709ab4b46be908c3deb0ce9b92f5c16e
STEP 4: RUN mkdir /app && cd /app &&   git clone https://gitlab.mbb.univ-montp2.fr/jlopez/wicopa.git
Cloning into 'wicopa'...
remote: Enumerating objects: 55, done.        
remote: Counting objects: 100% (55/55), done.        
remote: Compressing objects: 100% (50/50), done.        
remote: Total 422 (delta 17), reused 0 (delta 0)        
Receiving objects: 100% (422/422), 630.64 KiB | 17.52 MiB/s, done.
Resolving deltas: 100% (225/225), done.
--> fc9831dbe006204d3b986f17db088dd10fec52746baf888ba2a9d269bddfb688
STEP 5: WORKDIR /app/wicopa
--> c35d760ab01972586d1be0a73c60c23a0d248e7985d1766ba04984f735c017d8
STEP 6: RUN git checkout develop &&   cp inc/conf/Conf.php.sample inc/conf/Conf.php &&   chown -R apache:apache /app &&   sed -i "s#DB_NAME       = ''#DB_NAME       = 'wicopa'#"      inc/conf/Conf.php &&   sed -i "s#DB_HOSTNAME   = ''#DB_HOSTNAME   = 'wicopadb'#"    inc/conf/Conf.php &&   sed -i "s#DB_USERNAME   = ''#DB_USERNAME   = 'wicopauser'#"  inc/conf/Conf.php &&   sed -i "s#DB_PP         = ''#DB_PP         = 'w1c0Pa5s'#"    inc/conf/Conf.php &&   sed -i "s#'to_replace_with_your_admin_pass'#'450cb0c92db35549cb926efc391df2ceae4b48d1'#" inc/conf/Conf.php
Branch 'develop' set up to track remote branch 'develop' from 'origin'.
Switched to a new branch 'develop'
--> bc5744014fbc69a573a4963d48a7a151207a7ecfb3cfca55857d80b6b624bc5b
STEP 7: RUN sed -i 's/^#ServerName .*/ServerName localhost:80/g' /etc/apache2/httpd.conf &&   sed -i 's#/var/www/localhost/htdocs#/app/wicopa#g' /etc/apache2/httpd.conf &&   sed -i 's/^LoadModule php7_module.*/LoadModule php7_module modules\/libphp7\.so/g' /etc/apache2/httpd.conf &&   sed -i 's/DirectoryIndex index\.html/DirectoryIndex index\.php/g' /etc/apache2/httpd.conf &&   sed -ri 's#^DocumentRoot .*#DocumentRoot "/app/wicopa"#g' /etc/apache2/httpd.conf &&   sed -i 's#AllowOverride None#AllowOverride All#g' /etc/apache2/httpd.conf &&   echo "AddType application/x-httpd-php .php" >> /etc/apache2/httpd.conf
--> 544f31cbaaa7a0900ae204b67e2c65980595dee529f507d5225b77d8c68ed85d
STEP 8: RUN echo "Success"
Success
--> 84bd9a9d50c9d17fa578b37c2d31c13f5c99cd80fae94529881510d7be508d91
STEP 9: EXPOSE 80
--> 6a6d9db75851eb9842cc16b3495e59ed273b2de06daa12538f94e448a91c8f57
STEP 10: ENTRYPOINT httpd -D FOREGROUND && /bin/bash
STEP 11: COMMIT wicopa_web
--> f859ffc588d4bb33a0104b501b03b7d48aa1f9c59633ce8482501c27522774c0
0
✔ ~/wicopa [develop|✔] 
09:15 $ podman-compose up
podman stop -t=1 wicopadb
Error: no container with name or ID wicopadb found: no such container
125
podman stop -t=1 wicopaweb
Error: no container with name or ID wicopaweb found: no such container
125
podman rm wicopadb
Error: no container with name or ID wicopadb found: no such container
1
podman rm wicopaweb
Error: no container with name or ID wicopaweb found: no such container
1
podman pod rm wicopa
Error: no pod with name or ID wicopa found: no such pod
125
podman pod create --name=wicopa --share net -p 8000:80
d3119d13a30717a65088baba48275c05d84e09fc109f7c35fe9b75f4310e8e91
0
podman run --name=wicopadb -d --pod=wicopa -l io.podman.compose.config-hash=123 -l io.podman.compose.project=wicopa -l io.podman.compose.version=0.0.1 -l com.docker.compose.container-number=1 -l com.docker.compose.service=db -e MYSQL_ROOT_PASSWORD=w1c0Pa5s -e MYSQL_PASSWORD=w1c0Pa5s -e MYSQL_USER=wicopauser -e MYSQL_DATABASE=wicopa -v /home/foo/wicopa/.docker/db/wicopa:/var/lib/mysql:z -v /home/foo/wicopa/wicopa.sql:/docker-entrypoint-initdb.d/wicopa.sql:z --add-host web:127.0.0.1 --add-host wicopaweb:127.0.0.1 --add-host db:127.0.0.1 --add-host wicopadb:127.0.0.1 --expose 3306 mariadb:10.3
Trying to pull docker.io/library/mariadb:10.3...Getting image source signatures
Copying blob ab62701212b1 done
Copying blob 3bdaf925d088 done
Copying blob 05731e63f211 done
Copying blob 0bd67c50d6be done
Copying blob 6abc03819f3e done
Copying blob b1f6f41348ef done
Copying blob 10ba8f10417b done
Copying blob 3806bed5c691 done
Copying blob 24aae6d0fc18 done
Copying blob 9104943e23ec done
Copying blob ae510462589d done
Copying blob ec23646ae61e done
Copying blob 3c301b916a4e done
Copying config e07bb20373 done
Writing manifest to image destination
Storing signatures
Error: conflict at mount destination /var/lib/mysql: duplicate mount destination
125
podman run --name=wicopaweb -d --pod=wicopa -l io.podman.compose.config-hash=123 -l io.podman.compose.project=wicopa -l io.podman.compose.version=0.0.1 -l com.docker.compose.container-number=1 -l com.docker.compose.service=web --add-host web:127.0.0.1 --add-host wicopaweb:127.0.0.1 --add-host db:127.0.0.1 --add-host wicopadb:127.0.0.1 wicopa_web
49b0d033802a9af0ad82ca096abdbf8b6f0ee85e425cb308d96d99b7799b53bc
0
✔ ~/wicopa [develop|✔] 
09:16 $ podman-compose down
podman stop -t=1 wicopadb
Error: no container with name or ID wicopadb found: no such container
125
podman stop -t=1 wicopaweb
49b0d033802a9af0ad82ca096abdbf8b6f0ee85e425cb308d96d99b7799b53bc
0
podman rm wicopadb
Error: no container with name or ID wicopadb found: no such container
1
podman rm wicopaweb
49b0d033802a9af0ad82ca096abdbf8b6f0ee85e425cb308d96d99b7799b53bc
0
podman pod rm wicopa
d3119d13a30717a65088baba48275c05d84e09fc109f7c35fe9b75f4310e8e91
0

Same problem if I remove the database content after putting the pods in down state:

✔ ~/wicopa [develop|✔] 
09:16 $ sudo rm -rf .docker/db/wicopa/{mysql,performance_schema,wicopa,tc.log,multi-master.info,ib*,aria_log_control,aria_log.00000001}

I have the same error if I also remove the containers and the images.

I do not know if there is any cache in podman or if any overlay is duplicated...

Here are some other outputs for debugs; the db container is not launched:

✔ ~/wicopa [develop|✔] 
09:36 $ lsns |grep -Ev "firefox|systemd" |sed -e "s/$USER/foo/g"
        NS TYPE   NPROCS   PID USER       COMMAND
4026532896 user       13 11138 foo /usr/bin/fuse-overlayfs -o lowerdir=/home/foo/.local/share/containers/storage/overlay/l/DH6XP7BBMOZI2B4IPH7ZPU4BGC,upperdir=/home/foo/.local/share/containers/storage/overlay/07017e47abcf186731c0ff2340a629fd846e9b79073fbbd306eb9bac6f9cab31/diff,workdir=/home/foo/.local/share/containers/storage/overlay/07017e47abcf186731c0ff2340a629fd846e9b79073fbbd306eb9bac6f9cab31/work,context="system_u:object_r:container_file_t:s0:c752,c780" /home/foo/.local/share/containers/storage/overlay/07017e47abcf186731c0ff2340a629fd846e9b79073fbbd306eb9bac6f9cab31/merged
4026532897 mnt         5 11138 foo /usr/bin/fuse-overlayfs -o lowerdir=/home/foo/.local/share/containers/storage/overlay/l/DH6XP7BBMOZI2B4IPH7ZPU4BGC,upperdir=/home/foo/.local/share/containers/storage/overlay/07017e47abcf186731c0ff2340a629fd846e9b79073fbbd306eb9bac6f9cab31/diff,workdir=/home/foo/.local/share/containers/storage/overlay/07017e47abcf186731c0ff2340a629fd846e9b79073fbbd306eb9bac6f9cab31/work,context="system_u:object_r:container_file_t:s0:c752,c780" /home/foo/.local/share/containers/storage/overlay/07017e47abcf186731c0ff2340a629fd846e9b79073fbbd306eb9bac6f9cab31/merged
4026532898 mnt         1 11154 foo /pause
4026532899 uts         1 11154 foo /pause
4026532900 ipc         1 11154 foo /pause
4026532901 pid         1 11154 foo /pause
4026532903 net         8 11154 foo /pause
4026533044 mnt         7 11186 foo /bin/sh -c httpd -D FOREGROUND && /bin/bash
4026533045 uts         7 11186 foo /bin/sh -c httpd -D FOREGROUND && /bin/bash
4026533046 ipc         7 11186 foo /bin/sh -c httpd -D FOREGROUND && /bin/bash
4026533047 pid         7 11186 foo /bin/sh -c httpd -D FOREGROUND && /bin/bash
✔ ~/wicopa [develop|✔] 
09:36 $ podman ps
CONTAINER ID  IMAGE                        COMMAND               CREATED             STATUS                 PORTS                 NAMES
02aea9cd3a10  localhost/wicopa_web:latest  /bin/sh -c httpd ...  About a minute ago  Up About a minute ago  0.0.0.0:8000->80/tcp  wicopaweb
✔ ~/wicopa [develop|✔] 
09:36 $ podman ps -a
CONTAINER ID  IMAGE                        COMMAND               CREATED             STATUS                 PORTS                 NAMES
02aea9cd3a10  localhost/wicopa_web:latest  /bin/sh -c httpd ...  About a minute ago  Up About a minute ago  0.0.0.0:8000->80/tcp  wicopaweb
fe9436475c7d  k8s.gcr.io/pause:3.1                               About a minute ago  Up About a minute ago  0.0.0.0:8000->80/tcp  05873aae89ff-infra

Best regards,

[remyd1]

Hi @DocLM

Indeed, i moved to fedora 30 recently, and did not think it would be related to this bug.

Thanks for the info ! I will downgrade podman.