rhcs-dashboard/ceph-dev

ceph-dev's Issues

restart-dashboard.sh can be simplified

https://github.com/rhcs-dashboard/ceph-dev/blob/master/docker/ceph/restart-dashboard.sh

actually all you need to do is to run ceph mgr fail <pidof mgr>. this will restart the MGR once, instead of twice.

ricardoasmarques/ceph-dev-docker#117

test issue for slack

Ipv6 network error on setting up new ceph dev environment

Issue:

The following network error is generated when docker compose up command is ran:

Attaching to ceph
ceph             | npm ERR! code ERR_SOCKET_TIMEOUT
ceph             | npm ERR! errno ERR_SOCKET_TIMEOUT
ceph             | npm ERR! network request to https://registry.npmjs.org/zwitch/-/zwitch-1.0.5.tgz failed, reason: Socket timeout
ceph             | npm ERR! network This is a problem related to network connectivity.
ceph             | npm ERR! network In most cases you are behind a proxy or have bad network settings.
ceph             | npm ERR! network 
ceph             | npm ERR! network If you are behind a proxy, please make sure that the
ceph             | npm ERR! network 'proxy' config is set properly.  See: 'npm help config'
ceph             | 
ceph             | npm ERR! A complete log of this run can be found in: /root/.npm/_logs/2024-01-10T13_05_46_716Z-debug-0.log

Cause/Reason:

Doing a ping and curl from inside the container tells that its a problem associated with IPv6

[root@ceph ceph]# ping registry.npmjs.org
PING registry.npmjs.org(2606:4700:8393:80e2:e439:411:6810:23 (2606:4700:8393:80e2:e439:411:6810:23)) 56 data bytes

^C
--- registry.npmjs.org ping statistics ---
144 packets transmitted, 0 received, 100% packet loss, time 146459ms

The presence of IPv6 address 2404:6800:4009:825::200e, suggests that the network communication is being attempted over IPv6.

Also, the docker-compose.yaml is enabling use of ipv6:

ceph-dev/docker-compose.yml

Line 178 in 7a72a85

enable_ipv6: true

Possible Resolution:

Configuring the docker to allow containers to use ipv6 addresses:

The official documentaion of docker-compose suggests following while using ipv6 containers:

Before you can use IPv6 in Docker containers, you need to enable IPv6 support in the Docker daemon. Afterward, you can choose to use either IPv4 or IPv6 (or both) with any container or network.

Steps to configure:

1. Edit the Docker daemon configuration file, located at /etc/docker/daemon.json. Configure the following parameters:

{
  "experimental": true,
  "ip6tables": true
}

ip6tables enables additional IPv6 packet filter rules, providing network isolation and port mapping. This parameter requires experimental to be set to true.

Note: you might need to create a new /etc/docker/daemon.json if its not present

2. Save the configuration file.

3. Restart the Docker daemon for your changes to take effect.

sudo systemctl restart docker

docker-compose run --rm ceph /docker/build-dashboard-frontend.sh failure

OS Linux ubuntu 5.15.0-48-generic #54~20.04.1-Ubuntu SMP Thu Sep 1 16:17:26 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
Docker version 20.10.18, build b40c2f6
docker-compose version 1.29.2, build 5becea4c

run: docker-compse up -d
after
run: docker-compose run --rm ceph /docker/build-dashboard-frontend.sh failure
logs:

Creating ceph-dev_ceph_run ... done
npm WARN using --force I sure hope you know what you are doing.
npm WARN prepare removing existing node_modules/ before installation

[email protected] install /ceph/src/pybind/mgr/dashboard/frontend/node_modules/webpack-dev-server/node_modules/fsevents
node install.js

Skipping 'fsevents' build as platform linux is not supported

[email protected] install /ceph/src/pybind/mgr/dashboard/frontend/node_modules/nice-napi
node-gyp-build

[email protected] postinstall /ceph/src/pybind/mgr/dashboard/frontend/node_modules/@angular-devkit/build-angular/node_modules/esbuild
node install.js

[email protected] postinstall /ceph/src/pybind/mgr/dashboard/frontend/node_modules/@angular-devkit/build-angular/node_modules/core-js
node -e "try{require('./postinstall')}catch(e){}"

Thank you for using core-js ( https://github.com/zloirock/core-js ) for polyfilling JavaScript standard library!

The project needs your help! Please consider supporting of core-js:

https://opencollective.com/core-js
https://patreon.com/zloirock
https://paypal.me/zloirock
bitcoin: bc1qlea7544qtsmj2rayg0lthvza9fau63ux0fstcz

Also, the author of core-js ( https://github.com/zloirock ) is looking for a good job -)

[email protected] postinstall /ceph/src/pybind/mgr/dashboard/frontend/node_modules/core-js-pure
node -e "try{require('./postinstall')}catch(e){}"

Thank you for using core-js ( https://github.com/zloirock/core-js ) for polyfilling JavaScript standard library!

The project needs your help! Please consider supporting of core-js:

https://opencollective.com/core-js
https://patreon.com/zloirock
bitcoin: bc1qlea7544qtsmj2rayg0lthvza9fau63ux0fstcz

Also, the author of core-js ( https://github.com/zloirock ) is looking for a good job -)

[email protected] postinstall /ceph/src/pybind/mgr/dashboard/frontend/node_modules/core-js
node -e "try{require('./postinstall')}catch(e){}"

Thank you for using core-js ( https://github.com/zloirock/core-js ) for polyfilling JavaScript standard library!

The project needs your help! Please consider supporting of core-js:

https://opencollective.com/core-js
https://patreon.com/zloirock
bitcoin: bc1qlea7544qtsmj2rayg0lthvza9fau63ux0fstcz

Also, the author of core-js ( https://github.com/zloirock ) is looking for a good job -)

[email protected] postinstall /ceph/src/pybind/mgr/dashboard/frontend/node_modules/protobufjs
node scripts/postinstall

[email protected] postinstall /ceph/src/pybind/mgr/dashboard/frontend/node_modules/gherkin-lint/node_modules/core-js
node -e "try{require('./postinstall')}catch(e){}"

Thank you for using core-js ( https://github.com/zloirock/core-js ) for polyfilling JavaScript standard library!

The project needs your help! Please consider supporting of core-js on Open Collective or Patreon:

https://opencollective.com/core-js
https://www.patreon.com/zloirock

Also, the author of core-js ( https://github.com/zloirock ) is looking for a good job -)

[email protected] postinstall /ceph/src/pybind/mgr/dashboard/frontend/node_modules/es5-ext
node -e "try{require('./_postinstall')}catch(e){}" || exit 0

[email protected] postinstall /ceph/src/pybind/mgr/dashboard/frontend/node_modules/cucumber/node_modules/cucumber-expressions
node scripts/postinstall.js

[email protected] postinstall /ceph/src/pybind/mgr/dashboard/frontend/node_modules/babel-runtime/node_modules/core-js
node -e "try{require('./postinstall')}catch(e){}"

Thank you for using core-js ( https://github.com/zloirock/core-js ) for polyfilling JavaScript standard library!

The project needs your help! Please consider supporting of core-js on Open Collective or Patreon:

https://opencollective.com/core-js
https://www.patreon.com/zloirock

Also, the author of core-js ( https://github.com/zloirock ) is looking for a good job -)

[email protected] postinstall /ceph/src/pybind/mgr/dashboard/frontend/node_modules/cypress
node index.js --exec install

Note: Overriding Cypress cache directory to: /ceph/build.cypress

  Previous installs of Cypress may not be found.

Cypress 9.7.0 is installed in /ceph/build.cypress/9.7.0

[email protected] postinstall /ceph/src/pybind/mgr/dashboard/frontend/node_modules/@grafana/e2e/node_modules/cypress
node index.js --exec install

Note: Overriding Cypress cache directory to: /ceph/build.cypress

  Previous installs of Cypress may not be found.

Cypress 9.3.1 is installed in /ceph/build.cypress/9.3.1

@compodoc/[email protected] postinstall /ceph/src/pybind/mgr/dashboard/frontend/node_modules/@compodoc/compodoc
opencollective-postinstall || exit 0

Thank you for using @compodoc/compodoc!
If you rely on this package, please consider supporting our open collective:

https://opencollective.com/compodoc/donate

@angular/[email protected] postinstall /ceph/src/pybind/mgr/dashboard/frontend/node_modules/@angular/cli
node ./bin/postinstall/script.js

npm WARN lifecycle [email protected]~postinstall: cannot run in wd [email protected] ngcc --properties es2015 browser module main --async false --first-only --tsconfig 'tsconfig.app.json' (wd=/ceph/src/pybind/mgr/dashboard/frontend)
added 3067 packages in 89.24s
make: *** No rule to make target 'mgr-dashboard-frontend-build'. Stop.
ERROR: 2

Quick install setup hangs on F32

When setting up the environment on F32, after creating the images with docker-compose up d,
docker-compose logs -f ceph only shows attaching to ceph and makes no progress.

This does not seem to be related to docker/docker-compose versions nor docker engine.
The same behavior was replicated using:

• docker 19.03.9
• docker-ce
• docker-moby engine
• docker-compose 1.21.0
• docker-compose 1.25.4

Downgraded to F31 and faced no issues following the exact workflow as described in the README.

centos7: build-ceph.sh fails due to package problem with `devtoolset`

When trying to build ceph on centos7, build-ceph.sh fails and returns a non-zero exit code due to an issue with the devtoolset package.

The workaround is to replace install-deps.sh in build-ceph.sh with install-deps.sh || true, but that's not a solution I'd like to propose to adopt.

When I tried the project out a few weeks ago, that was an issue and it is still an issue, so I thought it's worth reporting it.

Note that the output of build-ceph.sh here is slightly more verbose than what build-ceph.sh usually produces, as I added set -x at the beginning of that script.

docker-compose run --rm ceph /docker/build-ceph.sh

  Verifying  : mesa-libEGL-devel-18.0.5-4.el7_6.x86_64                                   34/64
  Verifying  : libXxf86vm-devel-1.1.4-1.el7.x86_64                                       35/64
  Verifying  : qt5-qtbase-5.9.2-3.el7.x86_64                                             36/64
  Verifying  : libicu-50.1.2-17.el7.x86_64                                               37/64
  Verifying  : erlang-rpm-macros-0.1.4-1.el7.noarch                                      38/64
  Verifying  : 1:libglvnd-opengl-1.0.1-0.8.git5baa1e5.el7.x86_64                         39/64
  Verifying  : blis-srpm-macros-0.4.1-2.el7.noarch                                       40/64
  Verifying  : libXext-devel-1.3.3-3.el7.x86_64                                          41/64
  Verifying  : mesa-libGL-devel-18.0.5-4.el7_6.x86_64                                    42/64
  Verifying  : prelink-0.5.0-9.el7.x86_64                                                43/64
  Verifying  : ghc-rpm-macros-1.0.11-1.el7.x86_64                                        44/64
  Verifying  : qt5-qtbase-common-5.9.2-3.el7.noarch                                      45/64
  Verifying  : pcre2-utf16-10.23-2.el7.x86_64                                            46/64
  Verifying  : ghc-base-devel-4.6.0.1-26.4.el7.x86_64                                    47/64
  Verifying  : python3-other-rpm-macros-3-25.el7.noarch                                  48/64
  Verifying  : python3-rpm-macros-3-25.el7.noarch                                        49/64
  Verifying  : libxcb-devel-1.13-1.el7.x86_64                                            50/64
  Verifying  : libdrm-devel-2.4.91-3.el7.x86_64                                          51/64
  Verifying  : libX11-devel-1.6.5-2.el7.x86_64                                           52/64
  Verifying  : libXfixes-devel-5.0.3-1.el7.x86_64                                        53/64
  Verifying  : qt5-qtbase-gui-5.9.2-3.el7.x86_64                                         54/64
  Verifying  : xcb-util-0.4.0-2.el7.x86_64                                               55/64
  Verifying  : glx-utils-8.3.0-10.el7.x86_64                                             56/64
  Verifying  : unzip-6.0-19.el7.x86_64                                                   57/64
  Verifying  : erlang-erts-R16B-03.18.el7.x86_64                                         58/64
  Verifying  : libXau-devel-1.0.8-2.1.el7.x86_64                                         59/64
  Verifying  : elfutils-0.172-2.el7.x86_64                                               60/64
  Verifying  : kf5-rpm-macros-5.52.0-1.el7.noarch                                        61/64
  Verifying  : python-srpm-macros-3-22.el7.noarch                                        62/64
  Verifying  : python-rpm-macros-3-22.el7.noarch                                         63/64
  Verifying  : python3-rpm-macros-3-22.el7.noarch                                        64/64

Installed:
  blender-rpm-macros.noarch 1:2.68a-8.el7          blis-srpm-macros.noarch 0:0.4.1-2.el7
  epel-rpm-macros.noarch 0:7-19                    erlang-rpm-macros.noarch 0:0.1.4-1.el7
  ghc-rpm-macros.x86_64 0:1.0.11-1.el7             kf5-rpm-macros.noarch 0:5.52.0-1.el7
  ocaml-srpm-macros.noarch 0:5-2.el7               openblas-srpm-macros.noarch 0:1-1.el7
  python-qt5-rpm-macros.noarch 0:5.12.1-2.el7      python2-rpm-macros.noarch 0:3-25.el7
  python3-other-rpm-macros.noarch 0:3-25.el7       qt5-rpm-macros.noarch 0:5.9.2-3.el7

Dependency Installed:
  elfutils.x86_64 0:0.172-2.el7
  erlang-compiler.x86_64 0:R16B-03.18.el7
  erlang-crypto.x86_64 0:R16B-03.18.el7
  erlang-erts.x86_64 0:R16B-03.18.el7
  erlang-hipe.x86_64 0:R16B-03.18.el7
  erlang-kernel.x86_64 0:R16B-03.18.el7
  erlang-stdlib.x86_64 0:R16B-03.18.el7
  erlang-syntax_tools.x86_64 0:R16B-03.18.el7
  gdb.x86_64 0:7.6.1-114.el7
  ghc-base.x86_64 0:4.6.0.1-26.4.el7
  ghc-base-devel.x86_64 0:4.6.0.1-26.4.el7
  ghc-compiler.x86_64 0:7.6.3-26.4.el7
  gl-manpages.noarch 0:1.1-7.20130122.el7
  glx-utils.x86_64 0:8.3.0-10.el7
  gmp-devel.x86_64 1:6.0.0-15.el7
  hscolour.x86_64 0:1.20.3-9.el7
  libX11-devel.x86_64 0:1.6.5-2.el7
  libXau-devel.x86_64 0:1.0.8-2.1.el7
  libXdamage-devel.x86_64 0:1.1.4-4.1.el7
  libXext-devel.x86_64 0:1.3.3-3.el7
  libXfixes-devel.x86_64 0:5.0.3-1.el7
  libXxf86vm-devel.x86_64 0:1.1.4-1.el7
  libdrm-devel.x86_64 0:2.4.91-3.el7
  libffi-devel.x86_64 0:3.0.13-18.el7
  libglvnd-core-devel.x86_64 1:1.0.1-0.8.git5baa1e5.el7
  libglvnd-devel.x86_64 1:1.0.1-0.8.git5baa1e5.el7
  libglvnd-gles.x86_64 1:1.0.1-0.8.git5baa1e5.el7
  libglvnd-opengl.x86_64 1:1.0.1-0.8.git5baa1e5.el7
  libicu.x86_64 0:50.1.2-17.el7
  libxcb-devel.x86_64 0:1.13-1.el7
  mesa-libEGL-devel.x86_64 0:18.0.5-4.el7_6
  mesa-libGL-devel.x86_64 0:18.0.5-4.el7_6
  pcre2-utf16.x86_64 0:10.23-2.el7
  prelink.x86_64 0:0.5.0-9.el7
  qt5-qtbase.x86_64 0:5.9.2-3.el7
  qt5-qtbase-common.noarch 0:5.9.2-3.el7
  qt5-qtbase-devel.x86_64 0:5.9.2-3.el7
  qt5-qtbase-gui.x86_64 0:5.9.2-3.el7
  rpm-build.x86_64 0:4.11.3-35.el7
  unzip.x86_64 0:6.0-19.el7
  xcb-util.x86_64 0:0.4.0-2.el7
  xcb-util-image.x86_64 0:0.4.0-2.el7
  xcb-util-keysyms.x86_64 0:0.4.0-1.el7
  xcb-util-renderutil.x86_64 0:0.3.9-3.el7
  xcb-util-wm.x86_64 0:0.4.1-5.el7
  xorg-x11-proto-devel.noarch 0:2018.4-1.el7

Updated:
  python-rpm-macros.noarch 0:3-25.el7            python-srpm-macros.noarch 0:3-25.el7
  python3-rpm-macros.noarch 0:3-25.el7

Complete!
Loaded plugins: auto-update-debuginfo, fastestmirror, ovl
Enabling base-source repository
Enabling centos-sclo-rh-source repository
Enabling centos-sclo-sclo-source repository
Enabling epel-source repository
Enabling extras-source repository
Enabling updates-source repository
Loading mirror speeds from cached hostfile
 * base: mirror.softaculous.com
 * epel: ftp.plusline.net
 * epel-debuginfo: ftp.plusline.net
 * epel-source: mirror.karneval.cz
 * extras: centosmirror.netcup.net
 * updates: mirror.ratiokontakt.de
Checking for new repos for mirrors
sh: /usr/bin/python3.6: No such file or directory
sh: /usr/bin/python3.6: No such file or directory
sh: /usr/bin/python3.6: No such file or directory
sh: /usr/bin/python3.6: No such file or directory
sh: /usr/bin/python3.6: No such file or directory
sh: /usr/bin/python3.6: No such file or directory
sh: /usr/bin/python3.6: No such file or directory
sh: /usr/bin/python3.6: No such file or directory
sh: /usr/bin/python3.6: No such file or directory
sh: /usr/bin/python3.6: No such file or directory
sh: /usr/bin/python3.6: No such file or directory
sh: /usr/bin/python3.6: No such file or directory
sh: /usr/bin/python3.6: No such file or directory
sh: /usr/bin/python3.6: No such file or directory
sh: /usr/bin/python3.6: No such file or directory
Getting requirements for /tmp/install-deps.9/ceph.spec
 --> Already installed : 1:java-1.8.0-openjdk-devel-1.8.0.191.b12-1.el7_6.x86_64
 --> Already installed : sharutils-4.13.3-8.el7.x86_64
 --> Already installed : checkpolicy-2.5-8.el7.x86_64
 --> Already installed : selinux-policy-devel-3.13.1-229.el7_6.9.noarch
 --> Already installed : gperf-3.0.4-8.el7.x86_64
 --> Already installed : cmake3-3.13.4-1.el7.x86_64
 --> Already installed : cryptsetup-2.0.3-3.el7.x86_64
 --> Already installed : fuse-devel-2.9.2-11.el7.x86_64
 --> devtoolset-8-gcc-c++-8.2.1-3.el7.x86_64
 --> Already installed : gdbm-1.10-8.el7.x86_64
 --> Already installed : gperftools-devel-2.6.1-1.el7.x86_64
 --> Already installed : leveldb-devel-1.12.0-11.el7.x86_64
 --> Already installed : libaio-devel-0.3.109-13.el7.x86_64
 --> Already installed : libblkid-devel-2.23.2-59.el7.x86_64
 --> Already installed : libcurl-devel-7.29.0-51.el7.x86_64
 --> Already installed : systemd-devel-219-62.el7_6.5.x86_64
 --> libnl3-devel-3.2.28-4.el7.x86_64
 --> Already installed : liboath-devel-2.4.1-9.el7.x86_64
 --> Already installed : libtool-2.4.2-22.el7_3.x86_64
 --> Already installed : libxml2-devel-2.9.1-6.el7_2.3.x86_64
 --> Already installed : libuuid-devel-2.23.2-59.el7.x86_64
 --> Already installed : 1:make-3.82-23.el7.x86_64
 --> Already installed : ncurses-devel-5.9-14.20130511.el7_4.x86_64
 --> Already installed : parted-3.1-29.el7.x86_64
 --> Already installed : patch-2.7.1-10.el7_5.x86_64
 --> Already installed : 4:perl-5.16.3-294.el7_6.x86_64
 --> Already installed : 1:pkgconfig-0.27.1-4.el7.x86_64
 --> Already installed : procps-ng-3.3.10-23.el7.x86_64
 --> Already installed : python-2.7.5-76.el7.x86_64
 --> Already installed : python-devel-2.7.5-76.el7.x86_64
 --> Already installed : snappy-devel-1.1.0-3.el7.x86_64
 --> Already installed : sudo-1.8.23-3.el7.x86_64
 --> Already installed : systemd-219-62.el7_6.5.x86_64
 --> Already installed : util-linux-2.23.2-59.el7.x86_64
 --> Already installed : 1:valgrind-devel-3.13.0-13.el7.x86_64
 --> Already installed : which-2.20-7.el7.x86_64
 --> Already installed : xfsprogs-4.5.0-18.el7.x86_64
 --> Already installed : xfsprogs-devel-4.5.0-18.el7.x86_64
 --> Already installed : xmlstarlet-1.6.1-1.el7.x86_64
 --> Already installed : yasm-1.2.0-4.el7.x86_64
 --> Already installed : librabbitmq-devel-0.8.0-2.el7.x86_64
 --> Already installed : jq-1.5-1.el7.x86_64
 --> Already installed : python2-bcrypt-3.1.4-4.el7.x86_64
 --> Already installed : python-coverage-3.6-0.5.b3.el7.x86_64
 --> Already installed : python-nose-1.3.7-1.el7.noarch
 --> Already installed : python-pecan-0.4.5-2.el7.noarch
 --> Already installed : python-requests-2.6.0-1.el7_1.noarch
 --> Already installed : python-six-1.9.0-2.el7.noarch
 --> Already installed : python-tox-1.4.2-8.el7.noarch
 --> Already installed : python-virtualenv-15.1.0-2.el7.noarch
 --> Already installed : pyOpenSSL-0.13.1-4.el7.x86_64
 --> Already installed : socat-1.7.3.2-2.el7.x86_64
 --> Already installed : boost-random-1.53.0-27.el7.x86_64
 --> Already installed : nss-devel-3.36.0-7.1.el7_6.x86_64
 --> Already installed : keyutils-libs-devel-1.5.8-3.el7.x86_64
 --> Already installed : rdma-core-devel-17.2-3.el7.x86_64
 --> Already installed : rdma-core-devel-17.2-3.el7.x86_64
 --> Already installed : openldap-devel-2.4.44-21.el7_6.x86_64
 --> Already installed : 1:openssl-devel-1.0.2k-16.el7.x86_64
 --> Already installed : CUnit-devel-2.1.3-13.el7.x86_64
 --> Already installed : redhat-lsb-core-4.1-27.el7.centos.1.x86_64
 --> Already installed : Cython-0.19-5.el7.x86_64
 --> python36-devel-3.6.8-1.el7.x86_64
 --> python36-setuptools-39.2.0-3.el7.noarch
 --> python36-Cython-0.28.4-3.el7.x86_64
 --> Already installed : python-prettytable-0.7.2-3.el7.noarch
 --> Already installed : python-sphinx-1.1.3-11.el7.noarch
 --> Already installed : lz4-devel-1.7.5-2.el7.x86_64
 --> Already installed : python-cherrypy-3.2.2-4.el7.noarch
 --> Already installed : python-jwt-1.5.3-1.el7.noarch
 --> Already installed : python-routes-1.13-2.el7.noarch
 --> Already installed : python-werkzeug-0.9.1-2.el7.noarch
 --> Already installed : xmlsec1-1.2.20-7.el7_4.x86_64
 --> Already installed : lttng-ust-devel-2.4.1-4.el7.x86_64
 --> Already installed : libbabeltrace-devel-1.2.4-3.el7.x86_64
 --> Already installed : expat-devel-2.1.0-10.el7_3.x86_64
 --> Already installed : redhat-rpm-config-9.1.0-87.el7.centos.noarch
 --> Already installed : junit-4.11-8.el7.noarch
--> Running transaction check
---> Package devtoolset-8-gcc-c++.x86_64 0:8.2.1-3.el7 will be installed
--> Processing Dependency: devtoolset-8-libstdc++-devel = 8.2.1-3.el7 for package: devtoolset-8-gcc-c++-8.2.1-3.el7.x86_64
--> Processing Dependency: devtoolset-8-gcc = 8.2.1-3.el7 for package: devtoolset-8-gcc-c++-8.2.1-3.el7.x86_64
--> Processing Dependency: devtoolset-8-runtime for package: devtoolset-8-gcc-c++-8.2.1-3.el7.x86_64
---> Package libnl3-devel.x86_64 0:3.2.28-4.el7 will be installed
--> Processing Dependency: libnl3-cli = 3.2.28-4.el7 for package: libnl3-devel-3.2.28-4.el7.x86_64
--> Processing Dependency: libnl-cli-3.so.200()(64bit) for package: libnl3-devel-3.2.28-4.el7.x86_64
---> Package python34-devel.x86_64 0:3.4.9-2.el7 will be obsoleted
---> Package python36-Cython.x86_64 0:0.28.4-3.el7 will be installed
--> Processing Dependency: python(abi) = 3.6 for package: python36-Cython-0.28.4-3.el7.x86_64
Package: python36-3.6.8-1.el7.src - can't co-install with python36-3.6.8-1.el7.x86_64
--> Processing Dependency: /usr/bin/python3.6 for package: python36-Cython-0.28.4-3.el7.x86_64
--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python36-Cython-0.28.4-3.el7.x86_64
---> Package python36-devel.x86_64 0:3.6.8-1.el7 will be obsoleting
---> Package python36-setuptools.noarch 0:39.2.0-3.el7 will be installed
--> Running transaction check
---> Package devtoolset-8-gcc.x86_64 0:8.2.1-3.el7 will be installed
--> Processing Dependency: devtoolset-8-binutils >= 2.22.52.0.1 for package: devtoolset-8-gcc-8.2.1-3.el7.x86_64
---> Package devtoolset-8-libstdc++-devel.x86_64 0:8.2.1-3.el7 will be installed
---> Package devtoolset-8-runtime.x86_64 0:8.1-1.el7 will be installed
---> Package libnl3-cli.x86_64 0:3.2.28-4.el7 will be installed
---> Package python34.x86_64 0:3.4.9-2.el7 will be obsoleted
--> Processing Dependency: python(abi) = 3.4 for package: python34-setuptools-39.2.0-2.el7.noarch
--> Processing Dependency: python(abi) = 3.4 for package: python34-Cython-0.23.5-1.el7.x86_64
---> Package python34-libs.x86_64 0:3.4.9-2.el7 will be obsoleted
--> Processing Dependency: libpython3.4m.so.1.0()(64bit) for package: python34-Cython-0.28.4-3.el7.x86_64
--> Processing Dependency: libpython3.4m.so.1.0()(64bit) for package: python34-3.4.10-2.el7.x86_64
---> Package python36.x86_64 0:3.6.8-1.el7 will be obsoleting
---> Package python36-libs.x86_64 0:3.6.8-1.el7 will be obsoleting
--> Running transaction check
---> Package devtoolset-8-binutils.x86_64 0:2.30-54.el7 will be installed
---> Package python34.x86_64 0:3.4.9-2.el7 will be updated
---> Package python34.x86_64 0:3.4.10-2.el7 will be an update
---> Package python34-Cython.x86_64 0:0.23.5-1.el7 will be updated
---> Package python34-Cython.x86_64 0:0.28.4-3.el7 will be an update
---> Package python34-libs.x86_64 0:3.4.9-2.el7 will be updated
---> Package python34-libs.x86_64 0:3.4.10-2.el7 will be an update
---> Package python34-setuptools.noarch 0:39.2.0-2.el7 will be updated
---> Package python34-setuptools.noarch 0:39.2.0-3.el7 will be an update
--> Finished Dependency Resolution

Dependencies Resolved

================================================================================
 Package                        Arch     Version         Repository        Size
================================================================================
Installing:
 devtoolset-8-gcc-c++           x86_64   8.2.1-3.el7     centos-sclo-rh    12 M
 libnl3-devel                   x86_64   3.2.28-4.el7    base              71 k
 python36                       x86_64   3.6.8-1.el7     epel              67 k
     replacing  python34.x86_64 3.4.9-2.el7
 python36-Cython                x86_64   0.28.4-3.el7    epel             3.4 M
 python36-devel                 x86_64   3.6.8-1.el7     epel             850 k
     replacing  python34-devel.x86_64 3.4.9-2.el7
 python36-libs                  x86_64   3.6.8-1.el7     epel             8.6 M
     replacing  python34-libs.x86_64 3.4.9-2.el7
 python36-setuptools            noarch   39.2.0-3.el7    epel             631 k
Installing for dependencies:
 devtoolset-8-binutils          x86_64   2.30-54.el7     centos-sclo-rh   5.5 M
 devtoolset-8-gcc               x86_64   8.2.1-3.el7     centos-sclo-rh    31 M
 devtoolset-8-libstdc++-devel   x86_64   8.2.1-3.el7     centos-sclo-rh   2.7 M
 devtoolset-8-runtime           x86_64   8.1-1.el7       centos-sclo-rh    20 k
 libnl3-cli                     x86_64   3.2.28-4.el7    base             160 k
Updating for dependencies:
 python34                       x86_64   3.4.10-2.el7    epel              51 k
 python34-Cython                x86_64   0.28.4-3.el7    epel             3.4 M
 python34-libs                  x86_64   3.4.10-2.el7    epel             8.3 M
 python34-setuptools            noarch   39.2.0-3.el7    epel             640 k

Transaction Summary
================================================================================
Install  7 Packages (+5 Dependent packages)
Upgrade             ( 4 Dependent packages)

Total download size: 77 M
Downloading packages:
Delta RPMs disabled because /usr/bin/applydeltarpm not installed.
--------------------------------------------------------------------------------
Total                                              3.0 MB/s |  77 MB  00:25
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Installing : python36-libs-3.6.8-1.el7.x86_64                            1/21
  Installing : python36-3.6.8-1.el7.x86_64                                 2/21
  Installing : devtoolset-8-runtime-8.1-1.el7.x86_64                       3/21
ValueError: SELinux policy is not managed or store cannot be accessed.
  Updating   : python34-libs-3.4.10-2.el7.x86_64                           4/21
  Updating   : python34-3.4.10-2.el7.x86_64                                5/21
  Installing : devtoolset-8-libstdc++-devel-8.2.1-3.el7.x86_64             6/21
  Installing : devtoolset-8-binutils-2.30-54.el7.x86_64                    7/21
install-info: No such file or directory for /opt/rh/devtoolset-8/root/usr/share/info/as.info.gz
install-info: No such file or directory for /opt/rh/devtoolset-8/root/usr/share/info/binutils.info.gz
install-info: No such file or directory for /opt/rh/devtoolset-8/root/usr/share/info/gprof.info.gz
install-info: No such file or directory for /opt/rh/devtoolset-8/root/usr/share/info/ld.info.gz
install-info: No such file or directory for /opt/rh/devtoolset-8/root/usr/share/info/standards.info.gz
  Installing : libnl3-cli-3.2.28-4.el7.x86_64                              8/21
  Installing : libnl3-devel-3.2.28-4.el7.x86_64                            9/21
  Updating   : python34-Cython-0.28.4-3.el7.x86_64                        10/21
  Updating   : python34-setuptools-39.2.0-3.el7.noarch                    11/21
  Installing : python36-devel-3.6.8-1.el7.x86_64                          12/21
  Installing : python36-setuptools-39.2.0-3.el7.noarch                    13/21
  Installing : python36-Cython-0.28.4-3.el7.x86_64                        14/21
  Installing : devtoolset-8-gcc-8.2.1-3.el7.x86_64                        15/21
  Installing : devtoolset-8-gcc-c++-8.2.1-3.el7.x86_64                    16/21
  Erasing    : python34-devel-3.4.9-2.el7.x86_64                          17/21
  Cleanup    : python34-Cython-0.23.5-1.el7.x86_64                        18/21
  Cleanup    : python34-setuptools-39.2.0-2.el7.noarch                    19/21
  Cleanup    : python34-libs-3.4.9-2.el7.x86_64                           20/21
  Cleanup    : python34-3.4.9-2.el7.x86_64                                21/21
  Verifying  : devtoolset-8-libstdc++-devel-8.2.1-3.el7.x86_64             1/21
  Verifying  : python36-devel-3.6.8-1.el7.x86_64                           2/21
  Verifying  : python36-setuptools-39.2.0-3.el7.noarch                     3/21
  Verifying  : python34-Cython-0.28.4-3.el7.x86_64                         4/21
  Verifying  : libnl3-devel-3.2.28-4.el7.x86_64                            5/21
  Verifying  : devtoolset-8-binutils-2.30-54.el7.x86_64                    6/21
  Verifying  : python34-3.4.10-2.el7.x86_64                                7/21
  Verifying  : python34-libs-3.4.10-2.el7.x86_64                           8/21
  Verifying  : python36-3.6.8-1.el7.x86_64                                 9/21
  Verifying  : python36-Cython-0.28.4-3.el7.x86_64                        10/21
  Verifying  : devtoolset-8-gcc-c++-8.2.1-3.el7.x86_64                    11/21
  Verifying  : devtoolset-8-gcc-8.2.1-3.el7.x86_64                        12/21
  Verifying  : libnl3-cli-3.2.28-4.el7.x86_64                             13/21
  Verifying  : devtoolset-8-runtime-8.1-1.el7.x86_64                      14/21
  Verifying  : python36-libs-3.6.8-1.el7.x86_64                           15/21
  Verifying  : python34-setuptools-39.2.0-3.el7.noarch                    16/21
  Verifying  : python34-devel-3.4.9-2.el7.x86_64                          17/21
  Verifying  : python34-Cython-0.23.5-1.el7.x86_64                        18/21
  Verifying  : python34-libs-3.4.9-2.el7.x86_64                           19/21
  Verifying  : python34-libs-3.4.9-2.el7.x86_64                           20/21
  Verifying  : python34-3.4.9-2.el7.x86_64                                21/21
  Verifying  : python34-3.4.9-2.el7.x86_64                                22/21
  Verifying  : python34-setuptools-39.2.0-2.el7.noarch                    23/21

Installed:
  devtoolset-8-gcc-c++.x86_64 0:8.2.1-3.el7
  libnl3-devel.x86_64 0:3.2.28-4.el7
  python36.x86_64 0:3.6.8-1.el7
  python36-Cython.x86_64 0:0.28.4-3.el7
  python36-devel.x86_64 0:3.6.8-1.el7
  python36-libs.x86_64 0:3.6.8-1.el7
  python36-setuptools.noarch 0:39.2.0-3.el7

Dependency Installed:
  devtoolset-8-binutils.x86_64 0:2.30-54.el7
  devtoolset-8-gcc.x86_64 0:8.2.1-3.el7
  devtoolset-8-libstdc++-devel.x86_64 0:8.2.1-3.el7
  devtoolset-8-runtime.x86_64 0:8.1-1.el7
  libnl3-cli.x86_64 0:3.2.28-4.el7

Dependency Updated:
  python34.x86_64 0:3.4.10-2.el7      python34-Cython.x86_64 0:0.28.4-3.el7
  python34-libs.x86_64 0:3.4.10-2.el7 python34-setuptools.noarch 0:39.2.0-3.el7

Replaced:
  python34.x86_64 0:3.4.9-2.el7          python34-devel.x86_64 0:3.4.9-2.el7
  python34-libs.x86_64 0:3.4.9-2.el7

Complete!
root@ceph-mgr-dev-lp ~/src/ceph-dev-r ±master⚡ #                                                                                1 ↵

Generated GRAFANA_URL_API is not accesible from external hosts

As Ceph-Dashboard's GRAFANA_URL_API is generated from the following expression:

GRAFANA_IP=$(getent ahosts grafana.dev | tail -1 | awk '{print $1}')

It fails to retrieve the external IP address (only the bridged network addresses are found).

A suggestion would be to guess the external IP address in the docker-compose.yml and pass it as an environment variable. Let's discuss here the different approaches.

Publish ceph images is failing for master and pacific

It looks like for somedays the master and pacific ceph image building (not rpm ones) is failing consistently after running the install-deps.sh script. It started appearing after ceph/ceph@57edb76 in both master and pacific.

Add post-install script to populate Ceph

Default Ceph install ends up with a very basic setup, so we should populate it with more complex settings:

• RBD pool
• RBD Images, snapshots
• Add data to RBD Images.
• More RBD pools?
• More RGW daemons?
• More RGW buckets
• More RGW users?
• Add objects to RGW buckets?

Additionally, we should decide if it's interesting to configure the following features:

• Config RBD-mirroring?
• Config iSCSI?
• Config NFS?

run_tox lint fails with deps error

✘  ~/projects/ceph-dev   downstream-build-changes  docker-compose run --rm ceph /docker/ci/sanity-checks.sh run_tox lint                          
Running Tox...
lint recreate: /ceph/src/pybind/mgr/dashboard/.tox/lint
lint installdeps: -rrequirements.txt, -cconstraints.txt, -rrequirements-lint.txt
ERROR: invocation failed (exit code 1), logfile: /ceph/src/pybind/mgr/dashboard/.tox/lint/log/lint-1.log
=============================================== log start ===============================================
Obtaining file:///ceph/src/python-common (from -r requirements.txt (line 8))
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting bcrypt
  Downloading bcrypt-3.1.4-cp36-cp36m-manylinux1_x86_64.whl (54 kB)
Collecting CherryPy
  Downloading CherryPy-13.1.0-py2.py3-none-any.whl (430 kB)
Collecting more-itertools
  Downloading more_itertools-8.14.0-py3-none-any.whl (52 kB)
Collecting PyJWT
  Downloading PyJWT-2.0.1-py3-none-any.whl (15 kB)
Collecting pyopenssl
  Downloading pyOpenSSL-23.0.0-py3-none-any.whl (57 kB)
Collecting requests
  Downloading requests-2.26.0-py2.py3-none-any.whl (62 kB)
Collecting Routes
  Downloading Routes-2.4.1-py2.py3-none-any.whl (48 kB)
Collecting prettytable
  Downloading prettytable-2.5.0-py3-none-any.whl (24 kB)
Collecting pytest
  Downloading pytest-7.0.1-py3-none-any.whl (296 kB)
Collecting pyyaml
  Downloading PyYAML-6.0-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (603 kB)
Collecting natsort
  Downloading natsort-8.2.0-py3-none-any.whl (37 kB)
Requirement already satisfied: setuptools in ./.tox/lint/lib/python3.6/site-packages (from -r requirements.txt (line 13)) (59.6.0)
Collecting jsonpatch
  Downloading jsonpatch-1.32-py2.py3-none-any.whl (12 kB)
Collecting pylint==2.6.0
  Downloading pylint-2.6.0-py3-none-any.whl (325 kB)
Collecting flake8==3.9.0
  Downloading flake8-3.9.0-py2.py3-none-any.whl (73 kB)
Collecting flake8-colors==0.1.6
  Downloading flake8-colors-0.1.6.tar.gz (2.2 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting rstcheck==3.3.1
  Downloading rstcheck-3.3.1.tar.gz (13 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting autopep8==1.5.7
  Downloading autopep8-1.5.7-py2.py3-none-any.whl (45 kB)
Collecting pyfakefs==4.5.0
  Downloading pyfakefs-4.5.0-py3-none-any.whl (186 kB)
Collecting isort==5.5.3
  Downloading isort-5.5.3-py3-none-any.whl (95 kB)
ERROR: Could not find a version that satisfies the requirement jsonschema==4.16.0 (from versions: 0.1a0, 0.2, 0.3, 0.4, 0.5, 0.6, 0.7, 0.8.0, 1.0.0, 1.1.0, 1.2.0, 1.3.0, 2.0.0, 2.1.0, 2.2.0, 2.3.0, 2.4.0, 2.5.0, 2.5.1, 2.6.0, 3.0.0a1, 3.0.0a2, 3.0.0a3, 3.0.0a4, 3.0.0a5, 3.0.0a6, 3.0.0b1, 3.0.0b2, 3.0.0b3, 3.0.0, 3.0.1, 3.0.2, 3.1.0, 3.1.1, 3.2.0, 4.0.0a1, 4.0.0a2, 4.0.0a3, 4.0.0a4, 4.0.0a5, 4.0.0a6, 4.0.0)
ERROR: No matching distribution found for jsonschema==4.16.0

================================================ log end ================================================
ERROR: could not install deps [-rrequirements.txt, -cconstraints.txt, -rrequirements-lint.txt]; v = InvocationError('/ceph/src/pybind/mgr/dashboard/.tox/lint/bin/python -m pip install -rrequirements.txt -cconstraints.txt -rrequirements-lint.txt', 1)
________________________________________________ summary ________________________________________________
ERROR:   lint: could not install deps [-rrequirements.txt, -cconstraints.txt, -rrequirements-lint.txt]; v = InvocationError('/ceph/src/pybind/mgr/dashboard/.tox/lint/bin/python -m pip install -rrequirements.txt -cconstraints.txt -rrequirements-lint.txt', 1)

test issue

test issue as previous one (#11) has just disappeared.

../src/vstart.sh: No such file or directory

When using docker-compose up ceph I get the error /docker/start-ceph.sh: line 44: ../src/vstart.sh: No such file or directory

volume name is too short

When I perform a quick installation，report an error，I'm using the master branch，How can I fix this, thank you.

`[root@Nian ceph-dev]# docker-compose up
WARNING: The CEPH_REPO_DIR variable is not set. Defaulting to a blank string.
WARNING: The ALERTMANAGER_HOST_PORT variable is not set. Defaulting to a blank string.
WARNING: The GRAFANA_HOST_PORT variable is not set. Defaulting to a blank string.
WARNING: The NODE_EXPORTER_HOST_PORT variable is not set. Defaulting to a blank string.
WARNING: The PROMETHEUS_HOST_PORT variable is not set. Defaulting to a blank string.
WARNING: The CEPH2_REPO_DIR variable is not set. Defaulting to a blank string.
Starting node-exporter ...
Creating ceph ... error
Starting node-exporter ... done
Starting prometheus ...
Starting alertmanager ... done
Starting prometheus ... done
Starting grafana ... done

ERROR: for ceph Cannot create container for service ceph: create .: volume name is too short, names should be at least two alphanumeric characters
ERROR: Encountered errors while bringing up the project.
`