whamcloud/iml-common

iml-common's Issues

Remove remaining ZFS CLI code

Now we have the capability to pull all the necessary zfs properties from storage servers using the device-scanner https://github.com/whamcloud/device-scanner/ we don't need to call out to the CLI in the agent.

Remove relevant code and replace with utilisation of property information gathered by the device-scanner and provided to the resource manager through the device-aggregator .

This is a follow-on issue from #35

Remove ConfigureNTP

ConfigureNTP has been moved to rust-iml-agent. ConfigureNTP is no longer needed in iml-common so it can be removed.

Remove EL6 tests

Since EL7 is now the only supported version, remove legacy tests for EL6

BlockDeviceZfs should always refer to a pool path or zvol

In the current abstraction both zpools and datasets can be represented by a BlockDeviceZfs instance, really only zpools and zvols (datasets of type volume with a static reservation) should be able to be represented as block devices.

ZFS datasets of type filesystem should always be represented as FileSystemZfs instances.

Fix running pytest with coverage plug-in in Travis

Running coverage plug-in for pytest seems to be broken. (intermittent)

Fix running coverage to create the reports before running codecov.

https://travis-ci.org/intel-hpdd/iml-common/builds/253755003
https://coverage.readthedocs.io/en/coverage-4.4.1/changes.html
https://bitbucket.org/ned/coveragepy/commits/74e2f7c366a2

iml-common packages conflict at install time

Seen while testing on kraken.

[26/Sep/2017:11:28:10] DEBUG 0.000090: Transaction check error:
[26/Sep/2017:11:28:10] DEBUG 0.000134:   file /usr/lib/python2.7/site-packages/iml_common/__init__.pyc from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000139:   file /usr/lib/python2.7/site-packages/iml_common/blockdevices/__init__.pyc from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000136:   file /usr/lib/python2.7/site-packages/iml_common/filesystems/__init__.pyc from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000155:   file /usr/lib/python2.7/site-packages/iml_common/lib/__init__.pyc from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000138:   file /usr/lib/python2.7/site-packages/iml_common/test/__init__.pyc from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000125:   file /usr/lib/python2.7/site-packages/iml_common/__init__.pyo from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000129:   file /usr/lib/python2.7/site-packages/iml_common/blockdevices/__init__.pyo from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000128:   file /usr/lib/python2.7/site-packages/iml_common/filesystems/__init__.pyo from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000127:   file /usr/lib/python2.7/site-packages/iml_common/lib/__init__.pyo from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000126:   file /usr/lib/python2.7/site-packages/iml_common/test/__init__.pyo from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000144:   file /usr/lib/python2.7/site-packages/iml_common/blockdevices/blockdevice.py from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000157:   file /usr/lib/python2.7/site-packages/iml_common/blockdevices/blockdevice.pyc from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000135:   file /usr/lib/python2.7/site-packages/iml_common/blockdevices/blockdevice.pyo from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000157:   file /usr/lib/python2.7/site-packages/iml_common/blockdevices/blockdevice_linux.pyc from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000133:   file /usr/lib/python2.7/site-packages/iml_common/blockdevices/blockdevice_linux.pyo from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000133:   file /usr/lib/python2.7/site-packages/iml_common/blockdevices/blockdevice_lvm_volume.pyc from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000132:   file /usr/lib/python2.7/site-packages/iml_common/blockdevices/blockdevice_lvm_volume.pyo from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000131:   file /usr/lib/python2.7/site-packages/iml_common/blockdevices/blockdevice_zfs.py from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000138:   file /usr/lib/python2.7/site-packages/iml_common/blockdevices/blockdevice_zfs.pyc from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000133:   file /usr/lib/python2.7/site-packages/iml_common/blockdevices/blockdevice_zfs.pyo from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000131:   file /usr/lib/python2.7/site-packages/iml_common/filesystems/filesystem.pyc from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000130:   file /usr/lib/python2.7/site-packages/iml_common/filesystems/filesystem.pyo from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000132:   file /usr/lib/python2.7/site-packages/iml_common/filesystems/filesystem_ldiskfs.pyc from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000131:   file /usr/lib/python2.7/site-packages/iml_common/filesystems/filesystem_ldiskfs.pyo from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000130:   file /usr/lib/python2.7/site-packages/iml_common/filesystems/filesystem_zfs.pyc from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000130:   file /usr/lib/python2.7/site-packages/iml_common/filesystems/filesystem_zfs.pyo from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000142:   file /usr/lib/python2.7/site-packages/iml_common/lib/agent_rpc.pyc from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000128:   file /usr/lib/python2.7/site-packages/iml_common/lib/agent_rpc.pyo from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000127:   file /usr/lib/python2.7/site-packages/iml_common/lib/date_time.pyc from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000127:   file /usr/lib/python2.7/site-packages/iml_common/lib/date_time.pyo from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000127:   file /usr/lib/python2.7/site-packages/iml_common/lib/evaluator.pyc from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000127:   file /usr/lib/python2.7/site-packages/iml_common/lib/evaluator.pyo from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000128:   file /usr/lib/python2.7/site-packages/iml_common/lib/exception_sandbox.pyc from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000134:   file /usr/lib/python2.7/site-packages/iml_common/lib/exception_sandbox.pyo from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000147:   file /usr/lib/python2.7/site-packages/iml_common/lib/firewall_control.pyc from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000133:   file /usr/lib/python2.7/site-packages/iml_common/lib/firewall_control.pyo from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000142:   file /usr/lib/python2.7/site-packages/iml_common/lib/name_value_list.pyc from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000129:   file /usr/lib/python2.7/site-packages/iml_common/lib/name_value_list.pyo from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000125:   file /usr/lib/python2.7/site-packages/iml_common/lib/ntp.pyc from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000126:   file /usr/lib/python2.7/site-packages/iml_common/lib/ntp.pyo from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000130:   file /usr/lib/python2.7/site-packages/iml_common/lib/package_version_info.pyc from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000137:   file /usr/lib/python2.7/site-packages/iml_common/lib/package_version_info.pyo from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000136:   file /usr/lib/python2.7/site-packages/iml_common/lib/service_control.pyc from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000129:   file /usr/lib/python2.7/site-packages/iml_common/lib/service_control.pyo from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000127:   file /usr/lib/python2.7/site-packages/iml_common/lib/shell.pyc from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000126:   file /usr/lib/python2.7/site-packages/iml_common/lib/shell.pyo from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000125:   file /usr/lib/python2.7/site-packages/iml_common/lib/util.pyc from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000126:   file /usr/lib/python2.7/site-packages/iml_common/lib/util.pyo from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000134:   file /usr/lib/python2.7/site-packages/iml_common/test/command_capture_testcase.pyc from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000134:   file /usr/lib/python2.7/site-packages/iml_common/test/command_capture_testcase.pyo from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000130:   file /usr/lib/python2.7/site-packages/iml_common/test/iml_unit_testcase.pyc from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch
[26/Sep/2017:11:28:10] DEBUG 0.000130:   file /usr/lib/python2.7/site-packages/iml_common/test/iml_unit_testcase.pyo from install of python2-iml-common1.1-1.1.0-1.el7.centos.noarch conflicts with file from package python2-iml-common-1.0.7-1.el7.centos.noarch

We need to package each version as /usr/lib/python2.7/site-packages/iml_commonX.X so they don't conflict at install time.

Host MDS has no NIDS

Hello,
We are using iml-4.0.8.0 to monitor existing lustre file-system. While running detect file system it is throwing an error host mds has no NIDS. The lustre file system is working fine and we able to do lctl ping to all mds, oss and client nodes. Attached herewith the screen shot of error. Kindly help.