Request support for nested Hwameistor

[AmazingPangWei]

Request support for nested Hwameistor

[SSmallMonster]

can you paste the vm pod yaml that using the hwameistor LocalVolume?

[AmazingPangWei]

Of course, here is a vm example:

apiVersion: kubevirt.io/v1
kind: VirtualMachine
metadata:
  name: pw-vm-local
spec:
  dataVolumeTemplates:
    - metadata:
        name: pw-vm-lvm-disk
      spec:
        pvc:
          accessModes:
            - ReadWriteOnce
          resources:
            requests:
              storage: 100Gi
          volumeMode: Block
          storageClassName: hwameistor-storage-lvm-hdd
        source:
          http:
            url: http://mydomain.com/images/ubuntu22.04.raw
  runStrategy: Always
  template:
    spec:
      dnsPolicy: None
      domain:
        cpu:
          cores: 1
          sockets: 1
          threads: 1
        devices:
          disks:
            - bootOrder: 1
              disk:
                bus: scsi
              name: rootdisk
        machine:
          type: q35
        memory:
          guest: 2Gi
        resources: {}
      terminationGracePeriodSeconds: 0
      volumes:
        - dataVolume:
            name: pw-vm-lvm-disk
          name: rootdisk
        - cloudInitConfigDrive:
            userData: "#cloud-config"
          name: cloudinitvolume

[AmazingPangWei]

In my opinion, block pvcs are mounted through loop devices, and you can see them on your k8s node if you create a pod using block pvcs. Then you can make a vg in your pod, and list vgs on your k8s node.
You can reproduce this issue through above way.

[FloatXD]

I tried to reproduce the problem but to no avail

in vm

root@test4:~# lsblk
NAME    MAJ:MIN RM   SIZE RO TYPE MOUNTPOINTS
loop0     7:0    0  63.4M  1 loop /snap/core20/1974
loop1     7:1    0 111.9M  1 loop /snap/lxd/24322
loop2     7:2    0  53.3M  1 loop /snap/snapd/19457
vda     252:0    0   9.4G  0 disk 
├─vda1  252:1    0   9.3G  0 part /
├─vda14 252:14   0     4M  0 part 
└─vda15 252:15   0   106M  0 part /boot/efi
vdb     252:16   0     1M  0 disk 
vdc     252:32   0  18.9G  0 disk 
root@test4:~# vgcreate LocalStorage_PoolHDD /dev/vdc
  Physical volume "/dev/vdc" successfully created.
  Volume group "LocalStorage_PoolHDD" successfully created
root@test4:~# vgs
  VG                   #PV #LV #SN Attr   VSize   VFree  
  LocalStorage_PoolHDD   1   0   0 wz--n- <18.90g <18.90g

on physical machine

[root@controller-node-1 ~]# vgs
  VG                   #PV #LV #SN Attr   VSize    VFree   
  LocalStorage_PoolHDD   1   2   0 wz--n- <200.00g <170.00g
  centos                 1   3   0 wz--n- <299.00g    4.00m
[root@controller-node-1 ~]# pvs
  PV         VG                   Fmt  Attr PSize    PFree   
  /dev/sda2  centos               lvm2 a--  <299.00g    4.00m
  /dev/sdb   LocalStorage_PoolHDD lvm2 a--  <200.00g <170.00g
[root@controller-node-1 ~]# vgdisplay -v
  --- Volume group ---
  VG Name               LocalStorage_PoolHDD
  System ID             
  Format                lvm2
  Metadata Areas        1
  Metadata Sequence No  53
  VG Access             read/write
  VG Status             resizable
  MAX LV                0
  Cur LV                2
  Open LV               2
  Max PV                0
  Cur PV                1
  Act PV                1
  VG Size               <200.00 GiB
  PE Size               4.00 MiB
  Total PE              51199
  Alloc PE / Size       7680 / 30.00 GiB
  Free  PE / Size       43519 / <170.00 GiB
  VG UUID               GQ4hJv-H6P6-2Yx5-Ok2n-ahBu-VBqM-a6GlFR
   
  --- Logical volume ---
  LV Path                /dev/LocalStorage_PoolHDD/pvc-f4bcb649-3a96-4909-bbbe-335bd6995366
  LV Name                pvc-f4bcb649-3a96-4909-bbbe-335bd6995366
  VG Name                LocalStorage_PoolHDD
  LV UUID                dCJN07-0Hco-ho61-RBT3-pgHZ-92BP-wwOE8M
  LV Write Access        read/write
  LV Creation host, time controller-node-1, 2024-04-09 14:59:16 +0800
  LV Status              available
  # open                 1
  LV Size                10.00 GiB
  Current LE             2560
  Segments               1
  Allocation             inherit
  Read ahead sectors     auto
  - currently set to     8192
  Block device           253:2
   
  --- Logical volume ---
  LV Path                /dev/LocalStorage_PoolHDD/pvc-dab13f16-1be6-4dd2-a012-78d2d35f5d44
  LV Name                pvc-dab13f16-1be6-4dd2-a012-78d2d35f5d44
  VG Name                LocalStorage_PoolHDD
  LV UUID                GCkads-1sfV-IbJR-hKKz-3R6h-lEFf-0r8OjD
  LV Write Access        read/write
  LV Creation host, time controller-node-1, 2024-04-09 14:59:17 +0800
  LV Status              available
  # open                 1
  LV Size                20.00 GiB
  Current LE             5120
  Segments               1
  Allocation             inherit
  Read ahead sectors     auto
  - currently set to     8192
  Block device           253:3
   
  --- Physical volumes ---
  PV Name               /dev/sdb     
  PV UUID               xVsPfq-183I-UPM0-ohTZ-22Ms-FEi0-C19mgj
  PV Status             allocatable
  Total PE / Free PE    51199 / 43519
   
  --- Volume group ---
  VG Name               centos
  System ID             
  Format                lvm2
  Metadata Areas        1
  Metadata Sequence No  4
  VG Access             read/write
  VG Status             resizable
  MAX LV                0
  Cur LV                3
  Open LV               2
  Max PV                0
  Cur PV                1
  Act PV                1
  VG Size               <299.00 GiB
  PE Size               4.00 MiB
  Total PE              76543
  Alloc PE / Size       76542 / 298.99 GiB
  Free  PE / Size       1 / 4.00 MiB
  VG UUID               st4gcx-gqPm-V11H-wQyl-0bG8-a6So-ZKds9j
   
  --- Logical volume ---
  LV Path                /dev/centos/swap
  LV Name                swap
  VG Name                centos
  LV UUID                Jiq52w-sYWE-ErRd-wSxt-apOp-hEA3-eRpxS3
  LV Write Access        read/write
  LV Creation host, time localhost.localdomain, 2022-09-08 11:09:52 +0800
  LV Status              available
  # open                 0
  LV Size                <7.88 GiB
  Current LE             2016
  Segments               1
  Allocation             inherit
  Read ahead sectors     auto
  - currently set to     8192
  Block device           253:1
   
  --- Logical volume ---
  LV Path                /dev/centos/home
  LV Name                home
  VG Name                centos
  LV UUID                kviBws-b2Wg-SlQx-1S9G-ThxO-0obA-iDpCAl
  LV Write Access        read/write
  LV Creation host, time localhost.localdomain, 2022-09-08 11:09:53 +0800
  LV Status              available
  # open                 1
  LV Size                <241.12 GiB
  Current LE             61726
  Segments               1
  Allocation             inherit
  Read ahead sectors     auto
  - currently set to     8192
  Block device           253:7
   
  --- Logical volume ---
  LV Path                /dev/centos/root
  LV Name                root
  VG Name                centos
  LV UUID                2qt8nB-FmGC-UvWM-pwkD-AB06-zL0C-vdOafO
  LV Write Access        read/write
  LV Creation host, time localhost.localdomain, 2022-09-08 11:09:53 +0800
  LV Status              available
  # open                 1
  LV Size                50.00 GiB
  Current LE             12800
  Segments               1
  Allocation             inherit
  Read ahead sectors     auto
  - currently set to     8192
  Block device           253:0
   
  --- Physical volumes ---
  PV Name               /dev/sda2     
  PV UUID               OZecXn-VsZ5-UF0Z-QUd9-Xntm-wL2E-nvMzEI
  PV Status             allocatable
  Total PE / Free PE    76543 / 1
   

[AmazingPangWei]

@FloatXD Here are my questions：

1. Does vm test4 is on node controller-node-1?
2. Is volumeMode in vm spec volumeMode: Block ？