jiangcuo/proxmox-arm64

Proxmox VE & PBS unofficial arm64 version

proxmox-arm64's Issues

Suggestion: host ISOs via github releases

Thanks for providing ISOs of Proxmox for ARM64. I am trying it out on a orangepi-5. I think downloads would be nice via github releases. The file limit is 2Gb but I've found ISOs compress down nicely w/ zip. It is easy to create a release and upload a file, but automation is also easy via github actions.

I want to use it in orangepi5

I want to use it in orangepi5

Can't join cluster because /etc/network/interfaces is not beeing used

Hello,

thanks for your repo and your package server. I wasn't able to get the Pi4 into my cluster because it has no interface to join on.

error when start the vm

my armpve is upgrade 7.3 to 7.4-16 ; when I start the vm, it noticed that
EFI base image '/usr/share/pve-edk2-firmware//AAVMF_CODE.ms.fd' not found
my vm setting

VM startup at 100 percent CPU and no console

Hi,

I have encounter issue on running VM guide from wiki:
qm create 100 \ --name qemuvm \ --ostype l26 \ --cpu host \ --cores 1 \ --memory 1024 \ --scsihw virtio-scsi-pci \ --net0 virtio,bridge=vmbr0 \ --bios ovmf \ --efidisk0 local:0,efitype=4m,size=64M,format=qcow2 \ --serial0 socket \ --scsi0 local:0,import-from=/root/jammy-server-cloudimg-arm64.img,format=qcow2 \ --scsi1 local:cloudinit \ --ciuser root \ --cipassword rootroot \ --ipconfig0 ip=dhcp \ --boot order=scsi0

When I start the VM, the CPU goes 100 percent and never come down untill I stop the VM(waited for 30mins).
I open console for that VM shows "guess has not initialized the display (yet)."

This the qm config output:

:~:# qm config 100 bios: ovmf boot: order=scsi0 cipassword: ********** ciuser: root cores: 2 cpu: max efidisk0: local:100/vm-100-disk-0.qcow2,efitype=4m,size=64M ipconfig0: ip=dhcp memory: 1024 meta: creation-qemu=7.2.0,ctime=1682406393 name: qemuvm net0: virtio=82:97:17:86:E3:06,bridge=vmbr0 numa: 0 ostype: l26 scsi0: local:100/vm-100-disk-1.qcow2,size=2252M scsi1: local:100/vm-100-cloudinit.qcow2,media=cdrom scsihw: virtio-scsi-pci serial0: socket smbios1: uuid=5c9db09c-05c4-4072-8d71-23cb32d4e8ee sockets: 1 vga: virtio

Thanks in advance!

Any plans for the 6.2 opt in kernel?

ˆ (https://forum.proxmox.com/threads/opt-in-linux-6-2-kernel-for-proxmox-ve-7-x-available.124189/)

'vmgenid' is not a valid device model name TASK ERROR: start failed: QEMU exited with code 1

..

Failed to launch LXC

Hi,
I encountered exactly the same problem as Issue #9, then I tried to upgrade apparmor based on your reply, but it was the latest version, and did not solve the problem.

Device: NanoPI-R6S
CPU: Rockchip RK-3588S ARMv8
RAM:8GB

Could you please give me more advice to solve that?
If any questions or need more info, happy to provide.
Many thanks!

error instaling from repo smartmontools_7.2-pve1_arm64.deb File has unexpected size (527124 != 535744)

error instaling from repo
smartmontools_7.2-pve1_arm64.deb File has unexpected size (527124 != 535744)

`root@prox4m1:/home/pull# root@prox4m1:/home/pull# apt install proxmox-ve postfix open-iscsi
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
open-iscsi is already the newest version (2.1.3-5).
postfix is already the newest version (3.5.18-0+deb11u1).
proxmox-ve is already the newest version (7.3-1).
You might want to run 'apt --fix-broken install' to correct these.
The following packages have unmet dependencies:
smartmontools : Depends: libc6 (>= 2.34) but 2.31-13+rpt2+rpi1+deb11u5 is to be installed
Depends: libstdc++6 (>= 11) but 10.2.1-6 is to be installed
E: Unmet dependencies. Try 'apt --fix-broken install' with no packages (or specify a solution).
root@prox4m1:/home/pull# apt --fix-broken install
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Correcting dependencies... Done
The following additional packages will be installed:
smartmontools
Suggested packages:
gsmartcontrol smart-notifier
The following packages will be upgraded:
smartmontools
1 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
8 not fully installed or removed.
Need to get 536 kB of archives.
After this operation, 47.1 kB disk space will be freed.
Do you want to continue? [Y/n] Y
Get:1 https://mirrors.apqa.cn/proxmox pvearm/main arm64 smartmontools arm64 7.2-pve1 [536 kB]
Err:1 https://mirrors.apqa.cn/proxmox pvearm/main arm64 smartmontools arm64 7.2-pve1
File has unexpected size (527124 != 535744). Mirror sync in progress? [IP: 152.70.92.238 443]
Hashes of expected file:

• SHA512:6c791ecc05fd659295d64b66638c7e18d11528adbbcfe8c65c75ca49c7499d024ff2b2587d2579fb717a5d3eec8d95b4665253a41989d80bfc3bff7de4d38121
• SHA256:fb4a33e9124d1b1d8f7f3755fef5b70146d0d007916f793b6b3079a9bcef5a63
• SHA1:7308a5b89b49b2cda07759d6ca53a9016136b649 [weak]
• MD5Sum:89bef5b7d2de915d358f5405495cd514 [weak]
• Filesize:535744 [weak]
  E: Failed to fetch https://mirrors.apqa.cn/proxmox/pool/main/s/smartmontools/smartmontools_7.2-pve1_arm64.deb File has unexpected size (527124 != 535744). Mirror sync in progress? [IP: 152.70.92.238 443]
  Hashes of expected file:
  - SHA512:6c791ecc05fd659295d64b66638c7e18d11528adbbcfe8c65c75ca49c7499d024ff2b2587d2579fb717a5d3eec8d95b4665253a41989d80bfc3bff7de4d38121
  - SHA256:fb4a33e9124d1b1d8f7f3755fef5b70146d0d007916f793b6b3079a9bcef5a63
  - SHA1:7308a5b89b49b2cda07759d6ca53a9016136b649 [weak]
  - MD5Sum:89bef5b7d2de915d358f5405495cd514 [weak]
  - Filesize:535744 [weak]
  E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?
  `

Cannot get ip address from VM or CT on Orange Pi 5

Hi,

I have installed this on orange pi 5 everything seems well with some warning, but it’s running.

when deploying VM and container both unable to get ip address. I have try Linux bridge and ovs bridge same result.

Base os Armbian 23.02.2 Debian Bulleye
Pve-manager 7.4-3

Thanks.

KunPeng 920 ARM syslog err[QEMU/KVM cannot detect CPU flags on ARM]

Hello,I saw the error in Syslog,Is this a bug?

`
Apr 04 09:51:18 pve81 pvestatd[2625]: QEMU/KVM cannot detect CPU flags on ARM (aarch64)
Apr 04 09:51:18 pve81 pvestatd[2625]: CPU flag detection failed, will try again after delay

`

No Valid OpenPGP Data found

Hi,

So I am trying to use your version, but it will not get pass this on the Orange PI 5

root@traveller:# echo "deb https://mirrors.apqa.cn/proxmox/ pvearm main">/etc/apt/sources.list.d/foxi.list
root@traveller:# curl -L https://mirrors.apqa.cn/proxmox/gpg.key |apt-key add
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)).
100 3667 0 3667 0 0 639 0 --:--:-- 0:00:05 --:--:-- 836
gpg: no valid OpenPGP data found.

root@traveller:~# apt update
Hit:1 http://armbian.tnahosting.net/apt bullseye InRelease
Hit:2 http://deb.debian.org/debian bullseye InRelease
Hit:3 http://security.debian.org bullseye-security InRelease
Hit:4 http://deb.debian.org/debian bullseye-updates InRelease
Hit:5 http://deb.debian.org/debian bullseye-backports InRelease
Get:6 https://mirrors.apqa.cn/proxmox pvearm InRelease [4,306 B]
Err:6 https://mirrors.apqa.cn/proxmox pvearm InRelease
The following signatures couldn't be verified because the public key is not available: NO_PUBKEY B859507D6B1F46D3
Reading package lists... Done
W: GPG error: https://mirrors.apqa.cn/proxmox pvearm InRelease: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY B859507D6B1F46D3
E: The repository 'https://mirrors.apqa.cn/proxmox pvearm InRelease' is not signed.
N: Updating from such a repository can't be done securely, and is therefore disabled by default.
N: See apt-secure(8) manpage for repository creation and user configuration details.

E: The repository 'https://mirrors.apqa.cn/proxmox pvearm Release' does not have a Release file.

Followed wiki post and everytime i tried to update i get
root@prox4m1:/home/pi# apt update && apt full-upgrade
Hit:1 http://deb.debian.org/debian bookworm InRelease
Hit:2 http://deb.debian.org/debian bookworm-updates InRelease
Hit:3 http://security.debian.org/debian-security bookworm-security InRelease
Hit:4 http://archive.raspberrypi.org/debian bullseye InRelease
Hit:5 https://global.mirrors.apqa.cn/proxmox/debian/pve bullseye InRelease
Ign:6 https://mirrors.apqa.cn/proxmox pvearm InRelease
Err:7 https://mirrors.apqa.cn/proxmox pvearm Release
404 Not Found [IP: 152.70.92.238 443]
Reading package lists... Done
E: The repository 'https://mirrors.apqa.cn/proxmox pvearm Release' does not have a Release file.
N: Updating from such a repository can't be done securely, and is therefore disabled by default.
N: See apt-secure(8) manpage for repository creation and user configuration details.
N: Repository 'Debian bookworm' changed its 'non-free component' value from 'non-free' to 'non-free non-free-firmware'
N: More information about this can be found online in the Release notes at: https://www.debian.org/releases/bookworm/arm64/release-notes/ch-information.html#non-free-split

Any idea of whats happening?
Thank you

[Request] Single build-from-source script/instructions

Appreciate all the work you've put in to make this happen

I think we would all benefit from a single script or location containing step-by-step build instructions. Right now, there are many moving parts:

• Repackage rust packages with apt-mirror
• Clone some source?
• Get a docker container (which arch should it run on?)
  CDN in China is a bit slow for people outside Asia Pacific

In the long run, would be great to get this upstreamed, even if it just means building the packages for arm64 and a generic iso.

Thank you!

VMs Error: KVM virtualisation configured, but not available. Either disable in VM configuration or enable in BIOS.

Hi,

when i run:

qm create 100 \
--name qemuvm \
--ostype l26 \
--cpu host \
--cores 1 \
--memory 1024 \
--scsihw virtio-scsi-pci \
--net0 virtio,bridge=vmbr0 \
--bios ovmf \
--efidisk0 local:0,efitype=4m,size=64M,format=qcow2 \
--serial0 socket \
--scsi0 local:0,import-from=/root/jammy-server-cloudimg-arm64.img,format=qcow2 \
--scsi1 local:cloudinit \
--ciuser root \
--cipassword rootroot \
--ipconfig0 ip=dhcp \
--boot order=scsi0 

I get the following error: KVM virtualisation configured, but not available. Either disable in VM configuration or enable in BIOS.

Im running on an Oracle ARM OCI.

Unable to download iso image

As the picture above, please update the download link(https://mirrors.apqa.cn/proxmox-edge/unofficialiso/proxmox-ve-arm64_7.3-1.iso), thank you very much

issues unpacking pve-firmware_3.6-4_all.deb

Unpacking pve-firmware (3.6-4) ...
dpkg: error processing archive /var/cache/apt/archives/pve-firmware_3.6-4_all.deb (--unpack):
trying to overwrite '/lib/firmware/ath11k/WCN6855/hw2.0/board-2.bin', which is also in package armbian-firmware 23.02.2
dpkg-deb: error: paste subprocess was killed by signal (Broken pipe)
Errors were encountered while processing:
/var/cache/apt/archives/pve-firmware_3.6-4_all.deb
E: Sub-process /usr/bin/dpkg returned an error code (1)

Installation Error

**I received an error while installing. Help me to fix. **

Backing up lvm.conf before setting pve-manager specific settings..
'/etc/lvm/lvm.conf' -> '/etc/lvm/lvm.conf.bak'
Setting 'global_filter' in /etc/lvm/lvm.conf to prevent zvols from being scanned:
global_filter=["a|.|"] => global_filter=["r|/dev/zd.|"]
Job for pvestatd.service failed because the control process exited with error code.
See "systemctl status pvestatd.service" and "journalctl -xe" for details.
dpkg: error processing package pve-manager (--configure):
installed pve-manager package post-installation script subprocess returned error exit status 1
dpkg: dependency problems prevent configuration of proxmox-ve:
proxmox-ve depends on pve-manager; however:
Package pve-manager is not configured yet.

dpkg: error processing package proxmox-ve (--configure):
dependency problems - leaving unconfigured
Processing triggers for initramfs-tools (0.140) ...
update-initramfs: Generating /boot/initrd.img-5.10.0-21-arm64
Processing triggers for libglib2.0-0:arm64 (2.66.8-1) ...
Processing triggers for libc-bin (2.31-13+deb11u5) ...
Processing triggers for rsyslog (8.2102.0-2+deb11u1) ...
Processing triggers for ufw (0.36-7.1) ...
Processing triggers for man-db (2.9.4-2) ...
Setting up glib-networking:arm64 (2.66.0-2) ...
Setting up libsoup2.4-1:arm64 (2.72.0-2) ...
Setting up gstreamer1.0-plugins-good:arm64 (1.18.4-2+deb11u1) ...
Processing triggers for proxmox-backup-file-restore (2.3.3-1) ...
Updating file-restore initramfs...
12253 blocks
Processing triggers for libgdk-pixbuf-2.0-0:arm64 (2.42.2+dfsg-1+deb11u1) ...
Processing triggers for libc-bin (2.31-13+deb11u5) ...
Errors were encountered while processing:
pve-manager
proxmox-ve
E: Sub-process /usr/bin/dpkg returned an error code (1)
root@proxmox:~# systemctl status pvestatd.service
● pvestatd.service - PVE Status Daemon
Loaded: loaded (/lib/systemd/system/pvestatd.service; enabled; vendor preset: enabled)
Active: failed (Result: exit-code) since Sat 2023-03-18 22:30:44 UTC; 35s ago
Process: 13572 ExecStart=/usr/bin/pvestatd start (code=exited, status=111)
CPU: 463ms

Mar 18 22:30:44 proxmox pvestatd[13572]: ipcc_send_rec[1] failed: Connection refused
Mar 18 22:30:44 proxmox pvestatd[13572]: ipcc_send_rec[2] failed: Connection refused
Mar 18 22:30:44 proxmox pvestatd[13572]: ipcc_send_rec[1] failed: Connection refused
Mar 18 22:30:44 proxmox pvestatd[13572]: ipcc_send_rec[3] failed: Connection refused
Mar 18 22:30:44 proxmox pvestatd[13572]: Unable to load access control list: Connection refused
Mar 18 22:30:44 proxmox pvestatd[13572]: ipcc_send_rec[2] failed: Connection refused
Mar 18 22:30:44 proxmox pvestatd[13572]: ipcc_send_rec[3] failed: Connection refused
Mar 18 22:30:44 proxmox systemd[1]: pvestatd.service: Control process exited, code=exited, status=111/n/a
Mar 18 22:30:44 proxmox systemd[1]: pvestatd.service: Failed with result 'exit-code'.
Mar 18 22:30:44 proxmox systemd[1]: Failed to start PVE Status Daemon.
root@proxmox:~# journalctl -xe
Mar 18 22:31:29 proxmox pveproxy[22580]: worker exit
Mar 18 22:31:29 proxmox pveproxy[22582]: /etc/pve/local/pve-ssl.key: failed to load local private key (key_file or key) at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 1996.
Mar 18 22:31:29 proxmox pveproxy[22581]: worker exit
Mar 18 22:31:29 proxmox pveproxy[13553]: worker 22580 finished
Mar 18 22:31:29 proxmox pveproxy[13553]: starting 1 worker(s)
Mar 18 22:31:29 proxmox pveproxy[13553]: worker 22583 started
Mar 18 22:31:29 proxmox pveproxy[13553]: worker 22581 finished
Mar 18 22:31:29 proxmox pveproxy[13553]: starting 1 worker(s)
Mar 18 22:31:29 proxmox pveproxy[13553]: worker 22584 started
Mar 18 22:31:29 proxmox pveproxy[22583]: /etc/pve/local/pve-ssl.key: failed to load local private key (key_file or key) at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 1996.
Mar 18 22:31:29 proxmox pveproxy[22584]: /etc/pve/local/pve-ssl.key: failed to load local private key (key_file or key) at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 1996.
Mar 18 22:31:34 proxmox pveproxy[22582]: worker exit
Mar 18 22:31:34 proxmox pveproxy[13553]: worker 22582 finished
Mar 18 22:31:34 proxmox pveproxy[13553]: starting 1 worker(s)
Mar 18 22:31:34 proxmox pveproxy[13553]: worker 22585 started
Mar 18 22:31:34 proxmox pveproxy[22583]: worker exit
Mar 18 22:31:34 proxmox pveproxy[22585]: /etc/pve/local/pve-ssl.key: failed to load local private key (key_file or key) at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 1996.
Mar 18 22:31:34 proxmox pveproxy[22584]: worker exit
Mar 18 22:31:34 proxmox pveproxy[13553]: worker 22583 finished
Mar 18 22:31:34 proxmox pveproxy[13553]: starting 1 worker(s)
Mar 18 22:31:34 proxmox pveproxy[13553]: worker 22586 started
Mar 18 22:31:34 proxmox pveproxy[13553]: worker 22584 finished
Mar 18 22:31:34 proxmox pveproxy[13553]: starting 1 worker(s)
Mar 18 22:31:34 proxmox pveproxy[13553]: worker 22587 started
Mar 18 22:31:34 proxmox pveproxy[22586]: /etc/pve/local/pve-ssl.key: failed to load local private key (key_file or key) at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 1996.
Mar 18 22:31:34 proxmox pveproxy[22587]: /etc/pve/local/pve-ssl.key: failed to load local private key (key_file or key) at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 1996.
Mar 18 22:31:39 proxmox pveproxy[22585]: worker exit
Mar 18 22:31:39 proxmox pveproxy[13553]: worker 22585 finished
Mar 18 22:31:39 proxmox pveproxy[13553]: starting 1 worker(s)
Mar 18 22:31:39 proxmox pveproxy[13553]: worker 22588 started
Mar 18 22:31:39 proxmox pveproxy[22586]: worker exit
Mar 18 22:31:39 proxmox pveproxy[22588]: /etc/pve/local/pve-ssl.key: failed to load local private key (key_file or key) at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 1996.
Mar 18 22:31:39 proxmox pveproxy[22587]: worker exit
Mar 18 22:31:39 proxmox pveproxy[13553]: worker 22586 finished
Mar 18 22:31:39 proxmox pveproxy[13553]: starting 1 worker(s)
Mar 18 22:31:39 proxmox pveproxy[13553]: worker 22589 started
Mar 18 22:31:39 proxmox pveproxy[13553]: worker 22587 finished
Mar 18 22:31:39 proxmox pveproxy[13553]: starting 1 worker(s)
Mar 18 22:31:39 proxmox pveproxy[13553]: worker 22590 started
Mar 18 22:31:39 proxmox pveproxy[22589]: /etc/pve/local/pve-ssl.key: failed to load local private key (key_file or key) at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 1996.
Mar 18 22:31:39 proxmox pveproxy[22590]: /etc/pve/local/pve-ssl.key: failed to load local private key (key_file or key) at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 1996.

Sub-process /usr/bin/dpkg returned an error code (1)

Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
proxmox-ve is already the newest version (7.3-1).
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
3 not fully installed or removed.
Need to get 0 B/89.9 MB of archives.
After this operation, 0 B of additional disk space will be used.
Setting up pve-manager (7.4-16) ...
export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/binJob for pvestatd.service failed because the control process exited with error code.
See "systemctl status pvestatd.service" and "journalctl -xe" for details.
dpkg: error processing package pve-manager (--configure):
installed pve-manager package post-installation script subprocess returned error exit status 1
dpkg: dependency problems prevent configuration of proxmox-ve:
proxmox-ve depends on pve-manager; however:
Package pve-manager is not configured yet.

dpkg: error processing package proxmox-ve (--configure):
dependency problems - leaving unconfigured
Errors were encountered while processing:
pve-manager
proxmox-ve
N: Ignoring file 'pve-firmware_3.6-4_all.deb' in directory '/etc/apt/sources.list.d/' as it has an invalid filename extension
E: Sub-process /usr/bin/dpkg returned an error code (1)
W: Operation was interrupted before it could finish
尝试了其它issues里的方法，但还是无法安装

Does not install on Orange Pi 5

I'm using Orange Pi 5 with Armbian Debian, kernel 6.5 edge.

At the end of the command it displays an error:
apt install proxmox-ve postfix open-iscsi

I used the wiki as an installation reference:
https://github.com/jiangcuo/Proxmox-Arm64/wiki/Install-Proxmox-VE-on-Debian-bullseye

Creating config file /etc/perl/XML/SAX/ParserDetails.ini with new version
Setting up open-iscsi (2.1.3-5) ...
Created symlink /etc/systemd/system/sysinit.target.wants/iscsid.service → /lib/systemd/system/iscsid.service.
Created symlink /etc/systemd/system/iscsi.service → /lib/systemd/system/open-iscsi.service.
Created symlink /etc/systemd/system/sysinit.target.wants/open-iscsi.service → /lib/systemd/system/open-iscsi.service.
Setting up libwbclient0:arm64 (2:4.13.13+dfsg-1~deb11u5) ...
Setting up libjson-glib-1.0-0:arm64 (1.6.2-1) ...
Setting up libbytes-random-secure-perl (0.29-1) ...
Setting up libvirglrenderer1:arm64 (0.8.2-5+deb11u1) ...
Setting up proxmox-backup-client (2.4.1-1) ...
Setting up liblttng-ust-ctl4:arm64 (2.12.1-1) ...
Setting up libknet1:arm64 (1.24-pve2) ...
Setting up shared-mime-info (2.0-1) ...
Setting up python3-requests (2.25.1+dfsg-2) ...
Setting up swtpm (0.8.0~bpo11+3) ...
Setting up python3-ldb (2:2.2.3-2~deb11u2) ...
Setting up thin-provisioning-tools (0.9.0-1) ...
Setting up libqt5core5a:arm64 (5.15.2+dfsg-9) ...
Setting up libtemplate-perl (2.27-1+b3) ...
Setting up libxml-libxml-perl (2.0134+dfsg-2+b1) ...
update-perl-sax-parsers: Registering Perl SAX parser XML::LibXML::SAX::Parser with priority 50...
update-perl-sax-parsers: Registering Perl SAX parser XML::LibXML::SAX with priority 50...
update-perl-sax-parsers: Updating overall Perl SAX parser modules info file...
Replacing config file /etc/perl/XML/SAX/ParserDetails.ini with new version
Setting up libwww-robotrules-perl (6.02-1) ...
Setting up criu (3.16-2) ...
Setting up libqt5dbus5:arm64 (5.15.2+dfsg-9) ...
Setting up libhtml-parser-perl (3.75-1+b1) ...
Setting up libxslt1.1:arm64 (1.1.34-4+deb11u1) ...
Setting up libcrypt-ssleay-perl (0.73.06-1+b3) ...
Setting up libsndfile1:arm64 (1.0.31-2) ...
Setting up liblttng-ust0:arm64 (2.12.1-1) ...
Setting up libiscsi7:arm64 (1.19.0-3) ...
Setting up libgfrpc0:arm64 (9.2-1) ...
Setting up libavahi-client3:arm64 (0.8-5+deb11u2) ...
Setting up libio-socket-ssl-perl (2.069-1) ...
Setting up libhttp-message-perl (6.28-1) ...
Setting up gnutls-bin (3.7.1-5+deb11u3) ...
Setting up libhttp-negotiate-perl (6.01-1) ...
Setting up librados2 (17.2.6-pve1) ...
Setting up libhttp-cookies-perl (6.10-1) ...
Setting up libpulse0:arm64 (14.2-2) ...
Setting up libgfchangelog0:arm64 (9.2-1) ...
Setting up libhtml-tree-perl (5.07-2) ...
Setting up libspice-server1:arm64 (0.14.3-2.1) ...
Setting up xsltproc (1.1.34-4+deb11u1) ...
Setting up cifs-utils (2:6.11-3.1+deb11u1) ...
update-alternatives: using /usr/lib/aarch64-linux-gnu/cifs-utils/idmapwb.so to provide /etc/cifs-utils/idmap-plugin (idmap-plugin) in auto mode
Setting up libqt5network5:arm64 (5.15.2+dfsg-9) ...
Setting up libcephfs2 (17.2.6-pve1) ...
Setting up swtpm-tools (0.8.0~bpo11+3) ...
Adding group `tss' (GID 121) ...
Done.
Warning: The home dir /var/lib/tpm you specified can't be accessed: No such file or directory
Adding system user `tss' (UID 112) ...
Adding new user `tss' (UID 112) with group `tss' ...
Not creating home directory `/var/lib/tpm'.
Setting up libradosstriper1 (17.2.6-pve1) ...
Setting up lxc-pve (5.0.2-2) ...
Created symlink /etc/systemd/system/multi-user.target.wants/lxc-monitord.service → /lib/systemd/system/lxc-monitord.service.
Created symlink /etc/systemd/system/multi-user.target.wants/lxc-net.service → /lib/systemd/system/lxc-net.service.
Created symlink /etc/systemd/system/multi-user.target.wants/lxc.service → /lib/systemd/system/lxc.service.
Setting up librbd1 (17.2.6-pve1) ...
Setting up libgfapi0:arm64 (9.2-1) ...
Setting up libcups2:arm64 (2.3.3op2-3+deb11u2) ...
Setting up libhttp-daemon-perl (6.12-1+deb11u1) ...
Setting up libthrift-0.13.0 (0.13.0-6) ...
Setting up glusterfs-common (9.2-1) ...
Adding group `gluster' (GID 122) ...
Done.
Setting up ceph-fuse (17.2.6-pve1) ...
Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target.
Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target.
Setting up corosync (3.1.7-pve1) ...
Created symlink /etc/systemd/system/multi-user.target.wants/corosync.service → /lib/systemd/system/corosync.service.
Setting up python3-rados (17.2.6-pve1) ...
Setting up librgw2 (17.2.6-pve1) ...
Setting up python3-rbd (17.2.6-pve1) ...
Setting up samba-libs:arm64 (2:4.13.13+dfsg-1~deb11u5) ...
Setting up glusterfs-client (9.2-1) ...
Setting up libsmbclient:arm64 (2:4.13.13+dfsg-1~deb11u5) ...
Setting up smbclient (2:4.13.13+dfsg-1~deb11u5) ...
Setting up python3-rgw (17.2.6-pve1) ...
Setting up python3-cephfs (17.2.6-pve1) ...
Setting up ceph-common (17.2.6-pve1) ...
Adding group ceph....done
Adding system user ceph....done
Setting system user ceph properties....done
chown: cannot access '/var/log/ceph/*.log*': No such file or directory
Setting file flags is only supported on regular files and directories, cannot set on '/var/log/journal'.
Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target.
Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service.
Setting up pve-qemu-kvm (7.2.0-8) ...
Setting up spiceterm (3.2-2) ...
Setting up liblwp-protocol-https-perl (6.10-1) ...
Setting up libwww-perl (6.52-1) ...
Setting up libproxmox-acme-perl (1.4.4) ...
Setting up libpve-apiclient-perl (3.2-1) ...
Setting up liblvm2cmd2.03:arm64 (2.03.11-2.1) ...
Setting up dmeventd (2:1.02.175-2.1) ...
Created symlink /etc/systemd/system/sockets.target.wants/dm-event.socket → /lib/systemd/system/dm-event.socket.
dm-event.service is a disabled or a static unit, not starting it.
Setting up libxml-parser-perl:arm64 (2.46-2) ...
Setting up libxml-twig-perl (1:3.52-1) ...
Setting up libnet-dbus-perl (1.2.0-1+b1) ...
Setting up libpve-common-perl (7.4-2) ...
Setting up lvm2 (2.03.11-2.1) ...
update-initramfs: deferring update (trigger activated)
Created symlink /etc/systemd/system/sysinit.target.wants/blk-availability.service → /lib/systemd/system/blk-availability.service.Created symlink /etc/systemd/system/sysinit.target.wants/lvm2-monitor.service → /lib/systemd/system/lvm2-monitor.service.
Created symlink /etc/systemd/system/sysinit.target.wants/lvm2-lvmpolld.socket → /lib/systemd/system/lvm2-lvmpolld.socket.
Setting up pve-cluster (7.3-3) ...
Created symlink /etc/systemd/system/multi-user.target.wants/pve-cluster.service → /lib/systemd/system/pve-cluster.service.
Job for pve-cluster.service failed because the control process exited with error code.
See "systemctl status pve-cluster.service" and "journalctl -xe" for details.
Setting up libpve-cluster-perl (7.3-3) ...
Setting up libpve-http-server-perl (4.2-3) ...
Setting up libpve-access-control (7.4.1) ...
Setting up libpve-cluster-api-perl (7.3-3) ...
Setting up librados2-perl (1.3-1) ...
Setting up libpve-storage-perl (7.4-3) ...
Setting up pve-firewall (4.3-4) ...
Created symlink /etc/systemd/system/multi-user.target.wants/pvefw-logger.service → /lib/systemd/system/pvefw-logger.service.
Created symlink /etc/systemd/system/multi-user.target.wants/pve-firewall.service → /lib/systemd/system/pve-firewall.service.
Job for pve-firewall.service failed because the control process exited with error code.
See "systemctl status pve-firewall.service" and "journalctl -xe" for details.
Job for pve-firewall.service failed because the control process exited with error code.
See "systemctl status pve-firewall.service" and "journalctl -xe" for details.
Setting up libpve-guest-common-perl (4.2-4) ...
Setting up pve-container (4.4-6) ...
Setting up pve-ha-manager (3.6.1) ...
watchdog-mux.service is a disabled or a static unit, not starting it.
Created symlink /etc/systemd/system/multi-user.target.wants/pve-ha-lrm.service → /lib/systemd/system/pve-ha-lrm.service.
Job for pve-ha-lrm.service failed because the control process exited with error code.
See "systemctl status pve-ha-lrm.service" and "journalctl -xe" for details.
Created symlink /etc/systemd/system/multi-user.target.wants/pve-ha-crm.service → /lib/systemd/system/pve-ha-crm.service.
Job for pve-ha-crm.service failed because the control process exited with error code.
See "systemctl status pve-ha-crm.service" and "journalctl -xe" for details.
Setting up qemu-server (7.4-4+pve1) ...
Created symlink /etc/systemd/system/multi-user.target.wants/qmeventd.service → /lib/systemd/system/qmeventd.service.
Setting up pve-manager (7.4-16) ...

Configuration file '/etc/apt/sources.list.d/pveport.list'
 ==> File on system created by you or by a script.
 ==> File also in package provided by package maintainer.
   What would you like to do about it ?  Your options are:
    Y or I  : install the package maintainer's version
    N or O  : keep your currently-installed version
      D     : show the differences between the versions
      Z     : start a shell to examine the situation
 The default action is to keep your current version.
*** pveport.list (Y/I/N/O/D/Z) [default=N] ? y
Installing new version of config file /etc/apt/sources.list.d/pveport.list ...
Installing new version of config file /etc/network/if-post-down.d/vlan ...
Installing new version of config file /etc/network/if-pre-up.d/vlan ...
ipcc_send_rec[1] failed: Connection refused
ipcc_send_rec[2] failed: Connection refused
ipcc_send_rec[3] failed: Connection refused
Unable to load access control list: Connection refused
Created symlink /etc/systemd/system/multi-user.target.wants/pvedaemon.service → /lib/systemd/system/pvedaemon.service.
Created symlink /etc/systemd/system/multi-user.target.wants/pveproxy.service → /lib/systemd/system/pveproxy.service.
Created symlink /etc/systemd/system/multi-user.target.wants/spiceproxy.service → /lib/systemd/system/spiceproxy.service.
Created symlink /etc/systemd/system/multi-user.target.wants/pvestatd.service → /lib/systemd/system/pvestatd.service.
Created symlink /etc/systemd/system/getty.target.wants/pvebanner.service → /lib/systemd/system/pvebanner.service.
Created symlink /etc/systemd/system/multi-user.target.wants/pvescheduler.service → /lib/systemd/system/pvescheduler.service.
Created symlink /etc/systemd/system/timers.target.wants/pve-daily-update.timer → /lib/systemd/system/pve-daily-update.timer.
Created symlink /etc/systemd/system/sysinit.target.wants/pvenetcommit.service → /lib/systemd/system/pvenetcommit.service.
Created symlink /etc/systemd/system/pve-manager.service → /lib/systemd/system/pve-guests.service.
Created symlink /etc/systemd/system/multi-user.target.wants/pve-guests.service → /lib/systemd/system/pve-guests.service.
Backing up lvm.conf before setting pve-manager specific settings..
'/etc/lvm/lvm.conf' -> '/etc/lvm/lvm.conf.bak'
Setting 'global_filter' in /etc/lvm/lvm.conf to prevent zvols from being scanned:
global_filter=["a|.*|"] => global_filter=["r|/dev/zd.*|"]
Job for pvestatd.service failed because the control process exited with error code.
See "systemctl status pvestatd.service" and "journalctl -xe" for details.
dpkg: error processing package pve-manager (--configure):
 installed pve-manager package post-installation script subprocess returned error exit status 1
dpkg: dependency problems prevent configuration of proxmox-ve:
 proxmox-ve depends on pve-manager; however:
  Package pve-manager is not configured yet.

dpkg: error processing package proxmox-ve (--configure):
 dependency problems - leaving unconfigured
Processing triggers for fontconfig (2.13.1-4.2) ...
Processing triggers for initramfs-tools (0.140) ...
ln: failed to create hard link '/boot/initrd.img-6.5.0-rc5-edge-rockchip-rk3588.dpkg-bak' => '/boot/initrd.img-6.5.0-rc5-edge-rockchip-rk3588': Operation not permitted
update-initramfs: Generating /boot/initrd.img-6.5.0-rc5-edge-rockchip-rk3588
update-initramfs: Armbian: Converting to u-boot format: /boot/uInitrd-6.5.0-rc5-edge-rockchip-rk3588
Image Name:   uInitrd
Created:      Wed Sep 27 13:03:08 2023
Image Type:   AArch64 Linux RAMDisk Image (gzip compressed)
Data Size:    30158440 Bytes = 29451.60 KiB = 28.76 MiB
Load Address: 00000000
Entry Point:  00000000
update-initramfs: Armbian: Symlinking /boot/uInitrd-6.5.0-rc5-edge-rockchip-rk3588 to /boot/uInitrd
ln: failed to create symbolic link '/boot/uInitrd': Operation not permitted
update-initramfs: Symlink failed, moving /boot/uInitrd-6.5.0-rc5-edge-rockchip-rk3588 to /boot/uInitrd
renamed '/boot/uInitrd-6.5.0-rc5-edge-rockchip-rk3588' -> '/boot/uInitrd'
update-initramfs: Armbian: done.
Running hook script 'zz-proxmox-boot'..
Re-executing '/etc/kernel/postinst.d/zz-proxmox-boot' in new private mount namespace..
No /etc/kernel/proxmox-boot-uuids found, skipping ESP sync.
Processing triggers for libc-bin (2.31-13+deb11u6) ...
Processing triggers for rsyslog (8.2102.0-2+deb11u1) ...
Processing triggers for man-db (2.9.4-2) ...
Processing triggers for pve-ha-manager (3.6.1) ...
Errors were encountered while processing:
 pve-manager
 proxmox-ve
E: Sub-process /usr/bin/dpkg returned an error code (1)
root@orangepi5:~# 

A issue with pveceph installation

I only do this by compiling ceph [https://git.proxmox.com/git/ceph.git]???

Getting ZFS Working

Hello, I'm looking to get ZFS working. This is on a Raspberry Pi 4. I generally followed the instructions here for a fresh install.
https://gist.github.com/gtx28/059ac9a0c85e722225c6d5150d659dec

Thanks for the help and thanks for getting Proxmox 8 working on the Pi!

Here is what I've tried.

$ sudo apt install zfs-dkms zfsutils-linux
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
The following additional packages will be installed:
  zfs-zed
Suggested packages:
  debhelper nfs-kernel-server samba-common-bin zfs-initramfs
The following NEW packages will be installed:
  zfs-dkms zfs-zed zfsutils-linux
0 upgraded, 3 newly installed, 0 to remove and 0 not upgraded.
Need to get 2,841 kB of archives.
After this operation, 20.5 MB of additional disk space will be used.
Do you want to continue? [Y/n] y
Get:1 http://deb.debian.org/debian bookworm/contrib arm64 zfs-dkms all 2.1.11-1 [2,304 kB]
Get:2 https://global.mirrors.apqa.cn/proxmox/debian/pve bookworm/port arm64 zfsutils-linux arm64 2.1.12-pve1 [473 kB]
Get:3 https://global.mirrors.apqa.cn/proxmox/debian/pve bookworm/port arm64 zfs-zed arm64 2.1.12-pve1 [63.8 kB]
Fetched 2,841 kB in 2s (1,166 kB/s)
Preconfiguring packages ...
Selecting previously unselected package zfs-dkms.
(Reading database ... 64528 files and directories currently installed.)
Preparing to unpack .../zfs-dkms_2.1.11-1_all.deb ...
Unpacking zfs-dkms (2.1.11-1) ...
Selecting previously unselected package zfsutils-linux.
Preparing to unpack .../zfsutils-linux_2.1.12-pve1_arm64.deb ...
Unpacking zfsutils-linux (2.1.12-pve1) ...
Selecting previously unselected package zfs-zed.
Preparing to unpack .../zfs-zed_2.1.12-pve1_arm64.deb ...
Unpacking zfs-zed (2.1.12-pve1) ...
Setting up zfsutils-linux (2.1.12-pve1) ...
zfs-import-scan.service is a disabled or a static unit, not starting it.
Setting up zfs-dkms (2.1.11-1) ...
Loading new zfs-2.1.11 DKMS files...
Building for 6.1.21-v8+
Module build for kernel 6.1.21-v8+ was skipped since the
kernel headers for this kernel do not seem to be installed.
Setting up zfs-zed (2.1.12-pve1) ...
Processing triggers for man-db (2.11.2-2) ...
Processing triggers for initramfs-tools (0.142) ...
$ sudo modprobe zfs
modprobe: FATAL: Module zfs not found in directory /lib/modules/6.1.21-v8+
$ sudo apt install dpkg-dev raspberrypi-kernel-headers linux-image-arm64
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
E: Unable to locate package raspberrypi-kernel-headers

pveproxy oom on ps225-8G

[   64.647345] SLUB: Unable to allocate memory on node -1, gfp=0x15004c0(GFP_KERNEL_ACCOUNT|__GFP_RETRY_MAYFAIL)
[   64.647347]   cache: kmalloc-256(351:pveproxy.service), object size: 256, buffer size: 256, default order: 1, min order: 0
[   64.647348]   node 0: slabs: 3, objs: 96, free: 0
[   65.342797] pveproxy worker invoked oom-killer: gfp_mask=0x14080c0(GFP_KERNEL|__GFP_ZERO), nodemask=(null),  order=0, oom_score_adj=0
[   65.342801] pveproxy worker cpuset=/ mems_allowed=0
[   65.342806] CPU: 7 PID: 7318 Comm: pveproxy worker Tainted: G           O    4.14.79 #1
[   65.342807] Hardware name: BRCM BRCM-SR/BRCM-SR, BIOS 0.1 Feb 22 2019
[   65.342809] Call trace:
[   65.342819] [<ffff000008089a98>] dump_backtrace+0x0/0x398
[   65.342821] [<ffff000008089e44>] show_stack+0x14/0x20
[   65.342825] [<ffff00000883c0fc>] dump_stack+0x90/0xb4
[   65.342828] [<ffff000008171abc>] dump_header+0x8c/0x1d0
[   65.342830] [<ffff000008170f1c>] oom_kill_process+0x274/0x520
[   65.342831] [<ffff0000081717ec>] out_of_memory+0xfc/0x2d0
[   65.342833] [<ffff000008176988>] __alloc_pages_nodemask+0xb10/0xba0
[   65.342835] [<ffff00000819ee14>] __handle_mm_fault+0xe04/0x10f8
[   65.342836] [<ffff00000819f1d0>] handle_mm_fault+0xc8/0x170
[   65.342839] [<ffff000008855938>] do_page_fault+0x1f0/0x418
[   65.342840] [<ffff000008855b9c>] do_translation_fault+0x3c/0x44
[   65.342841] [<ffff000008081434>] do_mem_abort+0x3c/0xa0
[   65.342842] [<ffff000008081520>] do_el0_ia_bp_hardening+0x38/0x98
[   65.342843] Exception stack(0xffff00000af83ec0 to 0xffff00000af84000)
[   65.342845] 3ec0: 0000ffffb8e86c80 0000000000000000 0000ffffb8c64240 51d87ebacc46acae
[   65.342846] 3ee0: 0000aaab05b78380 0000000000000002 0000000000000007 0000000000000000
[   65.342848] 3f00: 0000ffffba7d6640 00000000ffffffff 0000000000000000 0000000000000038
[   65.342849] 3f20: 0000ffffb8e88c80 0000000000000000 0000ffffd353ec11 0000000000000000
[   65.342850] 3f40: 0000000000000000 0000000000000000 0000000000000011 0000aaab05ba0b80
[   65.342851] 3f60: 0000ffffba6b1000 00000000000001aa 0000ffffba6af000 0000ffffba6b2068
[   65.342852] 3f80: 0000000000000000 0000ffffba6af000 0000ffffba7d6638 0000ffffba6b06b8
[   65.342853] 3fa0: 000000000000000c 0000ffffd353f000 0000ffffba57678c 0000ffffd353f000
[   65.342854] 3fc0: 0000ffffb8c64240 0000000060000000 000000000000000f 00000000ffffffff
[   65.342855] 3fe0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[   65.342857] [<ffff000008083688>] el0_ia+0x18/0x1c
[   65.342858] Mem-Info:
[   65.342862] active_anon:261137 inactive_anon:7078 isolated_anon:0
                active_file:356 inactive_file:364 isolated_file:0
                unevictable:0 dirty:0 writeback:0 unstable:0
                slab_reclaimable:4533 slab_unreclaimable:13344
                mapped:7659 shmem:7172 pagetables:1634 bounce:0
                free:21266 free_pcp:564 free_cma:12805
[   65.342866] Node 0 active_anon:1044548kB inactive_anon:28312kB active_file:1424kB inactive_file:1456kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:30636kB dirty:0kB writeback:0kB shmem:28688kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 4096kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no
[   65.342870] DMA free:63616kB min:8616kB low:10768kB high:12920kB active_anon:1044548kB inactive_anon:28312kB active_file:1512kB inactive_file:1504kB unevictable:0kB writepending:0kB present:2063232kB managed:1452560kB mlocked:0kB kernel_stack:2160kB pagetables:6500kB bounce:0kB free_pcp:2256kB local_pcp:200kB free_cma:51220kB
[   65.342870] lowmem_reserve[]: 0 5995 5995
[   65.342874] Normal free:21448kB min:36436kB low:45544kB high:54652kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:6287360kB managed:6139560kB mlocked:0kB kernel_stack:1168kB pagetables:36kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
[   65.342874] lowmem_reserve[]: 0 0 0
[   65.342876] DMA: 729*4kB (UMEC) 252*8kB (UMEC) 86*16kB (UMEC) 45*32kB (UEC) 27*64kB (UEC) 9*128kB (UEC) 1*256kB (E) 1*512kB (U) 1*1024kB (C) 1*2048kB (E) 12*4096kB (C) = 63620kB
[   65.342887] Normal: 116*4kB (UMH) 135*8kB (UMEH) 78*16kB (UME) 55*32kB (UMEH) 28*64kB (UMEH) 8*128kB (UME) 3*256kB (MEH) 4*512kB (MEH) 1*1024kB (E) 1*2048kB (M) 2*4096kB (M) = 21448kB
[   65.342898] Node 0 hugepages_total=3072 hugepages_free=3072 hugepages_surp=0 hugepages_size=2048kB
[   65.342899] 7930 total pagecache pages
[   65.342899] 2087648 pages RAM
[   65.342900] 0 pages HighMem/MovableOnly
[   65.342900] 189618 pages reserved
[   65.342901] 16384 pages cma reserved
[   65.342901] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
[   65.342904] [ 1213]     0  1213     8175      229      16       4        0          -250 systemd-journal
[   65.342906] [ 1804]     0  1804     5615     1161      10       3        0         -1000 systemd-udevd
[   65.342907] [ 6352]   105  6352     2020      110       8       3        0             0 rpcbind
[   65.342909] [ 6354]   103  6354     1953      133       7       4        0          -900 dbus-daemon
[   65.342911] [ 6358]     0  6358    37721       42       9       4        0         -1000 lxcfs
[   65.342912] [ 6360]     0  6360    69177      565      15       5        0             0 pve-lxc-syscall
[   65.342913] [ 6366]     0  6366    55219      272      12       4        0             0 rsyslogd
[   65.342915] [ 6367]     0  6367     2557      253       9       3        0             0 smartd
[   65.342916] [ 6368]     0  6368     3590      206      11       4        0             0 systemd-logind
[   65.342917] [ 6372]     0  6372     1007       34       6       4        0             0 qmeventd
[   65.342918] [ 6373]     0  6373      451       15       5       3        0         -1000 watchdog-mux
[   65.342920] [ 6962]     0  6962     2996      160      10       4        0             0 lxc-monitord
[   65.342921] [ 6969]     0  6969      624       26       5       3        0             0 agetty
[   65.342922] [ 6972]     0  6972     2742      166       9       4        0             0 login
[   65.342923] [ 7233]     0  7233    43790      271      23       4        0             0 rrdcached
[   65.342924] [ 7248]   108  7248     4702      240      13       3        0             0 exim4
[   65.342926] [ 7251]     0  7251   158458     8075      67       5        0             0 pmxcfs
[   65.342927] [ 7257]     0  7257     1395       52       7       3        0             0 cron
[   65.342928] [ 7269]     0  7269     4034      336      13       3        0             0 systemd
[   65.342929] [ 7270]     0  7270    42170      758      18       5        0             0 (sd-pam)
[   65.342931] [ 7285]     0  7285     1461      140       7       3        0             0 bash
[   65.342932] [ 7289]     0  7289     3407      241      11       4        0         -1000 sshd
[   65.342933] [ 7290]     0  7290    36525    21872      67       4        0             0 pve-firewall
[   65.342934] [ 7291]     0  7291    35166    20539      65       4        0             0 pvestatd
[   65.342936] [ 7305]     0  7305    54273    31163      90       4        0             0 pvedaemon
[   65.342937] [ 7306]     0  7306    54400    31230      91       4        0             0 pvedaemon worke
[   65.342938] [ 7307]     0  7307    54396    31230      91       4        0             0 pvedaemon worke
[   65.342939] [ 7308]     0  7308    54396    31230      91       4        0             0 pvedaemon worke
[   65.342940] [ 7313]     0  7313    51240    25233      82       3        0             0 pve-ha-crm
[   65.342942] [ 7314]     0  7314     3993      309      11       4        0             0 sshd
[   65.342943] [ 7316]    33  7316    54621    31528      91       4        0             0 pveproxy
[   65.342944] [ 7317]    33  7317    54833    31653      92       4        0             0 pveproxy worker
[   65.342945] [ 7318]    33  7318    54834    31856      92       4        0             0 pveproxy worker
[   65.342947] [ 7319]    33  7319    54833    31927      92       4        0             0 pveproxy worker
[   65.342948] [ 7325]    33  7325    19039    12350      39       4        0             0 spiceproxy
[   65.342949] [ 7326]    33  7326    19187    12416      39       4        0             0 spiceproxy work
[   65.342950] [ 7327]     0  7327    51083    25088      80       3        0             0 pve-ha-lrm
[   65.342952] [ 7333]     0  7333    49886    25689      82       4        0             0 pvescheduler
[   65.342953] [ 7356]     0  7356      988      132       6       4        0             0 bash
[   65.342954] [ 7374]     0  7374     1680       58       8       3        0             0 systemctl
[   65.342955] [ 7375]     0  7375     3468      148      10       4        0             0 systemd-tty-ask
[   65.342956] [ 7376]     0  7376    54564    31470     100       4        0             0 pveproxy
[   65.342958] Out of memory: Kill process 7319 (pveproxy worker) score 16 or sacrifice child
[   65.342964] Killed process 7319 (pveproxy worker) total-vm:219332kB, anon-rss:126612kB, file-rss:1096kB, shmem-rss:0kB
[   65.357145] oom_reaper: reaped process 7319 (pveproxy worker), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
[   66.174295] pveproxy worker cpuset=/ mems_allowed=0
[   66.179335] CPU: 6 PID: 7317 Comm: pveproxy worker Tainted: G           O    4.14.79 #1
[   66.187592] Hardware name: BRCM BRCM-SR/BRCM-SR, BIOS 0.1 Feb 22 2019
[   66.194235] Call trace:
[   66.196765] [<ffff000008089a98>] dump_backtrace+0x0/0x398
[   66.202334] [<ffff000008089e44>] show_stack+0x14/0x20
[   66.207546] [<ffff00000883c0fc>] dump_stack+0x90/0xb4
[   66.212757] [<ffff000008175d78>] warn_alloc+0xe8/0x180
[   66.218056] [<ffff00000817696c>] __alloc_pages_nodemask+0xaf4/0xba0
[   66.224522] [<ffff0000081bf060>] new_slab+0x360/0x428
[   66.229733] [<ffff0000081c0ecc>] ___slab_alloc.constprop.33+0x254/0x338
[   66.236556] [<ffff0000081c147c>] kmem_cache_alloc+0x124/0x160
[   66.242485] [<ffff000008720f6c>] __alloc_skb+0x3c/0x168
[   66.247874] [<ffff00000872281c>] alloc_skb_with_frags+0x54/0x218
[   66.254070] [<ffff000008719f08>] sock_alloc_send_pskb+0x1e8/0x200
[   66.260356] [<ffff0000087fb7d0>] unix_dgram_sendmsg+0xe8/0x5e0
[   66.266372] [<ffff000008717260>] sock_sendmsg+0x18/0x30
[   66.271760] [<ffff0000087172e4>] sock_write_iter+0x6c/0xb0
[   66.277418] [<ffff0000081db3d4>] __vfs_write+0xac/0x118
[   66.282807] [<ffff0000081db634>] vfs_write+0xa4/0x1b0
[   66.288016] [<ffff0000081db8f8>] SyS_write+0x48/0xb0
[   66.293136] Exception stack(0xffff00000ae03ec0 to 0xffff00000ae04000)
[   66.299779] 3ec0: 0000000000000007 0000aaab0a9d8640 0000000000000031 0000ffffba4f5800
[   66.307856] 3ee0: 0000aaaad9fda1d4 0000000010004403 0000000000000068 0000aaab035ef398
[   66.315933] 3f00: 0000000000000040 0000aaab0a9e8600 0000000000000000 0000000000000000
[   66.324010] 3f20: 0000aaab035ef398 0000aaab035ef3b0 0000000000000000 0000000000000038
[   66.332087] 3f40: 0000aaaada1c0408 0000ffffba6c7430 0000000000000000 0000000000000007
[   66.340164] 3f60: 0000aaab0a9e8600 0000000000000000 0000ffffba4f5f00 0000aaab0a9e8618
[   66.348241] 3f80: 0000aaab036086b0 0000000000000031 0000aaab0a9e8618 0000000000000007
[   66.356318] 3fa0: 0000000000000000 0000ffffd353ee10 0000aaaad9fa2ac8 0000ffffd353ee10
[   66.364394] 3fc0: 0000ffffba6c7460 0000000060000000 0000000000000007 0000000000000040
[   66.372471] 3fe0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[   66.380549] [<ffff000008083ac0>] el0_svc_naked+0x34/0x38
[   66.386035] warn_alloc_show_mem: 1 callbacks suppressed
[   66.386036] Mem-Info:
[   66.393775] active_anon:210887 inactive_anon:7078 isolated_anon:0
                active_file:202 inactive_file:2662 isolated_file:0
                unevictable:0 dirty:21 writeback:0 unstable:0
                slab_reclaimable:4557 slab_unreclaimable:13370
                mapped:8758 shmem:7172 pagetables:1350 bounce:0
                free:69205 free_pcp:604 free_cma:13948
[   66.428385] Node 0 active_anon:843548kB inactive_anon:28312kB active_file:808kB inactive_file:10648kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:35032kB dirty:84kB writeback:0kB shmem:28688kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 4096kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no
[   66.457078] DMA free:255496kB min:8616kB low:10768kB high:12920kB active_anon:843548kB inactive_anon:28312kB active_file:808kB inactive_file:10748kB unevictable:0kB writepending:92kB present:2063232kB managed:1452560kB mlocked:0kB kernel_stack:2112kB pagetables:5364kB bounce:0kB free_pcp:2284kB local_pcp:552kB free_cma:55792kB
[   66.486932] lowmem_reserve[]: 0 5995 5995
[   66.491074] Normal free:21324kB min:36436kB low:45544kB high:54652kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:6287360kB managed:6139560kB mlocked:0kB kernel_stack:1168kB pagetables:36kB bounce:0kB free_pcp:124kB local_pcp:0kB free_cma:0kB
[   66.518957] lowmem_reserve[]: 0 0 0
[   66.522559] DMA: 4216*4kB (UMEC) 2983*8kB (UMEC) 2048*16kB (UMEC) 1353*32kB (UMEC) 775*64kB (UMEC) 162*128kB (UMEC) 37*256kB (MEC) 9*512kB (UM) 1*1024kB (C) 2*2048kB (EC) 12*4096kB (C) = 255480kB
[   66.540512] Normal: 85*4kB (UMH) 135*8kB (UMEH) 78*16kB (UME) 55*32kB (UMEH) 28*64kB (UMEH) 8*128kB (UME) 3*256kB (MEH) 4*512kB (MEH) 1*1024kB (E) 1*2048kB (M) 2*4096kB (M) = 21324kB
[   66.557299] Node 0 hugepages_total=3072 hugepages_free=3072 hugepages_surp=0 hugepages_size=2048kB
[   66.566543] 10119 total pagecache pages
[   66.570501] 2087648 pages RAM
[   66.573565] 0 pages HighMem/MovableOnly
[   66.577523] 189618 pages reserved
[   66.580943] 16384 pages cma reserved
[   66.584634] SLUB: Unable to allocate memory on node -1, gfp=0x15004c0(GFP_KERNEL_ACCOUNT|__GFP_RETRY_MAYFAIL)
[   66.594864]   cache: kmalloc-256(351:pveproxy.service), object size: 256, buffer size: 256, default order: 1, min order: 0
[   66.606256]   node 0: slabs: 3, objs: 96, free: 0

Install proxmox 8 on Raspberry pi 4 with bookworm

I try to follow the wiki to install on a raspberry pi 4 with Bookworm. Unfortunately is stopped with this:

W: Skipping acquire of configured file 'port/binary-armhf/Packages' as repository 'https://global.mirrors.apqa.cn/proxmox/debian/pve bookworm InRelease' does not seem to provide it (sources.list entry misspelt?)

One CPU failed to come online in Raspi 4

Hi, I've been using this for awhile and just realized that 1 CPU is missing.

root@lemnicloud:~# cat /proc/cpuinfo 
processor	: 0
BogoMIPS	: 108.00
Features	: fp asimd evtstrm crc32 cpuid
CPU implementer	: 0x41
CPU architecture: 8
CPU variant	: 0x0
CPU part	: 0xd08
CPU revision	: 3

processor	: 2
BogoMIPS	: 108.00
Features	: fp asimd evtstrm crc32 cpuid
CPU implementer	: 0x41
CPU architecture: 8
CPU variant	: 0x0
CPU part	: 0xd08
CPU revision	: 3

processor	: 3
BogoMIPS	: 108.00
Features	: fp asimd evtstrm crc32 cpuid
CPU implementer	: 0x41
CPU architecture: 8
CPU variant	: 0x0
CPU part	: 0xd08
CPU revision	: 3

I saw this output in dmesg:

[    7.132666] CPU1: failed to come online
[    7.136495] CPU1: failed in unknown state : 0x0
[    7.141161] psci_checker: Error occurred (-5) while trying to power up CPU 1

I tried swapping operating system to Raspberry Pi OS to see if it's a hardware failure, but it seems to be fine in Raspberry Pi OS.

I used the ISO image for the installation

a method that would facilitate them all being simply listed / integrated into the system for simpler installation / better experience

          Thanks. Hmm, yes, I was hoping we could figure out a method that would facilitate them all being simply listed / integrated into the system for simpler installation / better experience. Hmmmmm.

Originally posted by @ylluminate in #38 (comment)

oragepi 5b

I have installed Debian (from the manufacturer) on my oragepi 5b on a sd card and started the setup after the wiki it only aborts the installation at this point with

Unpacking pve-firmware (3.6-4) ...
dpkg: error processing archive /tmp/apt-dpkg-install-7KrmaM/259-pve-firmware_3.6-4_all.deb (--unpack):
trying to overwrite '/lib/firmware/brcm/brcmfmac4329-sdio.bin', which is also in package orangepi-firmware 1.0.2
dpkg-deb: error: paste subprocess was killed by signal (Broken pipe)
Selecting previously unselected package pve-manager.
Preparing to unpack .../260-pve-manager_7.4-3_arm64.deb ...
Unpacking pve-manager (7.4-3) ...
Selecting previously unselected package proxmox-ve.
Preparing to unpack .../261-proxmox-ve_7.3-1_all.deb ...
Unpacking proxmox-ve (7.3-1) ...
Errors were encountered while processing:
/tmp/apt-dpkg-install-7KrmaM/259-pve-firmware_3.6-4_all.deb
E: Sub-process /usr/bin/dpkg returned an error code (1)
root@orangepi5b:~#

Translated with www.DeepL.com/Translator (free version)

PBS 3 support

Hey, PBS 3 is out. Are there any plans to support it?

https://www.proxmox.com/en/news/press-releases/proxmox-backup-server-3-0

DEB Request

Hello,

    I'm running an ARM server running on Debian on Cloud. Is there any way to develop Proxmox-VE on Deb package or Script? 

   Kindly consider our request. 

How can i change the kernel with pve-kernel on nanopi t6?

Hello,

I have a question actually i using a Linux 6.5.0-rc1-collabora-rockchip-rk3588 SMP PREEMPT_DYNAMIC Fri Jul 28 15:49:06 UTC 2023
my question is how can i use pve-kernel https://github.com/jiangcuo/pve-port-kernel

Thank you in advice.

Expired SSL certificate on https://mirrors.apqa.cn/

Hi,
the SSL certificate on https://mirrors.apqa.cn/ expired on 10/06/2023.
This prevent to install packages via apt.

Kunpeng 920arm page very stuck

After installing the Kunpeng 920arm server by following the tutorial, I found that when I used PVE web to create a VM, the VM installation guide page was very stuck

/etc/hosts/

Is this correct in /etc/hosts/?

127.0.0.1       localhost
192.168.1.107   raspberrypi.local raspberrypi
::1             localhost ip6-localhost ip6-loopback
ff02::1         ip6-allnodes
ff02::2         ip6-allrouters

Pcie passthrough problem

Hi

I get this message when i try and do a pcie passthrough.

No IOMMU detected, please activate it.See Documentation for further information.

i have added this in grub: GRUB_CMDLINE_LINUX_DEFAULT="quiet iommu.passthrough=1"
and this in /etc/modules
vfio
vfio_iommu_type1
vfio_pci
vfio_virqfd

How can i get this working ?

Kernel config to support SolidRun LX2K platforms

Hi, I do not have working Ethernet on SolidRun LX2K (Freescale/NXP QoriQ Ethernet);

A good start would be if we could add the following kernel configs?

• https://github.com/SolidRun/lx2160a_build/blob/master/configs/linux/lx2k_additions.config
• https://github.com/nxp-qoriq/linux/blob/LSDK-21.08/arch/arm64/configs/lsdk.config

Thank you!

Guest has not initialized the display on pve8 && No IOMMU detected

NanoPC-T6 rk3588
OS: Armbian (23.08.0-trunk) aarch64 Bookworm

related #20 #28
I've read the wiki in detail and the relevant issues , made the appropriate changes, but they don't work for me, my VM startup keeps getting stuck at Guest has not initialized the display (yet), and cpu 100%.

nanopct6:pve-edk2-firmware:# qm terminal 100
unable to find a serial interface
nanopct6:pve-edk2-firmware:# dpkg -l | grep pve-edk2
ii  pve-edk2-firmware                    3.20220526-1                            all          edk2 based UEFI firmware modules for virtual machines
nanopct6:pve-edk2-firmware:# ll  /usr/share/pve-edk2-firmware/AAVMF_CODE.fd
-rw-r--r-- 1 root root 64M Jul 19  2022 /usr/share/pve-edk2-firmware/AAVMF_CODE.fd
nanopct6:pve-edk2-firmware:# ll  /usr/share/pve-edk2-firmware/AAVMF_CODE.ms.fd
lrwxrwxrwx 1 root root 13 Aug 28 02:47 /usr/share/pve-edk2-firmware/AAVMF_CODE.ms.fd -> AAVMF_CODE.fd

qm showcmd

nanopct6:pve-edk2-firmware:# qm showcmd 100
/usr/bin/kvm -id 100 -name 'openwrt,debug-threads=on' -no-shutdown -chardev 'socket,id=qmp,path=/var/run/qemu-server/100.qmp,server=on,wait=off' -mon 'chardev=qmp,mode=control' -chardev 'socket,id=qmp-event,path=/var/run/qmeventd.sock,reconnect=5' -mon 'chardev=qmp-event,mode=control' -pidfile /var/run/qemu-server/100.pid -daemonize -smbios 'type=1,uuid=6ac35558-c03c-4c51-8c2e-cb8151fd96d5' -smp '4,sockets=1,cores=4,maxcpus=4' -nodefaults -boot 'menu=on,strict=on,reboot-timeout=1000,splash=/usr/share/qemu-server/bootsplash.jpg' -vnc 'unix:/var/run/qemu-server/100.vnc,password=on' -cpu host -m 4096 -object 'iothread,id=iothread-virtioscsi0' -device 'pci-bridge,id=pci.1,chassis_nr=1,bus=pcie.0,addr=0x1e' -device 'pci-bridge,id=pci.2,chassis_nr=2,bus=pcie.0,addr=0x1f' -device 'pci-bridge,id=pci.3,chassis_nr=3,bus=pcie.0,addr=0x5' -device 'qemu-xhci,id=qemu-xhci' -device 'usb-tablet,id=tablet,bus=qemu-xhci.0,port=1' -device 'usb-kbd,id=keyboard,bus=qemu-xhci.0,port=2' -readconfig /usr/share/qemu-server/pve-aarch64.cfg -device 'virtio-gpu,id=vga,bus=pcie.0,addr=0x2' -chardev 'socket,path=/var/run/qemu-server/100.qga,server=on,wait=off,id=qga0' -device 'virtio-serial,id=qga0,bus=pcie.0,addr=0x8' -device 'virtserialport,chardev=qga0,name=org.qemu.guest_agent.0' -device 'virtio-serial,id=spice,bus=pcie.0,addr=0x9' -chardev 'spicevmc,id=vdagent,name=vdagent' -device 'virtserialport,chardev=vdagent,name=com.redhat.spice.0' -spice 'tls-port=61001,addr=::1,tls-ciphers=HIGH,seamless-migration=on' -device 'virtio-balloon-pci,id=balloon0,bus=pcie.0,addr=0x3,free-page-reporting=on' -iscsi 'initiator-name=iqn.1993-08.org.debian:01:c0c49f78d50' -device 'virtio-scsi-pci,id=virtioscsi0,bus=pcie.3,addr=0x1,iothread=iothread-virtioscsi0' -drive 'file=/var/lib/vz/images/100/vm-100-disk-0.raw,if=none,id=drive-scsi0,format=raw,cache=none,aio=io_uring,detect-zeroes=on' -device 'scsi-hd,bus=virtioscsi0.0,channel=0,scsi-id=0,lun=0,drive=drive-scsi0,id=scsi0,bootindex=100' -netdev 'type=tap,id=net0,ifname=tap100i0,script=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on' -device 'virtio-net-pci,mac=A6:9D:CF:43:9B:4B,netdev=net0,bus=pcie.0,addr=0xb,id=net0,rx_queue_size=1024,tx_queue_size=1024,bootindex=101' -netdev 'type=tap,id=net1,ifname=tap100i1,script=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown,vhost=on' -device 'virtio-net-pci,mac=9A:A4:37:7A:89:86,netdev=net1,bus=pcie.1,addr=0x2,id=net1,rx_queue_size=1024,tx_queue_size=1024,bootindex=102' -machine 'type=virt+pve0,gic-version=host' -machine 'virt,gic-version=host'

pveversion --verbos

nanopct6:pve-edk2-firmware:# pveversion --verbos
proxmox-ve: 8.0.1 (running kernel: 5.10.160-legacy-rk35xx)
pve-manager: 8.0.3-1 (running version: 8.0.3-1/a8e18f85609c0f55)
ceph-fuse: 17.2.6-pve1+3
corosync: 3.1.7-pve3
criu: 3.17.1-2
glusterfs-client: 10.3-5
ifupdown: residual config
ifupdown2: 3.2.0-1+pmx3
libjs-extjs: 7.0.0-3
libknet1: 1.25-1
libproxmox-acme-perl: 1.4.6
libproxmox-backup-qemu0: 1.4.0
libproxmox-rs-perl: 0.3.0
libpve-access-control: 8.0.4
libpve-apiclient-perl: 3.3.1
libpve-common-perl: 8.0.6
libpve-guest-common-perl: 5.0.3
libpve-http-server-perl: 5.0.4
libpve-rs-perl: 0.8.3
libpve-storage-perl: 8.0.2
libspice-server1: 0.15.1-1
lvm2: 2.03.16-2
lxc-pve: 5.0.2-4
lxcfs: 5.0.3-pve3
novnc-pve: 1.4.0-2
proxmox-backup-client: 3.0.1-1
proxmox-backup-file-restore: 3.0.1-1
proxmox-kernel-helper: 8.0.2
proxmox-mail-forward: 0.2.0
proxmox-mini-journalreader: 1.4.0
proxmox-widget-toolkit: 4.0.6
pve-cluster: 8.0.2
pve-container: 5.0.4
pve-docs: 8.0.4
pve-edk2-firmware: 3.20220526-1
pve-firewall: 5.0.3
pve-firmware: not correctly installed
pve-ha-manager: 4.0.2
pve-i18n: 3.0.5
pve-qemu-kvm: 8.0.2-3
pve-xtermjs: 4.16.0-3
qemu-server: 8.0.6-1
smartmontools: 7.3-pve1
spiceterm: 3.3.0
swtpm: 0.8.0+pve1
vncterm: 1.8.0

Thanks in advance!

Default password?

Installation doesnt ask to set default password...

Failed to launch Container

I installed Proxmox on Oracle Cloud under the ARM Processer, and I can't launch VM's due to Nested Virtualization was disabled.

The LXC containers are possible, But I receiving the error while launching.

**failed waiting for client: timed out
TASK ERROR: command '/usr/bin/termproxy 5900 --path /vms/100 --perm VM.Console -- /usr/bin/dtach -A /var/run/dtach/vzctlconsole100 -r winch -z lxc-console -n 100 -e -1' failed: exit code 1

sync_wait: 34 An error occurred in another process (expected sequence number 7)
__lxc_start: 2074 Failed to spawn container "100"
TASK ERROR: startup for container '100' failed**

Installing Proxmox VE from your repo fail

Hi,
I tried to install Proxmox on a SBC ROCK PI 5B :
I followed the WIKI and tried two times but it failed each time.
rock@rock-5b:$ uname -a
Linux rock-5b 5.10.66-27-rockchip-gea60d388902d #rockchip SMP Mon Oct 24 08:25:47 UTC 2022 aarch64 GNU/Linux
rock@rock-5b:$ lsb_release -a
No LSB modules are available.
Distributor ID: Debian
Description: Debian GNU/Linux 11 (bullseye)
Release: 11
Codename: bullseye

The error is as follows :
Preparing to unpack .../269-pve-firmware_3.6-4_all.deb ...
Unpacking pve-firmware (3.6-4) ...
dpkg: error processing archive /tmp/apt-dpkg-install-9ZsU3k/269-pve-firmware_3.6-4_all.deb (--unpack):
trying to overwrite '/lib/firmware/ath10k/QCA988X/hw2.0/board.bin', which is also in package qualcomm-wifibt-firmware 0.1-1
dpkg-deb: error: paste subprocess was killed by signal (Broken pipe)
Selecting previously unselected package pve-manager.

Errors were encountered while processing:
/tmp/apt-dpkg-install-9ZsU3k/269-pve-firmware_3.6-4_all.deb
E: Sub-process /usr/bin/dpkg returned an error code (1)

Any Help welcome

Thx

Raspberry pi 4b USB passthrough

Hi,

trying to passthrough USB3 to debian VM but no luck yet.
USB 2 works ok, I can see hard drive in VM, but when I connect it to USB 3, nothing.

I installed proxmox from ISO, running UEFI from SD card. Installed proxmox to 60 gb usb hard drive. Everything boots ok. I can see both drives in proxmox

When I try to attach USB to VM, for some reason USB3 option is grayed out

When I start the VM, USB is present by typing lsusb command. lsblk is not showing any drives except the boot drive for the VM.

I have limited knowledge, but I would like to understand what is the problem here.

aarch64 support for Parallels on macOS Apple Silicon?

Would be very useful to have Proxmox available on macOS Parallels with Apple Silicon so that we can run native speed LXC containers. Any thoughts on how this might be accomplished?

Is ZFS Working ?

Is zfs working? has anyone tried it? I will be using with U2 NVME SSD.

firewall not working

iptable -L

Chain INPUT (policy ACCEPT)
target     prot opt source               destination         
PVEFW-INPUT  all  --  anywhere             anywhere            

Chain FORWARD (policy DROP)
target     prot opt source               destination         
DOCKER-USER  all  --  anywhere             anywhere            
DOCKER-ISOLATION-STAGE-1  all  --  anywhere             anywhere            
ACCEPT     all  --  anywhere             anywhere             ctstate RELATED,ESTABLISHED
DOCKER     all  --  anywhere             anywhere            
ACCEPT     all  --  anywhere             anywhere            
ACCEPT     all  --  anywhere             anywhere            
PVEFW-FORWARD  all  --  anywhere             anywhere            

Chain OUTPUT (policy ACCEPT)
target     prot opt source               destination         
PVEFW-OUTPUT  all  --  anywhere             anywhere            

Chain DOCKER (1 references)
target     prot opt source               destination         

Chain DOCKER-ISOLATION-STAGE-1 (1 references)
target     prot opt source               destination         
DOCKER-ISOLATION-STAGE-2  all  --  anywhere             anywhere            
RETURN     all  --  anywhere             anywhere            

Chain DOCKER-ISOLATION-STAGE-2 (1 references)
target     prot opt source               destination         
DROP       all  --  anywhere             anywhere            
RETURN     all  --  anywhere             anywhere            

Chain DOCKER-USER (1 references)
target     prot opt source               destination         
RETURN     all  --  anywhere             anywhere            

Chain PVEFW-Drop (1 references)
target     prot opt source               destination         
PVEFW-DropBroadcast  all  --  anywhere             anywhere            
ACCEPT     icmp --  anywhere             anywhere             icmp fragmentation-needed
ACCEPT     icmp --  anywhere             anywhere             icmp time-exceeded
DROP       all  --  anywhere             anywhere             ctstate INVALID
DROP       udp  --  anywhere             anywhere             multiport dports 135,445
DROP       udp  --  anywhere             anywhere             udp dpts:netbios-ns:139
DROP       udp  --  anywhere             anywhere             udp spt:netbios-ns dpts:1024:65535
DROP       tcp  --  anywhere             anywhere             multiport dports epmap,netbios-ssn,microsoft-ds
DROP       udp  --  anywhere             anywhere             udp dpt:1900
DROP       tcp  --  anywhere             anywhere             tcp flags:!FIN,SYN,RST,ACK/SYN
DROP       udp  --  anywhere             anywhere             udp spt:domain
           all  --  anywhere             anywhere             /* PVESIG:83WlR/a4wLbmURFqMQT3uJSgIG8 */

Chain PVEFW-DropBroadcast (2 references)
target     prot opt source               destination         
DROP       all  --  anywhere             anywhere             ADDRTYPE match dst-type BROADCAST
DROP       all  --  anywhere             anywhere             ADDRTYPE match dst-type MULTICAST
DROP       all  --  anywhere             anywhere             ADDRTYPE match dst-type ANYCAST
DROP       all  --  anywhere             base-address.mcast.net/4 
           all  --  anywhere             anywhere             /* PVESIG:NyjHNAtFbkH7WGLamPpdVnxHy4w */

Chain PVEFW-FORWARD (1 references)
target     prot opt source               destination         
DROP       all  --  anywhere             anywhere             ctstate INVALID
ACCEPT     all  --  anywhere             anywhere             ctstate RELATED,ESTABLISHED
PVEFW-FWBR-IN  all  --  anywhere             anywhere             PHYSDEV match --physdev-in fwln+ --physdev-is-bridged
PVEFW-FWBR-OUT  all  --  anywhere             anywhere             PHYSDEV match --physdev-out fwln+ --physdev-is-bridged
           all  --  anywhere             anywhere             /* PVESIG:qnNexOcGa+y+jebd4dAUqFSp5nw */

Chain PVEFW-FWBR-IN (1 references)
target     prot opt source               destination         
PVEFW-smurfs  all  --  anywhere             anywhere             ctstate INVALID,NEW
veth801i0-IN  all  --  anywhere             anywhere             PHYSDEV match --physdev-out veth801i0 --physdev-is-bridged
           all  --  anywhere             anywhere             /* PVESIG:wiWVRhS8/LKvniz+c5HbbSZvh7Q */

Chain PVEFW-FWBR-OUT (1 references)
target     prot opt source               destination         
veth801i0-OUT  all  --  anywhere             anywhere             PHYSDEV match --physdev-in veth801i0 --physdev-is-bridged
           all  --  anywhere             anywhere             /* PVESIG:Rp6VMTxc1JlnbhOFPEexNKRsg2k */

Chain PVEFW-HOST-IN (1 references)
target     prot opt source               destination         
ACCEPT     all  --  anywhere             anywhere            
DROP       all  --  anywhere             anywhere             ctstate INVALID
ACCEPT     all  --  anywhere             anywhere             ctstate RELATED,ESTABLISHED
PVEFW-smurfs  all  --  anywhere             anywhere             ctstate INVALID,NEW
RETURN     igmp --  anywhere             anywhere            
RETURN     icmp --  anywhere             anywhere             icmp any
RETURN     tcp  --  anywhere             anywhere             match-set PVEFW-0-management-v4 src tcp dpt:8006
RETURN     tcp  --  anywhere             anywhere             match-set PVEFW-0-management-v4 src tcp dpts:5900:5999
RETURN     tcp  --  anywhere             anywhere             match-set PVEFW-0-management-v4 src tcp dpt:3128
RETURN     tcp  --  anywhere             anywhere             match-set PVEFW-0-management-v4 src tcp dpt:ssh
RETURN     tcp  --  anywhere             anywhere             match-set PVEFW-0-management-v4 src tcp dpts:60000:60050
RETURN     udp  --  10.13.14.1           pve2.bingsin.com     udp dpts:5404:5405
RETURN     udp  --  10.13.14.3           pve2.bingsin.com     udp dpts:5404:5405
RETURN     udp  --  10.13.14.4           pve2.bingsin.com     udp dpts:5404:5405
PVEFW-Reject  all  --  anywhere             anywhere            
NFLOG      all  --  anywhere             anywhere             limit: avg 1/sec burst 5 nflog-prefix  ":0:7:PVEFW-HOST-IN: policy REJECT: "
PVEFW-reject  all  --  anywhere             anywhere            [goto] 
           all  --  anywhere             anywhere             /* PVESIG:7qUG7NLALEEQ4kmQyphqfgk3gRU */

Chain PVEFW-HOST-OUT (1 references)
target     prot opt source               destination         
ACCEPT     all  --  anywhere             anywhere            
DROP       all  --  anywhere             anywhere             ctstate INVALID
ACCEPT     all  --  anywhere             anywhere             ctstate RELATED,ESTABLISHED
RETURN     igmp --  anywhere             anywhere            
RETURN     tcp  --  anywhere             10.13.14.0/24        tcp dpt:8006
RETURN     tcp  --  anywhere             10.13.14.0/24        tcp dpt:ssh
RETURN     tcp  --  anywhere             10.13.14.0/24        tcp dpts:5900:5999
RETURN     tcp  --  anywhere             10.13.14.0/24        tcp dpt:3128
RETURN     udp  --  pve2.bingsin.com     10.13.14.1           udp dpts:5404:5405
RETURN     udp  --  pve2.bingsin.com     10.13.14.3           udp dpts:5404:5405
RETURN     udp  --  pve2.bingsin.com     10.13.14.4           udp dpts:5404:5405
RETURN     all  --  anywhere             anywhere            
           all  --  anywhere             anywhere             /* PVESIG:/ea45QRsMYvZjzNCQQo+8XQ0zn8 */

Chain PVEFW-INPUT (1 references)
target     prot opt source               destination         
PVEFW-HOST-IN  all  --  anywhere             anywhere            
           all  --  anywhere             anywhere             /* PVESIG:+5iMmLaxKXynOB/+5xibfx7WhFk */

Chain PVEFW-OUTPUT (1 references)
target     prot opt source               destination         
PVEFW-HOST-OUT  all  --  anywhere             anywhere            
           all  --  anywhere             anywhere             /* PVESIG:LjHoZeSSiWAG3+2ZAyL/xuEehd0 */

Chain PVEFW-Reject (1 references)
target     prot opt source               destination         
PVEFW-DropBroadcast  all  --  anywhere             anywhere            
ACCEPT     icmp --  anywhere             anywhere             icmp fragmentation-needed
ACCEPT     icmp --  anywhere             anywhere             icmp time-exceeded
DROP       all  --  anywhere             anywhere             ctstate INVALID
PVEFW-reject  udp  --  anywhere             anywhere             multiport dports 135,445
PVEFW-reject  udp  --  anywhere             anywhere             udp dpts:netbios-ns:139
PVEFW-reject  udp  --  anywhere             anywhere             udp spt:netbios-ns dpts:1024:65535
PVEFW-reject  tcp  --  anywhere             anywhere             multiport dports epmap,netbios-ssn,microsoft-ds
DROP       udp  --  anywhere             anywhere             udp dpt:1900
DROP       tcp  --  anywhere             anywhere             tcp flags:!FIN,SYN,RST,ACK/SYN
DROP       udp  --  anywhere             anywhere             udp spt:domain
           all  --  anywhere             anywhere             /* PVESIG:h3DyALVslgH5hutETfixGP08w7c */

Chain PVEFW-SET-ACCEPT-MARK (2 references)
target     prot opt source               destination         
MARK       all  --  anywhere             anywhere             MARK or 0x80000000
           all  --  anywhere             anywhere             /* PVESIG:Hg/OIgIwJChBUcWU8Xnjhdd2jUY */

Chain PVEFW-logflags (5 references)
target     prot opt source               destination         
NFLOG      all  --  anywhere             anywhere             limit: avg 1/sec burst 5 nflog-prefix  ":0:7:PVEFW-logflags: DROP: "
DROP       all  --  anywhere             anywhere            
           all  --  anywhere             anywhere             /* PVESIG:HC8CEuX2HT92HaS+8/71UerEnag */

Chain PVEFW-reject (5 references)
target     prot opt source               destination         
DROP       all  --  anywhere             anywhere             ADDRTYPE match dst-type BROADCAST
DROP       all  --  base-address.mcast.net/4  anywhere            
DROP       icmp --  anywhere             anywhere            
REJECT     tcp  --  anywhere             anywhere             reject-with tcp-reset
REJECT     udp  --  anywhere             anywhere             reject-with icmp-port-unreachable
REJECT     icmp --  anywhere             anywhere             reject-with icmp-host-unreachable
REJECT     all  --  anywhere             anywhere             reject-with icmp-host-prohibited
           all  --  anywhere             anywhere             /* PVESIG:Jlkrtle1mDdtxDeI9QaDSL++Npc */

Chain PVEFW-smurflog (2 references)
target     prot opt source               destination         
NFLOG      all  --  anywhere             anywhere             limit: avg 1/sec burst 5 nflog-prefix  ":0:7:PVEFW-smurflog: DROP: "
DROP       all  --  anywhere             anywhere            
           all  --  anywhere             anywhere             /* PVESIG:ehR9MsiJdo/7X3yNWp9nxAhhZDA */

Chain PVEFW-smurfs (2 references)
target     prot opt source               destination         
RETURN     all  --  0.0.0.0              anywhere            
PVEFW-smurflog  all  --  anywhere             anywhere            [goto]  ADDRTYPE match src-type BROADCAST
PVEFW-smurflog  all  --  base-address.mcast.net/4  anywhere            [goto] 
           all  --  anywhere             anywhere             /* PVESIG:HssVe5QCBXd5mc9kC88749+7fag */

Chain PVEFW-tcpflags (0 references)
target     prot opt source               destination         
PVEFW-logflags  tcp  --  anywhere             anywhere            [goto]  tcp flags:FIN,SYN,RST,PSH,ACK,URG/FIN,PSH,URG
PVEFW-logflags  tcp  --  anywhere             anywhere            [goto]  tcp flags:FIN,SYN,RST,PSH,ACK,URG/NONE
PVEFW-logflags  tcp  --  anywhere             anywhere            [goto]  tcp flags:SYN,RST/SYN,RST
PVEFW-logflags  tcp  --  anywhere             anywhere            [goto]  tcp flags:FIN,SYN/FIN,SYN
PVEFW-logflags  tcp  --  anywhere             anywhere            [goto]  tcp spt:0 flags:FIN,SYN,RST,ACK/SYN
           all  --  anywhere             anywhere             /* PVESIG:CMFojwNPqllyqD67NeI5m+bP5mo */

Chain veth801i0-IN (1 references)
target     prot opt source               destination         
ACCEPT     udp  --  anywhere             anywhere             udp spt:bootps dpt:bootpc
ACCEPT     all  --  anywhere             anywhere            
PVEFW-Drop  all  --  anywhere             anywhere            
NFLOG      all  --  anywhere             anywhere             limit: avg 1/sec burst 5 nflog-prefix  ":801:7:veth801i0-IN: policy DROP: "
DROP       all  --  anywhere             anywhere            
           all  --  anywhere             anywhere             /* PVESIG:BsU3g3/Sg6xfqpVBxS+UmZaOBeI */

Chain veth801i0-OUT (1 references)
target     prot opt source               destination         
PVEFW-SET-ACCEPT-MARK  udp  --  anywhere             anywhere            [goto]  udp spt:bootpc dpt:bootps
DROP       all  --  anywhere             anywhere             MAC !ac:bd:ef:67:8d:9b
MARK       all  --  anywhere             anywhere             MARK and 0x7fffffff
PVEFW-SET-ACCEPT-MARK  all  --  anywhere             anywhere            [goto] 
           all  --  anywhere             anywhere             /* PVESIG:7M1pxdAtWpAFV51o2YEJdtdoItI */

SSH-Key validation

Hello,

When trying to create a new CT giving a ssh public key, the process blocks in the end when the key is being validated (error 500)
I don't know if all arm64 systems are touched by this problem, but the script /usr/share/perl5/PVE/Tools.pm tries to create a temporary file with the key to send to 'ssh-keygen' for validation. To do so, it opens a file with O_TMPFILE flag, wich is hardcoded inside the script. But it looks like the value is different on arm64, and so file opening ends with "Invalid argument" error.
Maybe the script should be modified to use system-dependent value instead of hardcoding it, but a quick patch could be :

@@ -100,7 +100,7 @@

 use constant {O_PATH    => 0x00200000,
               O_CLOEXEC => 0x00080000,
-              O_TMPFILE => 0x00410000}; # This includes O_DIRECTORY
+              O_TMPFILE => 0x00404000}; # This includes O_DIRECTORY

 use constant {AT_EMPTY_PATH => 0x1000,
               AT_FDCWD => -100};

(documentation) build pve && automatic builds

Hey, could you explain how to use your repack.sh, it looks like you only repack all x86 / amd packages to arm64 ones instead of building it as arm64 binarys from source code.

So proxmox only use scripts instead of binarys?
Best regards

Qemu x64?

Good morning. Can you create vm qemu with x64 structure?
I have bought orange pi 5 and I would like to use it to virtualize, but I need to know if it is possible to create vms other than arm or is it mandatory to be arm.
Thanks greetings

Correct repository and package links for Bookworm

Hi

If Im following the wiki installation guide to install on Bookworm would I need different commands to install the repository and packages as they both reference Bullseye, or would they work fine?

Thanks

VMs no longer boot with upgrade from 7.4 to 8

After following the documented steps to upgrade to the newest proxmox version, my vms now no longer boot. I also cannot get into the uefi menu. It appears that it just completly hangs.

It looks like the issue we had here #20 may have returned?

Im on the rock 5b

No Memory and SWAP Limits for CT's

I have multiple Debian Bookworm CT's running on a Raspberry PI 4B 8GB and they running fine,
but Memory and SWAP Settings from Proxmox are not working and all CT's have 8GB in "top".

Do you have a Fix or a Workaround for this Problem on Raspberry PI's?

[Install] packages have unmet dependencies: pve-kernel-5.15 : Depends: pve-kernel-5.15.39-4-pve but it is not installable

When io follow the Guide in my bullseye install, i get the following error after apt-get install proxmox-ve: The following packages have unmet dependencies:
pve-kernel-5.15 : Depends: pve-kernel-5.15.39-4-pve but it is not installable.

It seems that pve kernel is not found and install halts. What am i doing wrong? Can't seem to find a similar error neither a description about it. Thank you