CHAT_OUTPUT_BEGIN COMMAND_ID=HOMELAB-CLUSTER-CRITICAL-SNAPSHOT-428 STATUS=FAIL RC=127 HOST=pve01 MODE=read-only COMPONENT=cluster-audit REFERENCE_REGISTER_CHECK=OK REFERENCE_SHA256=5763f2f8edc75fcf6f3951f8c95896d1cc112ceccb6cf5b64a383f540a4deb8e ERROR_REGISTER_CHECK=OK ERROR_REGISTER_SHA256=08b3a769b8e38eaa1acec915352fb328180d70caa7ff6cd9d1ec0da426262752 COMMAND_SHA256=acb8cfc8df7523b005c7cc8d9dcc5e8d6955edc9869f35192b9aab7770149bb5 DUPLICATE_FAILED_COMMAND_BLOCKED=false EXECUTION_STARTED=true CHANGES_MADE=false SANITIZED=yes SECRETS_INCLUDED=no PRIVATE_ADDRESSES_INCLUDED=no RAW_EVIDENCE_SHA256=983c89419e9432c65180a176c36039953a5d07a157e9509f7eaa97016d1f65b6 SANITIZED_OUTPUT_SHA256=50e542092e058ed4496ae5f17ec2fa7a38e02c39668e58030948a9916e980eb2 OUTPUT_BEGIN AUDIT_ID=HOMELAB-CLUSTER-CRITICAL-SNAPSHOT-428 AUDIT_TIME_UTC=2026-07-24T09:43:29Z CHANGES_PLANNED=NO ===== PROXMOX_QUORUM ===== Cluster information ------------------- Name: homelab Config Version: 3 Transport: knet Secure auth: on Quorum information ------------------ Date: Fri Jul 24 12:43:29 2026 Quorum provider: corosync_votequorum Nodes: 3 Node ID: 0x00000001 Ring ID: 1.ba Quorate: Yes Votequorum information ---------------------- Expected votes: 3 Highest expected: 3 Total votes: 3 Quorum: 2 Flags: Quorate Membership information ---------------------- Nodeid Votes Name 0x00000001 1 [PRIVATE_IP] (local) 0x00000002 1 [PRIVATE_IP] 0x00000003 1 [PRIVATE_IP] ===== PROXMOX_NODES ===== +-------+--------+-------+-------+--------+-----------+-----------+-------------------------------------------------------------------------------------------------+-------------+ | node | status | cpu | level | maxcpu | maxmem | mem | ssl_fingerprint | uptime | +=======+========+=======+=======+========+===========+===========+=================================================================================================+=============+ | pve01 | online | 1.98% | | 24 | 31.09 GiB | 22.07 GiB | EB:7A:01:C5:02:1B:B7:F9:54:F4:38:8B:7F:03:1F:87:62:D0:6E:5F:C0:39:FB:B5:42:AE:58:6F:58:9A:9C:C1 | 20h 22m 46s | +-------+--------+-------+-------+--------+-----------+-----------+-------------------------------------------------------------------------------------------------+-------------+ | pve02 | online | 8.49% | | 4 | 15.40 GiB | 11.36 GiB | C0:88:6E:89:CD:BF:0C:82:54:20:E7:11:DE:CA:ED:09:12:C6:9C:24:2A:1E:5C:33:49:EC:4E:E0:67:BE:79:05 | 20h 20m 42s | +-------+--------+-------+-------+--------+-----------+-----------+-------------------------------------------------------------------------------------------------+-------------+ | pve03 | online | 4.43% | | 8 | 31.25 GiB | 11.24 GiB | 7E:FE:4A:DC:32:3C:02:84:A2:DD:23:84:FD:19:1E:8A:1B:B1:60:F6:F4:16:D0:28:3B:13:AE:65:7D:1F:38:32 | 20h 21m 35s | +-------+--------+-------+-------+--------+-----------+-----------+-------------------------------------------------------------------------------------------------+-------------+ ===== PROXMOX_STORAGE ===== +-------------------------+---------+-------------+--------------------------+-----+------------+----------+-----------+---------+-----------+-------+------+--------+------------+--------+-----+---------+------+-------+--------+---------+--------------+-------+------------+------+----------+-----+--------+-----------+-----------+------+----------+--------+------+-----------+ | id | type | cgroup-mode | content | cpu | disk | diskread | diskwrite | hastate | host-arch | level | lock | maxcpu | maxdisk | maxmem | mem | memhost | name | netin | netout | network | network-type | node | plugintype | pool | protocol | sdn | shared | status | storage | tags | template | uptime | vmid | zone-type | +=========================+=========+=============+==========================+=====+============+==========+===========+=========+===========+=======+======+========+============+========+=====+=========+======+=======+========+=========+==============+=======+============+======+==========+=====+========+===========+===========+======+==========+========+======+===========+ | storage/pve01/local | storage | | iso,backup,vztmpl,import | | 40.39 GiB | | | | | | | | 97.87 GiB | | | | | | | | | pve01 | dir | | | | 0 | available | local | | | | | | +-------------------------+---------+-------------+--------------------------+-----+------------+----------+-----------+---------+-----------+-------+------+--------+------------+--------+-----+---------+------+-------+--------+---------+--------------+-------+------------+------+----------+-----+--------+-----------+-----------+------+----------+--------+------+-----------+ | storage/pve01/local-lvm | storage | | images,rootdir | | 310.84 GiB | | | | | | | | 809.48 GiB | | | | | | | | | pve01 | lvmthin | | | | 0 | available | local-lvm | | | | | | +-------------------------+---------+-------------+--------------------------+-----+------------+----------+-----------+---------+-----------+-------+------+--------+------------+--------+-----+---------+------+-------+--------+---------+--------------+-------+------------+------+----------+-----+--------+-----------+-----------+------+----------+--------+------+-----------+ | storage/pve02/local | storage | | iso,backup,vztmpl,import | | 26.14 GiB | | | | | | | | 97.87 GiB | | | | | | | | | pve02 | dir | | | | 0 | available | local | | | | | | +-------------------------+---------+-------------+--------------------------+-----+------------+----------+-----------+---------+-----------+-------+------+--------+------------+--------+-----+---------+------+-------+--------+---------+--------------+-------+------------+------+----------+-----+--------+-----------+-----------+------+----------+--------+------+-----------+ | storage/pve02/local-lvm | storage | | images,rootdir | | 290.27 GiB | | | | | | | | 787.91 GiB | | | | | | | | | pve02 | lvmthin | | | | 0 | available | local-lvm | | | | | | +-------------------------+---------+-------------+--------------------------+-----+------------+----------+-----------+---------+-----------+-------+------+--------+------------+--------+-----+---------+------+-------+--------+---------+--------------+-------+------------+------+----------+-----+--------+-----------+-----------+------+----------+--------+------+-----------+ | storage/pve03/local | storage | | iso,backup,vztmpl,import | | 53.72 GiB | | | | | | | | 97.87 GiB | | | | | | | | | pve03 | dir | | | | 0 | available | local | | | | | | +-------------------------+---------+-------------+--------------------------+-----+------------+----------+-----------+---------+-----------+-------+------+--------+------------+--------+-----+---------+------+-------+--------+---------+--------------+-------+------------+------+----------+-----+--------+-----------+-----------+------+----------+--------+------+-----------+ | storage/pve03/local-lvm | storage | | images,rootdir | | 145.74 GiB | | | | | | | | 331.23 GiB | | | | | | | | | pve03 | lvmthin | | | | 0 | available | local-lvm | | | | | | +-------------------------+---------+-------------+--------------------------+-----+------------+----------+-----------+---------+-----------+-------+------+--------+------------+--------+-----+---------+------+-------+--------+---------+--------------+-------+------------+------+----------+-----+--------+-----------+-----------+------+----------+--------+------+-----------+ ===== LOCAL_FILESYSTEMS ===== Filesystem Size Used Avail Use% Mounted on /dev/mapper/pve-root 98G 41G 53G 44% / efivarfs 192K 135K 53K 72% /sys/firmware/efi/efivars /dev/nvme0n1p2 1022M 9.1M 1013M 1% /boot/efi /dev/mapper/pve-homelab--staging 295G 148G 132G 53% /mnt/staging /dev/fuse 128M 1.4M 127M 2% /etc/pve overlay 98G 41G 53G 44% /var/lib/containers/storage/overlay/4639d2b7096bff2bf1482d2b2b867a1a21a3e9eba88986eb78f9daa256eb5a77/merged ===== LOCAL_INODES ===== Filesystem Inodes IUsed IFree IUse% Mounted on /dev/mapper/pve-root 6553600 139099 6414501 3% / efivarfs 0 0 0 - /sys/firmware/efi/efivars /dev/nvme0n1p2 0 0 0 - /boot/efi /dev/mapper/pve-homelab--staging 19660800 4475 19656325 1% /mnt/staging /dev/fuse 262144 89 262055 1% /etc/pve overlay 6553600 139099 6414501 3% /var/lib/containers/storage/overlay/4639d2b7096bff2bf1482d2b2b867a1a21a3e9eba88986eb78f9daa256eb5a77/merged ===== ZFS ===== no pools available ===== CEPH ===== STATE=NOT_CONFIGURED_OR_TOOL_ABSENT ===== PVE01_FAILED_UNITS ===== homelab-backup-matrix-refresh.service loaded failed failed Generate unified homelab backup matrix state ===== PVE01_KERNEL_CRITICAL_24H ===== ===== PROXMOX_FAILED_TASKS ===== Unknown option: errors Unknown option: limit 400 unable to parse option pvesh get [OPTIONS] [FORMAT_OPTIONS] ===== TIME_SYNCHRONIZATION ===== Timezone=Europe/Moscow LocalRTC=no NTPSynchronized=yes ===== SKLADCHIK_SUPERVISOR ===== cut: '"': No such file or directory SCRIPT_SHA256= EXPECTED_SHA256=bd40ee19ea8b277d52f4240b97d3c79b825c90154272bac8a43004591bd0ddc3 Result=success ExecMainStatus=0 ActiveState=inactive SubState=dead SUPERVISOR_TIMER=active STATUS=OK TS=2026-07-24T09:38:15Z problems= backup_status=OK cookie_expiry_status=OK cookie_jar=yes monitor_status=OK restore_status=OK POST_FIX_COOKIE_FAILURES=0 ===== EDGE_VM ===== edge-vm.gram1.ru active active bash: line 1: /var/lib/skladchik-reports-monitor/cookies.jar: Permission denied stat: missing operand Try 'stat --help' for more information. bash: -c: line 1: syntax error near unexpected token `(' bash: -c: line 1: `sudo -n grep -E ^(STATUS|TS|reports|open|resolved|cookie_jar|cookie_expiry_status|problems)= /var/lib/skladchik-reports-monitor/health.txt' Filesystem Size Used Avail Use% Mounted on /dev/sdb1 95G 33G 58G 36% / ===== CORE_APPS ===== core-apps.gram1.ru bash: line 1: {{.Status}}: command not found 7be8012c619c01d5770417d3a26ca82c7cd14935ed5cf10fd7cb6e2fa687c82f /opt/stacks/gitea/data/gitea/public/.well-known/homelab-bootstrap.json 7be8012c619c01d5770417d3a26ca82c7cd14935ed5cf10fd7cb6e2fa687c82f /opt/stacks/gitea/data/gitea/public/.well-known/homelab-bootstrap/7be8012c619c01d5770417d3a26ca82c7cd14935ed5cf10fd7cb6e2fa687c82f.json Filesystem Size Used Avail Use% Mounted on /dev/sda1 118G 42G 72G 37% / ===== PUBLIC_BOOTSTRAP ===== EXPECTED_BOOTSTRAP_SHA256=7be8012c619c01d5770417d3a26ca82c7cd14935ed5cf10fd7cb6e2fa687c82f 7be8012c619c01d5770417d3a26ca82c7cd14935ed5cf10fd7cb6e2fa687c82f - 7be8012c619c01d5770417d3a26ca82c7cd14935ed5cf10fd7cb6e2fa687c82f - ===== READER_CAPABILITY_EXPOSURE ===== /usr/bin/bash: -c: line 207: syntax error near unexpected token `(' /usr/bin/bash: -c: line 207: ` \"/homelab-reader/[0-9a-fA-F]{64}([/\\\"]|$)\" \' OUTPUT_END CHAT_OUTPUT_END