linstor-server
linstor-server copied to clipboard
LINBIT
Proxmox lxc backup error
We have a problem with backups of LXC containers on Proxmox. Occasionally, the following error occurs. This problem has existed for several years now. Both Proxmox and Linstor are up to date. Backups of "normal" VMs do not have any issues on the same cluster.
After that error, we have to manually remove the snapshot vzdump file.
43113:` 2025-07-16 21:14:21 INFO: Starting Backup of VM 43113 (lxc)
43113: 2025-07-16 21:14:21 INFO: status = running
43113: 2025-07-16 21:14:21 INFO: CT Name: A-NV2--documents.kundeXYZ-sales.de
43113: 2025-07-16 21:14:21 INFO: including mount point rootfs ('/') in backup
43113: 2025-07-16 21:14:21 INFO: backup mode: snapshot
43113: 2025-07-16 21:14:21 INFO: ionice priority: 7
43113: 2025-07-16 21:14:21 INFO: create storage snapshot 'vzdump'
43113: 2025-07-16 21:19:21 ERROR: Backup of VM 43113 failed - API Return-Code: 500. Message: Could not create cluster wide snapshot snap_vm-43113-disk-1_vzdump of vm-43113-disk-1, because:
43113: 2025-07-16 21:19:21 ERROR: read timeout at /usr/share/perl5/Net/HTTP/Methods.pm line 274.
43113: 2025-07-16 21:19:21 ERROR:
43113: 2025-07-16 21:19:21 ERROR: at /usr/share/perl5/PVE/Storage/Custom/LINSTORPlugin.pm line 620.
43113: 2025-07-16 21:19:21 ERROR: PVE::Storage::Custom::LINSTORPlugin::volume_snapshot("PVE::Storage::Custom::LINSTORPlugin", HASH(0x5c5493addd18), "NVME_DRBD_R1_2", "vm-43113-disk-1", "vzdump") called at /usr/share/perl5/PVE/Storage.pm line 357
43113: 2025-07-16 21:19:21 ERROR: PVE::Storage::volume_snapshot(HASH(0x5c5493b54c30), "NVME_DRBD_R1_2:vm-43113-disk-1", "vzdump") called at /usr/share/perl5/PVE/LXC/Config.pm line 211
43113: 2025-07-16 21:19:21 ERROR: PVE::LXC::Config::__snapshot_create_vol_snapshot("PVE::LXC::Config", 43113, "rootfs", HASH(0x5c5493acfd60), "vzdump") called at /usr/share/perl5/PVE/AbstractConfig.pm line 840
43113: 2025-07-16 21:19:21 ERROR: PVE::AbstractConfig::__ANON__("rootfs", HASH(0x5c5493acfd60)) called at /usr/share/perl5/PVE/AbstractConfig.pm line 475
43113: 2025-07-16 21:19:21 ERROR: PVE::AbstractConfig::foreach_volume_full("PVE::LXC::Config", HASH(0x5c5493a75cb0), undef, CODE(0x5c54936f05d0)) called at /usr/share/perl5/PVE/AbstractConfig.pm line 484
43113: 2025-07-16 21:19:21 ERROR: PVE::AbstractConfig::foreach_volume("PVE::LXC::Config", HASH(0x5c5493a75cb0), CODE(0x5c54936f05d0)) called at /usr/share/perl5/PVE/AbstractConfig.pm line 842
43113: 2025-07-16 21:19:21 ERROR: eval {...} called at /usr/share/perl5/PVE/AbstractConfig.pm line 828
43113: 2025-07-16 21:19:21 ERROR: PVE::AbstractConfig::snapshot_create("PVE::LXC::Config", 43113, "vzdump", 0, "vzdump backup snapshot") called at /usr/share/perl5/PVE/VZDump/LXC.pm line 229
43113: 2025-07-16 21:19:21 ERROR: PVE::VZDump::LXC::__ANON__() called at /usr/share/perl5/PVE/AbstractConfig.pm line 299
43113: 2025-07-16 21:19:21 ERROR: PVE::AbstractConfig::__ANON__() called at /usr/share/perl5/PVE/Tools.pm line 259
43113: 2025-07-16 21:19:21 ERROR: eval {...} called at /usr/share/perl5/PVE/Tools.pm line 259
43113: 2025-07-16 21:19:21 ERROR: PVE::Tools::lock_file_full("/run/lock/lxc/pve-config-43113.lock", 10, 0, CODE(0x5c5493add850)) called at /usr/share/perl5/PVE/AbstractConfig.pm line 302
43113: 2025-07-16 21:19:21 ERROR: PVE::AbstractConfig::__ANON__("PVE::LXC::Config", 43113, 10, 0, CODE(0x5c5493abaa70)) called at /usr/share/perl5/PVE/AbstractConfig.pm line 322
43113: 2025-07-16 21:19:21 ERROR: PVE::AbstractConfig::lock_config_full("PVE::LXC::Config", 43113, 10, CODE(0x5c5493abaa70)) called at /usr/share/perl5/PVE/AbstractConfig.pm line 330
43113: 2025-07-16 21:19:21 ERROR: PVE::AbstractConfig::lock_config("PVE::LXC::Config", 43113, CODE(0x5c5493abaa70)) called at /usr/share/perl5/PVE/VZDump/LXC.pm line 231
43113: 2025-07-16 21:19:21 ERROR: PVE::VZDump::LXC::snapshot(PVE::VZDump::LXC=HASH(0x5c549349b7d8), HASH(0x5c54937168c0), 43113) called at /usr/share/perl5/PVE/VZDump.pm line 1177
43113: 2025-07-16 21:19:21 ERROR: eval {...} called at /usr/share/perl5/PVE/VZDump.pm line 936
43113: 2025-07-16 21:19:21 ERROR: PVE::VZDump::exec_backup_task(PVE::VZDump=HASH(0x5c548c526810), HASH(0x5c54937168c0)) called at /usr/share/perl5/PVE/VZDump.pm line 1442
43113: 2025-07-16 21:19:21 ERROR: eval {...} called at /usr/share/perl5/PVE/VZDump.pm line 1436
43113: 2025-07-16 21:19:21 ERROR: PVE::VZDump::exec_backup(PVE::VZDump=HASH(0x5c548c526810), PVE::RPCEnvironment=HASH(0x5c548c5207d8), "root\@pam") called at /usr/share/perl5/PVE/API2/VZDump.pm line 148
43113: 2025-07-16 21:19:21 ERROR: PVE::API2::VZDump::__ANON__("UPID:kundeXYZ01:0009FA5F:11BCFBD5:6877F6B6:vzdump::root\@pam:") called at /usr/share/perl5/PVE/RESTEnvironment.pm line 620
43113: 2025-07-16 21:19:21 ERROR: eval {...} called at /usr/share/perl5/PVE/RESTEnvironment.pm line 611
43113: 2025-07-16 21:19:21 ERROR: PVE::RESTEnvironment::fork_worker(PVE::RPCEnvironment=HASH(0x5c548c5207d8), "vzdump", undef, "root\@pam", CODE(0x5c5493467f98)) called at /usr/share/perl5/PVE/API2/VZDump.pm line 172
43113: 2025-07-16 21:19:21 ERROR: PVE::API2::VZDump::__ANON__(HASH(0x5c5493477608)) called at /usr/share/perl5/PVE/RESTHandler.pm line 499
43113: 2025-07-16 21:19:21 ERROR: PVE::RESTHandler::handle("PVE::API2::VZDump", HASH(0x5c5490528ff8), HASH(0x5c5493477608)) called at /usr/share/perl5/PVE/RESTHandler.pm line 337
43113: 2025-07-16 21:19:21 ERROR: PVE::RESTHandler::__ANON__("PVE::API2::VZDump", HASH(0x5c5493477608)) called at /usr/share/perl5/PVE/Jobs/VZDump.pm line 35
43113: 2025-07-16 21:19:21 ERROR: PVE::Jobs::VZDump::run("PVE::Jobs::VZDump", HASH(0x5c5493477608), "ff638bfd13de90d1ac1b8d32d2fc708a2bb67eec:2", "21:00") called at /usr/share/perl5/PVE/Jobs.pm line 299
43113: 2025-07-16 21:19:21 ERROR: eval {...} called at /usr/share/perl5/PVE/Jobs.pm line 299
43113: 2025-07-16 21:19:21 ERROR: PVE::Jobs::run_jobs(0) called at /usr/share/perl5/PVE/Service/pvescheduler.pm line 114
43113: 2025-07-16 21:19:21 ERROR: PVE::Service::pvescheduler::__ANON__() called at /usr/share/perl5/PVE/Service/pvescheduler.pm line 89
43113: 2025-07-16 21:19:21 ERROR: eval {...} called at /usr/share/perl5/PVE/Service/pvescheduler.pm line 88
43113: 2025-07-16 21:19:21 ERROR: PVE::Service::pvescheduler::__ANON__("jobs", CODE(0x5c5493477c50)) called at /usr/share/perl5/PVE/Service/pvescheduler.pm line 115
43113: 2025-07-16 21:19:21 ERROR: PVE::Service::pvescheduler::__ANON__() called at /usr/share/perl5/PVE/Service/pvescheduler.pm line 126
43113: 2025-07-16 21:19:21 ERROR: PVE::Service::pvescheduler::run(PVE::Service::pvescheduler=HASH(0x5c54933ea9e0)) called at /usr/share/perl5/PVE/Daemon.pm line 398
43113: 2025-07-16 21:19:21 ERROR: eval {...} called at /usr/share/perl5/PVE/Daemon.pm line 379
43113: 2025-07-16 21:19:21 ERROR: PVE::Daemon::__ANON__(PVE::Service::pvescheduler=HASH(0x5c54933ea9e0), undef) called at /usr/share/perl5/PVE/Daemon.pm line 551
43113: 2025-07-16 21:19:21 ERROR: eval {...} called at /usr/share/perl5/PVE/Daemon.pm line 549
43113: 2025-07-16 21:19:21 ERROR: PVE::Daemon::start(PVE::Service::pvescheduler=HASH(0x5c54933ea9e0), undef) called at /usr/share/perl5/PVE/Daemon.pm line 658
43113: 2025-07-16 21:19:21 ERROR: PVE::Daemon::__ANON__(HASH(0x5c5493472958)) called at /usr/share/perl5/PVE/RESTHandler.pm line 499
43113: 2025-07-16 21:19:21 ERROR: PVE::RESTHandler::handle("PVE::Service::pvescheduler", HASH(0x5c5493460920), HASH(0x5c5493472958), 1) called at /usr/share/perl5/PVE/RESTHandler.pm line 985
43113: 2025-07-16 21:19:21 ERROR: eval {...} called at /usr/share/perl5/PVE/RESTHandler.pm line 968
43113: 2025-07-16 21:19:21 ERROR: PVE::RESTHandler::cli_handler("PVE::Service::pvescheduler", "pvescheduler start", "start", ARRAY(0x5c548dced150), ARRAY(0x5c548c555b08), undef, undef, undef) called at /usr/share/perl5/PVE/CLIHandler.pm line 594
43113: 2025-07-16 21:19:21 ERROR: PVE::CLIHandler::__ANON__(ARRAY(0x5c548c520748), CODE(0x5c5493460290), undef) called at /usr/share/perl5/PVE/CLIHandler.pm line 673
43113: 2025-07-16 21:19:21 ERROR: PVE::CLIHandler::run_cli_handler("PVE::Service::pvescheduler", "prepare", CODE(0x5c5493460290)) called at /usr/bin/pvescheduler line 28
A bit late (overlooked), but are there any related Linstor error reports/errors? The proxmox log is not enough to give any hint on what went wrong.
