[Bug]: An error occurred during the backup process for milvus: ["Fail to fill segment backup info"]

[372278663]

Current Behavior

I wrote a script for automatic daily backup of Milvus. The key command is: ./milvus-backup create -n milvus_backup_$TIMESTAMP

I tried it in two environments and encountered the same problem of errors after several days of normal operation. Here are the relevant logs:

[2024/07/29 09:30:12.091 +08:00] [INFO] [core/backup_impl_create_backup.go:494] [backupCollectionExecute] [collectionMeta="id:"186d75b8-4d4a-11ef-abe3-e61792940d17" start_time:1722216610 collection_id:451333863845088053 db_name:"default" collection_name:"kb000043" schema:<name:"kb000043" fields:<fieldID:100 name:"kb_id" data_type:VarChar type_params:<key:"max_length" value:"65535" > > fields:<fieldID:101 name:"src_id" data_type:VarChar type_params:<key:"max_length" value:"65535" > > fields:<fieldID:102 name:"src_nm" data_type:VarChar type_params:<key:"max_length" value:"65535" > > fields:<fieldID:103 name:"chunk_type" data_type:VarChar type_params:<key:"max_length" value:"65535" > > fields:<fieldID:104 name:"chunk_id" data_type:Int64 > fields:<fieldID:105 name:"answer" data_type:VarChar type_params:<key:"max_length" value:"65535" > > fields:<fieldID:106 name:"text" data_type:VarChar type_params:<key:"max_length" value:"65535" > > fields:<fieldID:107 name:"pk" is_primary_key:true data_type:VarChar type_params:<key:"max_length" value:"65535" > > fields:<fieldID:108 name:"vector" data_type:FloatVector type_params:<key:"dim" value:"1024" > > > shards_num:1 consistency_level:Session backup_timestamp:451468751011840 has_index:true index_infos:<field_name:"vector" index_name:"vector" index_type:"HNSW" params:<key:"index_type" value:"HNSW" > params:<key:"metric_type" value:"L2" > params:<key:"params" value:"{\"M\":8,\"efConstruction\":64}" > > load_state:"NotLoad" backup_physical_timestamp:1722216610 "] [2024/07/29 09:30:12.091 +08:00] [INFO] [core/backup_impl_create_backup.go:501] ["Begin copy data"] [dbName=default] [collectionName=kb000043] [segmentNum=1] [2024/07/29 09:30:12.091 +08:00] [INFO] [core/backup_impl_create_backup.go:509] ["copy segment"] [collection_id=451333863845088053] [partition_id=451333863845088054] [segment_id=451333863845088140] [group_id=0] [2024/07/29 09:30:12.091 +08:00] [DEBUG] [core/backup_impl_create_backup.go:841] [insertPath] [bucket=a-bucket] [insertPath=files/insert_log/451333863845088053/451333863845088054/451333863845088140/] [2024/07/29 09:30:12.092 +08:00] [ERROR] [core/backup_impl_create_backup.go:509] ["Fail to fill segment backup info"] [collection_id=451333863845077768] [partition_id=451333863845077769] [segment_id=451333863845077825] [group_id=0] [error="Get empty input path, but segment should not be empty, files/insert_log/451333863845077768/451333863845077769/451333863845077825/"] [stack="github.com/zilliztech/milvus-backup/core.(*BackupContext).backupCollectionExecute\n\t/home/runner/work/milvus-backup/milvus-backup/core/backup_impl_create_backup.go:509\ngithub.com/zilliztech/milvus-backup/core.(*BackupContext).executeCreateBackup.func2\n\t/home/runner/work/milvus-backup/milvus-backup/core/backup_impl_create_backup.go:638\ngithub.com/zilliztech/milvus-backup/internal/common.(*WorkerPool).work.func1\n\t/home/runner/work/milvus-backup/milvus-backup/internal/common/workerpool.go:70\ngolang.org/x/sync/errgroup.(*Group).Go.func1\n\t/home/runner/go/pkg/mod/golang.org/x/[email protected]/errgroup/errgroup.go:75"]

Expected Behavior

No response

Steps To Reproduce

No response

Environment

milvus standalone : 2.3.3
milvus-backup: 0.4.12

Anything else?

No response