milvus-backup
milvus-backup copied to clipboard
zilliztech
Backup and restore tool for Milvus
### Current Behavior 1.使用命令进行备份 ./milvus-backup create -n backup1 --colls k_1522222211111111aaaaaaaaaaaaaaaa 2.同一套环境，进行恢复 ./milvus-backup restore -n backup1 -s _recover 3.通过attu查看，collection存在，数据不存在 ### Expected Behavior 1.查看minio备份情况，备份的bucket和数据都存在  2.查看attu，collection存在，数据没有恢复  3.我的backup.yaml如下： 配置文件目录：/home/runner/work/milvus-backup/milvus-backup/configs 配置文件内容： ```yaml #...
### Current Behavior swagger ui的接口文档中，Create backup的接口文档有如下参数，支持指定数据库名称db_collections { "async": true, "backup_name": "string", "collection_names": [ "string" ], "db_collections": "string", "force": true, "gc_pause_address": "string", "gc_pause_enable": true, "gc_pause_seconds": 0, "meta_only": true, "requestId": "string" }...
### Current Behavior After enabling authorization, where do i keep my client certificate ? ``` milvus: address: localhost port: 19530 authorizationEnabled: true ``` getting below error while checking ``` root@milvus-backup-tool:/opt/milvus#...
https://github.com/zilliztech/milvus-backup/blob/acdfde10069668e3bee15e12866dcc20e1faa69c/configs/backup.yaml#L18 If ```tlsMode : 2``` then how to update TLS path for client.pem, client.key and ca.pem in backup.yaml
 ### Current Behavior ./milvus-backup create -n backup_test The ip addresses entered in the backup configuration file are the milvus and minio addresses of the official environment I then copied...
This is not a critical issue. Tested recently and found out the log size from executing the create backup command exceeds 2MB (when number of binlog files are large). [code.1](https://github.com/zilliztech/milvus-backup/blob/main/core/backup_impl_create_backup.go#L728)...
### Is your feature request related to a problem? Please describe. The current cross-cluster backup and recovery operation is somewhat complicated, requiring a lot of manual intervention from users. ###...
### Current Behavior Ubuntu 20.04 Milvus v2.4.1 Milvus-backup v0.4.15 Cannot backup the db with sparse vector field. `[2024/06/25 08:18:49.561 +00:00] [INFO] [core/backup_impl_restore_backup.go:721] ["execute bulk insert"] [db=default] [collection=_123a5fee_0ab7_4431_b0d3_f6807fba5ae5_47f641da_e708_47f0_b4a0_89abf1544bb0_recover] [partition=_default] [files="[backup/test_backup/binlogs/insert_log/450567692780131941/450567692780131942/450684820018465243/,]"] [endTime=450705079402496]...
### Current Behavior 执行 milvus-backup create 命令一段时间后(大概十几分钟后), 报如下错误: [2024/10/10 09:38:14.554 +08:00] [ERROR] [storage/minio_chunk_manager.go:447] ["copyObject error"] [srcObjectKey=file/insert_log/452466374303636288/452466374303636289/452466374301282722/106/452466374301282742] [ dstObjectKey=file/my_backup/binlogs/insert_log/452466374303636288/452466374303636289/452466374301282722/452466374301282722/106/452466374301282742] [error="Put \"http://10.110.7.33:32000/backup-bucket/file/my_bac kup/binlogs/insert_log/452466374303636288/452466374303636289/452466374301282722/452466374301282722/106/452466374301282742\": net/http: timeout awaiting response headers"] [stack="github.com/zilliztech/milvus-bac kup/core/storage.(*MinioChunkManager).Copy\n\t/home/runner/work/milvus-backup/milvus-backup/core/storage/minio_chunk_manager.go:447\ngithub.com/zilliztech/milvus-backup/core/storage.(*Copier).copyRemote\n\t/home /runner/work/milvus-backup/milvus-backup/core/storage/copier.go:261\ngithub.com/zilliztech/milvus-backup/core/storage.(*Copier).Copy\n\t/home/runner/work/milvus-backup/milvus-backup/core/storage/copier.go:242\ng ithub.com/zilliztech/milvus-backup/core.(*BackupContext).copySegment.func2\n\t/home/runner/work/milvus-backup/milvus-backup/core/backup_impl_create_backup.go:859\ngithub.com/zilliztech/milvus-backup/internal/uti...
### Current Behavior I successfully backed up the data using the milvus-backup, but a message was displayed indicating that I could not find the backup file during data restoration ```...
