Zhen Ye
Zhen Ye
> Seems that data is gced for some reason? It seems that the problem is not caused by GC, the file can't be read in about a minute after flushing...
> > failed to load data from remote: Error in GetObjectSize[errcode:404, exception:, errmessage:No response body., params:params, bucket=bucket-laion2 > > 404 doesn't mean file not exist right? yes,I have tested it...
maybe related to: #29245?
Those segments is on `updateSegmentIndex` on every crash node. - Node may crashed with SEGSEGV. - Node may report some Assert error like issue metioned. - After segment compacted, No...
Maybe caused by same bug: #29828
GC Task blocks at scan (list) minio object. ``` goroutine 7744 [chan receive]: github.com/milvus-io/milvus/internal/storage.(*MinioObjectStorage).ListObjects(0xc0008dc280, {0x555e678, 0xc02db23720}, {0xc000418770, 0xd}, {0xc02d1a6be0, 0x10}, 0x1) /go/src/github.com/milvus-io/milvus/internal/storage/minio_object_storage.go:190 +0x525 github.com/milvus-io/milvus/internal/storage.(*RemoteChunkManager).listObjects(0xc0008eb530, {0x555e678, 0xc02db23720}, {0xc000418770, 0xd}, {0xc02d1a6be0, 0x10},...
> GC Task blocks at scan (list) minio object. > > ``` > goroutine 7744 [chan receive]: > github.com/milvus-io/milvus/internal/storage.(*MinioObjectStorage).ListObjects(0xc0008dc280, {0x555e678, 0xc02db23720}, {0xc000418770, 0xd}, {0xc02d1a6be0, 0x10}, 0x1) > /go/src/github.com/milvus-io/milvus/internal/storage/minio_object_storage.go:190 +0x525 >...
New fix has been merged into master. @ThreadDao Please verify it.
/run-cpu-e2e
/run-cpu-e2e