milvus
milvus copied to clipboard
Published
20 hours ago •
milvus-io
milvus-io
[Bug]: Streaming node crashed at insert growing segment
Is there an existing issue for this?
- [x] I have searched the existing issues
Environment
- Milvus version: 2.6.4
- Deployment mode(standalone or cluster): cluster
- MQ type(rocksmq, pulsar or kafka):
- SDK version(e.g. pymilvus v2.0.0rc2):
- OS(Ubuntu or CentOS):
- CPU/Memory:
- GPU:
- Others:
Current Behavior
2025-10-29 19:02:39.212 _ZN6milvus7segcore19InsertRecordGrowing9insert_pkERKSt7variantIJSt9monostatelNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEEEEl
2025-10-29 19:02:39.212 /root/milvus/internal/core/src/segcore/InsertRecord.h:920 pc=0x7df841ed3b5b
2025-10-29 19:02:39.212 _ZN6milvus7segcore18SegmentGrowingImpl6InsertEllPKlPKmPNS_5proto7segcore12InsertRecordE
2025-10-29 19:02:39.212 /root/milvus/internal/core/src/segcore/SegmentGrowingImpl.cpp:248 pc=0x7df841ed3b5b
2025-10-29 19:02:39.413 Insert
2025-10-29 19:02:39.413 /root/milvus/internal/core/src/segcore/segment_c.cpp:346 pc=0x7df841fc3683
2025-10-29 19:02:39.413 _cgo_b375adbfd914_Cfunc_Insert
2025-10-29 19:02:39.413 /tmp/go-build/cgo-gcc-prolog:319 pc=0x65ad92b
2025-10-29 19:02:39.413 runtime.asmcgocall
2025-10-29 19:02:39.413 /usr/local/go/src/runtime/asm_amd64.s:923 pc=0x268ffe3
2025-10-29 19:02:39.413
2025-10-29 19:02:39.413
2025-10-29 19:02:39.415 SIGSEGV: segmentation violation
2025-10-29 19:02:39.415 PC=0x7df841ed3b5b m=39818 sigcode=128 addr=0x0
2025-10-29 19:02:39.415 signal arrived during cgo execution
2025-10-29 19:02:39.415
2025-10-29 19:02:39.415 goroutine 104777911 gp=0xc0af53e8c0 m=39818 mp=0xc057ef7008 [syscall, locked to thread]:
2025-10-29 19:02:39.415 _ZN6milvus7segcore19InsertRecordGrowing9insert_pkERKSt7variantIJSt9monostatelNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEEEEl
2025-10-29 19:02:39.415 /root/milvus/internal/core/src/segcore/InsertRecord.h:920 pc=0x7df841ed3b5b
2025-10-29 19:02:39.415 _ZN6milvus7segcore18SegmentGrowingImpl6InsertEllPKlPKmPNS_5proto7segcore12InsertRecordE
2025-10-29 19:02:39.415 /root/milvus/internal/core/src/segcore/SegmentGrowingImpl.cpp:248 pc=0x7df841ed3b5b
2025-10-29 19:02:39.415 Insert
2025-10-29 19:02:39.415 /root/milvus/internal/core/src/segcore/segment_c.cpp:346 pc=0x7df841fc3683
2025-10-29 19:02:39.415 runtime.cgocall(0x65ad8f0, 0xc0528a0d80)
2025-10-29 19:02:39.415 /usr/local/go/src/runtime/cgocall.go:167 +0x4b fp=0xc0528a0d58 sp=0xc0528a0d20 pc=0x268326b
2025-10-29 19:02:39.415 github.com/milvus-io/milvus/internal/util/segcore._Cfunc_Insert(0x7df734460600, 0x12d, 0x1, 0xc0e6f92de8, 0xc0e6f92df0, 0xc08339c400, 0x8ab)
2025-10-29 19:02:39.415 _cgo_gotypes.go:712 +0x4f fp=0xc0528a0d80 sp=0xc0528a0d58 pc=0x555c58f
2025-10-29 19:02:39.415 github.com/milvus-io/milvus/internal/util/segcore.(*cSegmentImpl).Insert.func1(...)
2025-10-29 19:02:39.415 /root/milvus/internal/util/segcore/segment.go:224
2025-10-29 19:02:39.415 github.com/milvus-io/milvus/internal/util/segcore.(*cSegmentImpl).Insert(0xc0b32c9aa0, {0x0?, 0x0?}, 0xc0bb4ae480)
2025-10-29 19:02:39.415 /root/milvus/internal/util/segcore/segment.go:224 +0x17b fp=0xc0528a0e40 sp=0xc0528a0d80 pc=0x5562c7b
2025-10-29 19:02:39.415 github.com/milvus-io/milvus/internal/querynodev2/segments.(*LocalSegment).Insert.func1()
2025-10-29 19:02:39.415 /root/milvus/internal/querynodev2/segments/segment.go:733 +0x19d fp=0xc0528a0f20 sp=0xc0528a0e40 pc=0x630df1d
2025-10-29 19:02:39.415 github.com/milvus-io/milvus/pkg/v2/util/conc.(*Pool[...]).Submit.func1()
2025-10-29 19:02:39.415 /root/milvus/pkg/util/conc/pool.go:82 +0x9e fp=0xc0528a0f80 sp=0xc0528a0f20 pc=0x5510a7e
2025-10-29 19:02:39.415 github.com/panjf2000/ants/v2.(*goWorker).run.func1()
2025-10-29 19:02:39.415 /go/pkg/mod/github.com/panjf2000/ants/[email protected]/worker.go:73 +0x8a fp=0xc0528a0fe0 sp=0xc0528a0f80 pc=0x4de93aa
2025-10-29 19:02:39.415 runtime.goexit({})
2025-10-29 19:02:39.415 /usr/local/go/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0528a0fe8 sp=0xc0528a0fe0 pc=0x2690361
2025-10-29 19:02:39.415 created by github.com/panjf2000/ants/v2.(*goWorker).run in goroutine 3105
2025-10-29 19:02:39.415 /go/pkg/mod/github.com/panjf2000/ants/[email protected]/worker.go:50 +0x65
Expected Behavior
No response
Steps To Reproduce
Milvus Log
No response
Anything else?
No response
Cannot reproduced recently.
Common labels: {"app":"milvus","cluster":"milvus-gcp-us-west1-1","job":"milvus-in01-604dfc451a712e6/milvus","namespace":"milvus-in01-604dfc451a712e6"}
Line limit: "10000 (42 returned)"
Total bytes processed: "24.7 MB"
2025-10-29 19:02:35.008 [2025/10/29 19:02:35.008 +00:00] [INFO] [delegator/delegator_data.go:173] ["insert into growing segment"] [collectionID=460987332415134116] [channel=in01-604dfc451a712e6-rootcoord-dml_5_460987332415134116v0] [replicaID=460987366162045156] [collectionID=460987332415134116] [segmentID=461802471795537088] [rowCount=50] [maxTimestamp=461836007439859732]
2025-10-29 19:02:35.015 [2025/10/29 19:02:35.015 +00:00] [INFO] [delegator/delegator_data.go:173] ["insert into growing segment"] [collectionID=460987332415134116] [channel=in01-604dfc451a712e6-rootcoord-dml_1_460987332415134116v1] [replicaID=460987366162045156] [collectionID=460987332415134116] [segmentID=461802471795537087] [rowCount=50] [maxTimestamp=461836007439859733]
2025-10-29 19:02:35.286 [2025/10/29 19:02:35.286 +00:00] [INFO] [task/executor.go:363] ["release segment..."] [taskID=1761636841167] [collectionID=457840590649577239] [replicaID=457840625801235182] [segmentID=457840590692720261] [node=1516] [source=balance_checker] [shardLeader=1512]
2025-10-29 19:02:35.287 [2025/10/29 19:02:35.286 +00:00] [INFO] [querynodev2/services.go:631] ["received release segment request"] [traceID=ecd18e8d1ed3414ef000fc1d7671cd9b] [collectionID=457840590649577239] [shard=in01-604dfc451a712e6-rootcoord-dml_8_457840590649577239v0] [segmentIDs="[457840590692720261]"] [currentNodeID=1512] [scope=Historical] [needTransfer=true]
2025-10-29 19:02:35.287 [2025/10/29 19:02:35.287 +00:00] [INFO] [delegator/delegator_data.go:794] ["delegator start to release segments"] [traceID=ecd18e8d1ed3414ef000fc1d7671cd9b] [collectionID=457840590649577239] [channel=in01-604dfc451a712e6-rootcoord-dml_8_457840590649577239v0] [replicaID=457840625801235182] [segmentIDs="[457840590692720261]"] [nodeID=1516] [scope=Historical] [force=false]
2025-10-29 19:02:35.287 [2025/10/29 19:02:35.287 +00:00] [INFO] [querynodev2/services.go:631] ["received release segment request"] [traceID=ecd18e8d1ed3414ef000fc1d7671cd9b] [collectionID=457840590649577239] [shard=in01-604dfc451a712e6-rootcoord-dml_8_457840590649577239v0] [segmentIDs="[457840590692720261]"] [currentNodeID=1516] [scope=Historical] [needTransfer=false]
2025-10-29 19:02:35.287 [2025/10/29 19:02:35.287 +00:00] [INFO] [querynodev2/services.go:661] ["start to release segments"] [traceID=ecd18e8d1ed3414ef000fc1d7671cd9b] [collectionID=457840590649577239] [shard=in01-604dfc451a712e6-rootcoord-dml_8_457840590649577239v0] [segmentIDs="[457840590692720261]"] [currentNodeID=1516]
2025-10-29 19:02:35.288 [2025/10/29 19:02:35.287 +00:00] [INFO] [segments/segment.go:1443] ["delete segment from memory"] [traceID=ecd18e8d1ed3414ef000fc1d7671cd9b] [collectionID=457840590649577239] [partitionID=457840590649577240] [segmentID=457840590692720261] [segmentType=Sealed] [insertCount=89]
2025-10-29 19:02:35.288 [2025/10/29 19:02:35.288 +00:00] [INFO] [segments/collection.go:161] ["release collection due to ref count to 0"] [nodeID=1516] [collectionID=457840590649577239]
2025-10-29 19:02:35.291 [2025/10/29 19:02:35.291 +00:00] [INFO] [task/executor.go:371] ["release segment done"] [taskID=1761636841167] [collectionID=457840590649577239] [replicaID=457840625801235182] [segmentID=457840590692720261] [node=1516] [source=balance_checker] [shardLeader=1512] [taskID=1761636841167] ["time taken"=4.826633ms]
2025-10-29 19:02:35.361 {"log_type": "ACCESS","log_format": "BASE","time": "2025/10/29 19:02:35.361 +00:00", "method_name": "Insert", "user_name": "db_31fa0b92aef9139", "user_addr": "tcp-10.33.139.133:47024", "method_status": "Successful", "error_code": "0", "sdk_version": "Golang-Unknown", "error_msg": "", "trace_id": "435700ed5a9dc341a0dc2246266eef3f", "time_cost": "19.977929ms", "database_name": "db_31fa0b92aef9139", "collection_name": "hybrid_code_chunks_1d8f6613", "partition_name": "", "method_expr": "Unknown","instance_id": "in01-604dfc451a712e6"}
2025-10-29 19:02:35.423 [2025/10/29 19:02:35.423 +00:00] [INFO] [delegator/delegator_data.go:173] ["insert into growing segment"] [collectionID=461802471742224761] [channel=in01-604dfc451a712e6-rootcoord-dml_10_461802471742224761v0] [replicaID=461802491889320242] [collectionID=461802471742224761] [segmentID=461802471756364379] [rowCount=13] [maxTimestamp=461836007544717329]
2025-10-29 19:02:36.022 [2025/10/29 19:02:36.022 +00:00] [INFO] [delegator/delegator_data.go:173] ["insert into growing segment"] [collectionID=460987331679714620] [channel=in01-604dfc451a712e6-rootcoord-dml_5_460987331679714620v0] [replicaID=461711974072320029] [collectionID=460987331679714620] [segmentID=461802471760956318] [rowCount=5] [maxTimestamp=461836007702003732]
2025-10-29 19:02:36.443 {"log_type": "ACCESS","log_format": "BASE","time": "2025/10/29 19:02:36.442 +00:00", "method_name": "Insert", "user_name": "db_bd809e649911799", "user_addr": "tcp-10.33.139.133:57408", "method_status": "Successful", "error_code": "0", "sdk_version": "Golang-Unknown", "error_msg": "", "trace_id": "c5007fce909203c8b0d812f09dd2b708", "time_cost": "7.647575ms", "database_name": "db_bd809e649911799", "collection_name": "companies_info", "partition_name": "", "method_expr": "Unknown","instance_id": "in01-604dfc451a712e6"}
2025-10-29 19:02:36.608 [2025/10/29 19:02:36.608 +00:00] [INFO] [delegator/delegator_data.go:173] ["insert into growing segment"] [collectionID=452194404470429420] [channel=in01-604dfc451a712e6-rootcoord-dml_4_452194404470429420v0] [replicaID=452194404465377570] [collectionID=452194404470429420] [segmentID=461802471795536650] [rowCount=1] [maxTimestamp=461836007859552269]
2025-10-29 19:02:36.720 {"log_type": "ACCESS","log_format": "BASE","time": "2025/10/29 19:02:36.720 +00:00", "method_name": "Insert", "user_name": "db_bd809e649911799", "user_addr": "tcp-10.33.139.133:47036", "method_status": "Successful", "error_code": "0", "sdk_version": "Golang-Unknown", "error_msg": "", "trace_id": "1d522dae471529b1274d30c864246314", "time_cost": "7.059337ms", "database_name": "db_bd809e649911799", "collection_name": "companies_info", "partition_name": "", "method_expr": "Unknown","instance_id": "in01-604dfc451a712e6"}
2025-10-29 19:02:36.794 {"log_type": "ACCESS","log_format": "BASE","time": "2025/10/29 19:02:36.794 +00:00", "method_name": "Insert", "user_name": "db_bd809e649911799", "user_addr": "tcp-10.33.139.133:57408", "method_status": "Successful", "error_code": "0", "sdk_version": "Golang-Unknown", "error_msg": "", "trace_id": "477f12581c2327941c84cb560ec5f222", "time_cost": "7.627241ms", "database_name": "db_bd809e649911799", "collection_name": "companies_info", "partition_name": "", "method_expr": "Unknown","instance_id": "in01-604dfc451a712e6"}
2025-10-29 19:02:36.805 [2025/10/29 19:02:36.805 +00:00] [INFO] [delegator/delegator_data.go:173] ["insert into growing segment"] [collectionID=452194404470429420] [channel=in01-604dfc451a712e6-rootcoord-dml_4_452194404470429420v0] [replicaID=452194404465377570] [collectionID=452194404470429420] [segmentID=461802471795536650] [rowCount=1] [maxTimestamp=461836007911718926]
2025-10-29 19:02:36.808 [2025/10/29 19:02:36.807 +00:00] [INFO] [delegator/delegator_data.go:173] ["insert into growing segment"] [collectionID=452194404470429420] [channel=in01-604dfc451a712e6-rootcoord-dml_4_452194404470429420v0] [replicaID=452194404465377570] [collectionID=452194404470429420] [segmentID=461802471795536650] [rowCount=1] [maxTimestamp=461836007911718927]
2025-10-29 19:02:37.223 [2025/10/29 19:02:37.223 +00:00] [INFO] [delegator/delegator_data.go:173] ["insert into growing segment"] [collectionID=460987331679714620] [channel=in01-604dfc451a712e6-rootcoord-dml_5_460987331679714620v0] [replicaID=461711974072320029] [collectionID=460987331679714620] [segmentID=461802471760956318] [rowCount=4] [maxTimestamp=461836008016314386]
2025-10-29 19:02:37.813 [2025/10/29 19:02:37.813 +00:00] [INFO] [delegator/delegator_data.go:173] ["insert into growing segment"] [collectionID=460987331679714620] [channel=in01-604dfc451a712e6-rootcoord-dml_5_460987331679714620v0] [replicaID=461711974072320029] [collectionID=460987331679714620] [segmentID=461802471760956318] [rowCount=1] [maxTimestamp=461836008173862928]
2025-10-29 19:02:37.816 [2025/10/29 19:02:37.814 +00:00] [INFO] [delegator/delegator_data.go:173] ["insert into growing segment"] [collectionID=460987332415134116] [channel=in01-604dfc451a712e6-rootcoord-dml_1_460987332415134116v1] [replicaID=460987366162045156] [collectionID=460987332415134116] [segmentID=461802471795537087] [rowCount=56] [maxTimestamp=461836008173862936]
2025-10-29 19:02:37.816 [2025/10/29 19:02:37.814 +00:00] [INFO] [delegator/delegator_data.go:173] ["insert into growing segment"] [collectionID=460987332415134116] [channel=in01-604dfc451a712e6-rootcoord-dml_5_460987332415134116v0] [replicaID=460987366162045156] [collectionID=460987332415134116] [segmentID=461802471795537088] [rowCount=44] [maxTimestamp=461836008173862935]
2025-10-29 19:02:38.041 [2025/10/29 19:02:38.040 +00:00] [INFO] [balance/score_based_balancer.go:462] ["balance plan generated"] [collection=460987332270967358] ["replica id"=460987366162044927] ["replica group"=__default_resource_group] [nodesInfo="[\"NodeItemInfo {NodeID: 1515, AssignedScore: 2528208.800000, CurrentScore: 2528087.000000, Priority: -121}, memory factor 32768.000000, delegator score: 0.000000\",\"NodeItemInfo {NodeID: 1514, AssignedScore: 2528208.800000, CurrentScore: 2528086.000000, Priority: -122}, memory factor 32768.000000, delegator score: 0.000000\",\"NodeItemInfo {NodeID: 1512, AssignedScore: 2617.000000, CurrentScore: 2617.000000, Priority: 0}, memory factor 32768.000000, delegator score: 0.000000\",\"NodeItemInfo {NodeID: 1518, AssignedScore: 2528208.800000, CurrentScore: 2528099.000000, Priority: -109}, memory factor 32768.000000, delegator score: 0.000000\",\"NodeItemInfo {NodeID: 1516, AssignedScore: 2528208.800000, CurrentScore: 2528226.000000, Priority: 18}, memory factor 32768.000000, delegator score: 0.000000\",\"NodeItemInfo {NodeID: 1519, AssignedScore: 2528208.800000, CurrentScore: 2528546.000000, Priority: 338}, memory factor 32768.000000, delegator score: 0.000000\"]"] ["report details"="[\"node 1512 skip balance since current score(2617.000000) lower than assigned one (2617.000000)\",\"node 1515 skip balance since current score(2528087.000000) lower than assigned one (2528208.800000)\",\"node 1514 skip balance since current score(2528086.000000) lower than assigned one (2528208.800000)\",\"node 1518 skip balance since current score(2528099.000000) lower than assigned one (2528208.800000)\",\"pick segment 460987332270969006 with score 108.900000 from node 1516\",\"stop add segment candidate since node[1516] current score(2528117.100000) below assigned(2528208.800000)\",\"add segment plan {ID:460987332270969006 collectionID:460987332270967358 partitionID:460987332270967359 insert_channel:\\\"in01-604dfc451a712e6-rootcoord-dml_10_460987332270967358v0\\\" num_of_rows:99 level:L1 is_sorted:true %!s(*meta.Replica=<nil>) %!s(int64=1516) %!s(int64=1514) %!s(int64=18) %!s(int64=-122) %!s(int64=108) HIGH}\"]"]
2025-10-29 19:02:38.041 [2025/10/29 19:02:38.041 +00:00] [INFO] [balance/utils.go:74] ["create segment task"] [collection=460987332270967358] [segmentID=460987332270969006] [replica=460987366162044927] [channel=in01-604dfc451a712e6-rootcoord-dml_10_460987332270967358v0] [level=L1] [loadPriority=0] [from=1516] [to=1514]
2025-10-29 19:02:38.081 [2025/10/29 19:02:38.081 +00:00] [INFO] [segments/collection.go:112] ["new collection created"] [collectionID=460987332270967358] [schema="name:\"ps_chunks\" fields:{name:\"RowID\" description:\"row id\" data_type:Int64} fields:{fieldID:1 name:\"Timestamp\" description:\"time stamp\" data_type:Int64} fields:{fieldID:100 name:\"url\" data_type:VarChar type_params:{key:\"max_length\" value:\"65535\"}} fields:{fieldID:101 name:\"text\" data_type:VarChar type_params:{key:\"max_length\" value:\"65535\"}} fields:{fieldID:102 name:\"pk\" is_primary_key:true data_type:Int64 autoID:true} fields:{fieldID:103 name:\"vector\" data_type:FloatVector type_params:{key:\"dim\" value:\"1536\"}}"] []
2025-10-29 19:02:38.087 [2025/10/29 19:02:38.087 +00:00] [INFO] [segments/segment.go:379] ["create segment done"] [traceID=bff4a0c03440e3d086aa7b22f5faf2c5] [collectionID=460987332270967358] [partitionID=460987332270967359] [segmentID=460987332270969006] [segmentType=Sealed] [level=L1]
2025-10-29 19:02:38.467 W20251029 19:02:38.467010 246424 index_static.cc:43] [KNOWHERE][CreateConfig][CGO_DYN] unhandled create config for indexType: SPARSE_WAND
2025-10-29 19:02:38.468 W20251029 19:02:38.468717 257905 index_static.cc:43] [KNOWHERE][CreateConfig][CGO_DYN] unhandled create config for indexType: SPARSE_WAND
2025-10-29 19:02:38.470 W20251029 19:02:38.470110 284735 index_static.cc:43] [KNOWHERE][CreateConfig][CGO_DYN] unhandled create config for indexType: SPARSE_WAND
2025-10-29 19:02:38.556 {"log_type": "ACCESS","log_format": "BASE","time": "2025/10/29 19:02:38.556 +00:00", "method_name": "Insert", "user_name": "db_bd809e649911799", "user_addr": "tcp-10.33.139.133:57408", "method_status": "Successful", "error_code": "0", "sdk_version": "Golang-Unknown", "error_msg": "", "trace_id": "1281d9b2237f2673bf68aa8ee827eb65", "time_cost": "9.537862ms", "database_name": "db_bd809e649911799", "collection_name": "companies_info", "partition_name": "", "method_expr": "Unknown","instance_id": "in01-604dfc451a712e6"}
2025-10-29 19:02:38.609 [2025/10/29 19:02:38.609 +00:00] [INFO] [delegator/delegator_data.go:173] ["insert into growing segment"] [collectionID=452194404470429420] [channel=in01-604dfc451a712e6-rootcoord-dml_4_452194404470429420v0] [replicaID=452194404465377570] [collectionID=452194404470429420] [segmentID=461802471795536650] [rowCount=1] [maxTimestamp=461836008383316340]
2025-10-29 19:02:38.812 [2025/10/29 19:02:38.812 +00:00] [INFO] [delegator/delegator_data.go:173] ["insert into growing segment"] [collectionID=460987331679714620] [channel=in01-604dfc451a712e6-rootcoord-dml_5_460987331679714620v0] [replicaID=461711974072320029] [collectionID=460987331679714620] [segmentID=461802471760956318] [rowCount=4] [maxTimestamp=461836008435745159]
2025-10-29 19:02:38.826 [2025/10/29 19:02:38.826 +00:00] [INFO] [task/executor.go:363] ["release segment..."] [taskID=1761636841168] [collectionID=460987332270967358] [replicaID=460987366162044927] [segmentID=460987332270969006] [node=1516] [source=balance_checker] [shardLeader=1512]
2025-10-29 19:02:38.826 [2025/10/29 19:02:38.826 +00:00] [INFO] [querynodev2/services.go:631] ["received release segment request"] [traceID=bff4a0c03440e3d086aa7b22f5faf2c5] [collectionID=460987332270967358] [shard=in01-604dfc451a712e6-rootcoord-dml_10_460987332270967358v0] [segmentIDs="[460987332270969006]"] [currentNodeID=1512] [scope=Historical] [needTransfer=true]
2025-10-29 19:02:38.826 [2025/10/29 19:02:38.826 +00:00] [INFO] [delegator/delegator_data.go:794] ["delegator start to release segments"] [traceID=bff4a0c03440e3d086aa7b22f5faf2c5] [collectionID=460987332270967358] [channel=in01-604dfc451a712e6-rootcoord-dml_10_460987332270967358v0] [replicaID=460987366162044927] [segmentIDs="[460987332270969006]"] [nodeID=1516] [scope=Historical] [force=false]
2025-10-29 19:02:38.827 [2025/10/29 19:02:38.826 +00:00] [INFO] [querynodev2/services.go:631] ["received release segment request"] [traceID=bff4a0c03440e3d086aa7b22f5faf2c5] [collectionID=460987332270967358] [shard=in01-604dfc451a712e6-rootcoord-dml_10_460987332270967358v0] [segmentIDs="[460987332270969006]"] [currentNodeID=1516] [scope=Historical] [needTransfer=false]
2025-10-29 19:02:38.827 [2025/10/29 19:02:38.827 +00:00] [INFO] [querynodev2/services.go:661] ["start to release segments"] [traceID=bff4a0c03440e3d086aa7b22f5faf2c5] [collectionID=460987332270967358] [shard=in01-604dfc451a712e6-rootcoord-dml_10_460987332270967358v0] [segmentIDs="[460987332270969006]"] [currentNodeID=1516]
2025-10-29 19:02:38.827 [2025/10/29 19:02:38.827 +00:00] [INFO] [segments/segment.go:1443] ["delete segment from memory"] [traceID=bff4a0c03440e3d086aa7b22f5faf2c5] [collectionID=460987332270967358] [partitionID=460987332270967359] [segmentID=460987332270969006] [segmentType=Sealed] [insertCount=99]
2025-10-29 19:02:38.827 [2025/10/29 19:02:38.827 +00:00] [INFO] [segments/collection.go:161] ["release collection due to ref count to 0"] [nodeID=1516] [collectionID=460987332270967358]
2025-10-29 19:02:38.832 [2025/10/29 19:02:38.832 +00:00] [INFO] [task/executor.go:371] ["release segment done"] [taskID=1761636841168] [collectionID=460987332270967358] [replicaID=460987366162044927] [segmentID=460987332270969006] [node=1516] [source=balance_checker] [shardLeader=1512] [taskID=1761636841168] ["time taken"=6.815664ms]
2025-10-29 19:02:39.415 SIGSEGV: segmentation violation
There's no new created growing segment or releasing growing segment, So it's not concurrent problem on go side, some memory unsafe access may happen at segcore.