matrixone
matrixone copied to clipboard
Published
20 hours ago •
matrixorigin
matrixorigin
[Bug]: UT TestDelete3 failed
Is there an existing issue for the same bug?
- [X] I have checked the existing issues.
Environment
- Version or commit-id (e.g. v0.1.0 or 8b23a93):
- Hardware parameters:
- OS type:
- Others:
Actual Behavior
https://github.com/matrixorigin/matrixone/actions/runs/6505453119/job/17669102751?pr=12103
Expected Behavior
No response
Steps to Reproduce
No response
Additional information
No response
another failed link:https://github.com/matrixorigin/matrixone/actions/runs/7159480602/job/19492786109?pr=13271
https://github.com/matrixorigin/matrixone/actions/runs/7320342629/job/19939334738?pr=13779
repro：https://github.com/matrixorigin/matrixone/actions/runs/8982550007/job/24670410339?pr=15876
repro: https://github.com/matrixorigin/matrixone/actions/runs/9042943535/job/24850082568
data race occurred:
2024-05-11T10:58:43.4740830Z ==================
2024-05-11T10:58:43.4741020Z WARNING: DATA RACE
2024-05-11T10:58:43.4741250Z Read at 0x00c0022b08d0 by goroutine 4440:
2024-05-11T10:58:43.4741450Z runtime.mapiterinit()
2024-05-11T10:58:43.4742070Z /Users/runner/hostedtoolcache/go/1.21.5/x64/src/runtime/map.go:816 +0x0
2024-05-11T10:58:43.4743060Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/tables/updates.(*ObjectMVCCHandle).GetChangeIntentionCnt()
2024-05-11T10:58:43.4743920Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/tables/updates/mvcc.go:386 +0x84
2024-05-11T10:58:43.4744640Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/tables.(*aobject).estimateRawScore()
2024-05-11T10:58:43.4745400Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/tables/aobj.go:367 +0x2f3
2024-05-11T10:58:43.4746170Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/tables.(*aobject).RunCalibration()
2024-05-11T10:58:43.4746920Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/tables/aobj.go:384 +0x26
2024-05-11T10:58:43.4747720Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/logtail.(*dirtyCollector).tryCompactTree()
2024-05-11T10:58:43.4748550Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/logtail/collector.go:435 +0xd8c
2024-05-11T10:58:43.4749560Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/logtail.(*dirtyCollector).cleanupStorage.func1()
2024-05-11T10:58:43.4750390Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/logtail/collector.go:355 +0x37d
2024-05-11T10:58:43.4750820Z github.com/tidwall/btree.(*BTreeG[go.shape.*uint8]).nodeScan()
2024-05-11T10:58:43.4751500Z /Users/runner/go/pkg/mod/github.com/tidwall/[email protected]/btreeg.go:372 +0x28d
2024-05-11T10:58:43.4751890Z github.com/tidwall/btree.(*BTreeG[go.shape.*uint8]).scan()
2024-05-11T10:58:43.4752570Z /Users/runner/go/pkg/mod/github.com/tidwall/[email protected]/btreeg.go:364 +0x1bc
2024-05-11T10:58:43.4753020Z github.com/tidwall/btree.(*BTreeG[go.shape.*uint8]).Scan()
2024-05-11T10:58:43.4753690Z /Users/runner/go/pkg/mod/github.com/tidwall/[email protected]/btreeg.go:351 +0xee
2024-05-11T10:58:43.4754480Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/logtail.(*dirtyCollector).cleanupStorage()
2024-05-11T10:58:43.4755310Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/logtail/collector.go:346 +0x5a
2024-05-11T10:58:43.4755960Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/logtail.(*dirtyCollector).Run()
2024-05-11T10:58:43.4756790Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/logtail/collector.go:182 +0x177
2024-05-11T10:58:43.4757410Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/db/test.TestDelete3.func1()
2024-05-11T10:58:43.4758220Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/db/test/db_test.go:3287 +0x39
2024-05-11T10:58:43.4758940Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/tasks/worker.(*lamdaHandle).OnExec()
2024-05-11T10:58:43.4759840Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/tasks/worker/heartbeater.go:32 +0x45
2024-05-11T10:58:43.4760610Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/tasks/worker.(*heartbeater).Start.func1()
2024-05-11T10:58:43.4761530Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/tasks/worker/heartbeater.go:76 +0x11d
2024-05-11T10:58:43.4761550Z
2024-05-11T10:58:43.4761850Z Previous write at 0x00c0022b08d0 by goroutine 4374:
2024-05-11T10:58:43.4762040Z runtime.mapassign()
2024-05-11T10:58:43.4762660Z /Users/runner/hostedtoolcache/go/1.21.5/x64/src/runtime/map.go:579 +0x0
2024-05-11T10:58:43.4763650Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/tables/updates.(*ObjectMVCCHandle).GetOrCreateDeleteChain()
2024-05-11T10:58:43.4764650Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/tables/updates/mvcc.go:368 +0xad
2024-05-11T10:58:43.4765360Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/tables.(*baseObject).RangeDelete()
2024-05-11T10:58:43.4766130Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/tables/base.go:761 +0x1d5
2024-05-11T10:58:43.4766780Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/tables.(*aobject).RangeDelete()
2024-05-11T10:58:43.4767010Z <autogenerated>:1 +0xb7
2024-05-11T10:58:43.4767740Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/txn/txnimpl.(*txnTable).RangeDelete()
2024-05-11T10:58:43.4768560Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/txn/txnimpl/table.go:812 +0xa09
2024-05-11T10:58:43.4769350Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/txn/txnimpl.(*txnDB).RangeDelete()
2024-05-11T10:58:43.4770180Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/txn/txnimpl/txndb.go:152 +0xe5
2024-05-11T10:58:43.4770910Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/txn/txnimpl.(*txnStore).RangeDelete()
2024-05-11T10:58:43.4771820Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/txn/txnimpl/store.go:322 +0xb0
2024-05-11T10:58:43.4772780Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/txn/txnimpl.(*txnRelation).DeleteByPhyAddrKeys.func1()
2024-05-11T10:58:43.4773650Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/txn/txnimpl/relation.go:279 +0x2c1
2024-05-11T10:58:43.4774720Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/containers.ForeachWindowFixed[go.shape.[24]uint8]()
2024-05-11T10:58:43.4775540Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/containers/utils.go:702 +0x3f5
2024-05-11T10:58:43.4776240Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/containers.ForeachVectorWindow()
2024-05-11T10:58:43.4777040Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/containers/utils.go:595 +0xd54
2024-05-11T10:58:43.4777910Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/txn/txnimpl.(*txnRelation).DeleteByPhyAddrKeys()
2024-05-11T10:58:43.4778790Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/txn/txnimpl/relation.go:272 +0x2a5
2024-05-11T10:58:43.4779580Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/db/testutil.(*TestEngine).DeleteAll()
2024-05-11T10:58:43.4780430Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/db/testutil/engine.go:246 +0x47d
2024-05-11T10:58:43.4780990Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/db/test.TestDelete3()
2024-05-11T10:58:43.4781800Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/db/test/db_test.go:3311 +0x5c6
2024-05-11T10:58:43.4781980Z testing.tRunner()
2024-05-11T10:58:43.4782660Z /Users/runner/hostedtoolcache/go/1.21.5/x64/src/testing/testing.go:1595 +0x261
2024-05-11T10:58:43.4782860Z testing.(*T).Run.func1()
2024-05-11T10:58:43.4783530Z /Users/runner/hostedtoolcache/go/1.21.5/x64/src/testing/testing.go:1648 +0x44
2024-05-11T10:58:43.4783540Z
2024-05-11T10:58:43.4783750Z Goroutine 4440 (running) created at:
2024-05-11T10:58:43.4784460Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/tasks/worker.(*heartbeater).Start()
2024-05-11T10:58:43.4785380Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/tasks/worker/heartbeater.go:67 +0x12d
2024-05-11T10:58:43.4785940Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/db/test.TestDelete3()
2024-05-11T10:58:43.4786750Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/db/test/db_test.go:3290 +0x374
2024-05-11T10:58:43.4786940Z testing.tRunner()
2024-05-11T10:58:43.4787610Z /Users/runner/hostedtoolcache/go/1.21.5/x64/src/testing/testing.go:1595 +0x261
2024-05-11T10:58:43.4787810Z testing.(*T).Run.func1()
2024-05-11T10:58:43.4788480Z /Users/runner/hostedtoolcache/go/1.21.5/x64/src/testing/testing.go:1648 +0x44
2024-05-11T10:58:43.4788490Z
2024-05-11T10:58:43.4788700Z Goroutine 4374 (running) created at:
2024-05-11T10:58:43.4789030Z testing.(*T).Run()
2024-05-11T10:58:43.4789730Z /Users/runner/hostedtoolcache/go/1.21.5/x64/src/testing/testing.go:1648 +0x845
2024-05-11T10:58:43.4789950Z testing.runTests.func1()
2024-05-11T10:58:43.4790610Z /Users/runner/hostedtoolcache/go/1.21.5/x64/src/testing/testing.go:2054 +0x84
2024-05-11T10:58:43.4790800Z testing.tRunner()
2024-05-11T10:58:43.4791470Z /Users/runner/hostedtoolcache/go/1.21.5/x64/src/testing/testing.go:1595 +0x261
2024-05-11T10:58:43.4791660Z testing.runTests()
2024-05-11T10:58:43.4792330Z /Users/runner/hostedtoolcache/go/1.21.5/x64/src/testing/testing.go:2052 +0x8ad
2024-05-11T10:58:43.4792510Z testing.(*M).Run()
2024-05-11T10:58:43.4793180Z /Users/runner/hostedtoolcache/go/1.21.5/x64/src/testing/testing.go:1925 +0xcd7
2024-05-11T10:58:43.4793350Z main.main()
2024-05-11T10:58:43.4793600Z _testmain.go:399 +0x2bd
2024-05-11T10:58:43.4793760Z ==================
2024-05-11T10:58:43.4798880Z ==================
2024-05-11T10:58:43.4799150Z WARNING: DATA RACE
2024-05-11T10:58:43.4799390Z Read at 0x00c0038f6498 by goroutine 4440:
2024-05-11T10:58:43.4800600Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/tables/updates.(*ObjectMVCCHandle).GetChangeIntentionCnt()
2024-05-11T10:58:43.4801490Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/tables/updates/mvcc.go:386 +0xa4
2024-05-11T10:58:43.4802210Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/tables.(*aobject).estimateRawScore()
2024-05-11T10:58:43.4803190Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/tables/aobj.go:367 +0x2f3
2024-05-11T10:58:43.4803900Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/tables.(*aobject).RunCalibration()
2024-05-11T10:58:43.4804640Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/tables/aobj.go:384 +0x26
2024-05-11T10:58:43.4805440Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/logtail.(*dirtyCollector).tryCompactTree()
2024-05-11T10:58:43.4806270Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/logtail/collector.go:435 +0xd8c
2024-05-11T10:58:43.4807130Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/logtail.(*dirtyCollector).cleanupStorage.func1()
2024-05-11T10:58:43.4808070Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/logtail/collector.go:355 +0x37d
2024-05-11T10:58:43.4808490Z github.com/tidwall/btree.(*BTreeG[go.shape.*uint8]).nodeScan()
2024-05-11T10:58:43.4809300Z /Users/runner/go/pkg/mod/github.com/tidwall/[email protected]/btreeg.go:372 +0x28d
2024-05-11T10:58:43.4809690Z github.com/tidwall/btree.(*BTreeG[go.shape.*uint8]).scan()
2024-05-11T10:58:43.4810340Z /Users/runner/go/pkg/mod/github.com/tidwall/[email protected]/btreeg.go:364 +0x1bc
2024-05-11T10:58:43.4810710Z github.com/tidwall/btree.(*BTreeG[go.shape.*uint8]).Scan()
2024-05-11T10:58:43.4811690Z /Users/runner/go/pkg/mod/github.com/tidwall/[email protected]/btreeg.go:351 +0xee
2024-05-11T10:58:43.4812480Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/logtail.(*dirtyCollector).cleanupStorage()
2024-05-11T10:58:43.4813290Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/logtail/collector.go:346 +0x5a
2024-05-11T10:58:43.4813930Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/logtail.(*dirtyCollector).Run()
2024-05-11T10:58:43.4814740Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/logtail/collector.go:182 +0x177
2024-05-11T10:58:43.4815340Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/db/test.TestDelete3.func1()
2024-05-11T10:58:43.4816130Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/db/test/db_test.go:3287 +0x39
2024-05-11T10:58:43.4816820Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/tasks/worker.(*lamdaHandle).OnExec()
2024-05-11T10:58:43.4817700Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/tasks/worker/heartbeater.go:32 +0x45
2024-05-11T10:58:43.4818460Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/tasks/worker.(*heartbeater).Start.func1()
2024-05-11T10:58:43.4819550Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/tasks/worker/heartbeater.go:76 +0x11d
2024-05-11T10:58:43.4819570Z
2024-05-11T10:58:43.4819880Z Previous write at 0x00c0038f6498 by goroutine 4374:
2024-05-11T10:58:43.4820860Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/tables/updates.(*ObjectMVCCHandle).GetOrCreateDeleteChain()
2024-05-11T10:58:43.4821690Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/tables/updates/mvcc.go:368 +0xb9
2024-05-11T10:58:43.4822370Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/tables.(*baseObject).RangeDelete()
2024-05-11T10:58:43.4823110Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/tables/base.go:761 +0x1d5
2024-05-11T10:58:43.4823740Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/tables.(*aobject).RangeDelete()
2024-05-11T10:58:43.4823970Z <autogenerated>:1 +0xb7
2024-05-11T10:58:43.4824670Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/txn/txnimpl.(*txnTable).RangeDelete()
2024-05-11T10:58:43.4825480Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/txn/txnimpl/table.go:812 +0xa09
2024-05-11T10:58:43.4826230Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/txn/txnimpl.(*txnDB).RangeDelete()
2024-05-11T10:58:43.4827040Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/txn/txnimpl/txndb.go:152 +0xe5
2024-05-11T10:58:43.4827740Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/txn/txnimpl.(*txnStore).RangeDelete()
2024-05-11T10:58:43.4828700Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/txn/txnimpl/store.go:322 +0xb0
2024-05-11T10:58:43.4829610Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/txn/txnimpl.(*txnRelation).DeleteByPhyAddrKeys.func1()
2024-05-11T10:58:43.4830460Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/txn/txnimpl/relation.go:279 +0x2c1
2024-05-11T10:58:43.4831350Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/containers.ForeachWindowFixed[go.shape.[24]uint8]()
2024-05-11T10:58:43.4832140Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/containers/utils.go:702 +0x3f5
2024-05-11T10:58:43.4832820Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/containers.ForeachVectorWindow()
2024-05-11T10:58:43.4833700Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/containers/utils.go:595 +0xd54
2024-05-11T10:58:43.4834550Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/txn/txnimpl.(*txnRelation).DeleteByPhyAddrKeys()
2024-05-11T10:58:43.4835410Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/txn/txnimpl/relation.go:272 +0x2a5
2024-05-11T10:58:43.4836120Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/db/testutil.(*TestEngine).DeleteAll()
2024-05-11T10:58:43.4836950Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/db/testutil/engine.go:246 +0x47d
2024-05-11T10:58:43.4837490Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/db/test.TestDelete3()
2024-05-11T10:58:43.4838440Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/db/test/db_test.go:3311 +0x5c6
2024-05-11T10:58:43.4838630Z testing.tRunner()
2024-05-11T10:58:43.4839340Z /Users/runner/hostedtoolcache/go/1.21.5/x64/src/testing/testing.go:1595 +0x261
2024-05-11T10:58:43.4839540Z testing.(*T).Run.func1()
2024-05-11T10:58:43.4840230Z /Users/runner/hostedtoolcache/go/1.21.5/x64/src/testing/testing.go:1648 +0x44
2024-05-11T10:58:43.4840240Z
2024-05-11T10:58:43.4840450Z Goroutine 4440 (running) created at:
2024-05-11T10:58:43.4841180Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/tasks/worker.(*heartbeater).Start()
2024-05-11T10:58:43.4842120Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/tasks/worker/heartbeater.go:67 +0x12d
2024-05-11T10:58:43.4842700Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/db/test.TestDelete3()
2024-05-11T10:58:43.4843530Z /Users/runner/work/matrixone/matrixone/pkg/vm/engine/tae/db/test/db_test.go:3290 +0x374
2024-05-11T10:58:43.4843720Z testing.tRunner()
2024-05-11T10:58:43.4844560Z /Users/runner/hostedtoolcache/go/1.21.5/x64/src/testing/testing.go:1595 +0x261
2024-05-11T10:58:43.4844790Z testing.(*T).Run.func1()
2024-05-11T10:58:43.4845470Z /Users/runner/hostedtoolcache/go/1.21.5/x64/src/testing/testing.go:1648 +0x44
2024-05-11T10:58:43.4845490Z
2024-05-11T10:58:43.4845710Z Goroutine 4374 (running) created at:
2024-05-11T10:58:43.4845900Z testing.(*T).Run()
2024-05-11T10:58:43.4846590Z /Users/runner/hostedtoolcache/go/1.21.5/x64/src/testing/testing.go:1648 +0x845
2024-05-11T10:58:43.4846810Z testing.runTests.func1()
2024-05-11T10:58:43.4847500Z /Users/runner/hostedtoolcache/go/1.21.5/x64/src/testing/testing.go:2054 +0x84
2024-05-11T10:58:43.4847690Z testing.tRunner()
2024-05-11T10:58:43.4848370Z /Users/runner/hostedtoolcache/go/1.21.5/x64/src/testing/testing.go:1595 +0x261
2024-05-11T10:58:43.4848570Z testing.runTests()
2024-05-11T10:58:43.4849380Z /Users/runner/hostedtoolcache/go/1.21.5/x64/src/testing/testing.go:2052 +0x8ad
2024-05-11T10:58:43.4849570Z testing.(*M).Run()
2024-05-11T10:58:43.4850290Z /Users/runner/hostedtoolcache/go/1.21.5/x64/src/testing/testing.go:1925 +0xcd7
2024-05-11T10:58:43.4850480Z main.main()
2024-05-11T10:58:43.4850730Z _testmain.go:399 +0x2bd
2024-05-11T10:58:43.4850880Z ==================
repro：https://github.com/matrixorigin/matrixone/actions/runs/9160264328/job/25182526327?pr=16253
2024-05-20T14:58:30.2448586Z ==================
2024-05-20T14:58:30.2448704Z WARNING: DATA RACE
2024-05-20T14:58:30.2448861Z Write at 0x00c0021552d0 by goroutine 4508:
2024-05-20T14:58:30.2449444Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/tables/updates.(*MVCCHandle).upgradeDeleteChainByTSLocked()
2024-05-20T14:58:30.2449976Z /home/runner/work/matrixone/matrixone/pkg/vm/engine/tae/tables/updates/mvcc.go:756 +0x4a4
2024-05-20T14:58:30.2450489Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/tables/updates.(*MVCCHandle).upgradeDeleteChain()
2024-05-20T14:58:30.2450990Z /home/runner/work/matrixone/matrixone/pkg/vm/engine/tae/tables/updates/mvcc.go:763 +0x4e
2024-05-20T14:58:30.2451554Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/tables/updates.(*ObjectMVCCHandle).UpgradeAllDeleteChain()
2024-05-20T14:58:30.2452132Z /home/runner/work/matrixone/matrixone/pkg/vm/engine/tae/tables/updates/mvcc.go:414 +0x185
2024-05-20T14:58:30.2452609Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/tables.(*baseObject).UpgradeAllDeleteChain()
2024-05-20T14:58:30.2453061Z /home/runner/work/matrixone/matrixone/pkg/vm/engine/tae/tables/base.go:133 +0xee
2024-05-20T14:58:30.2453505Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/tables.(*aobject).UpgradeAllDeleteChain()
2024-05-20T14:58:30.2453668Z <autogenerated>:1 +0x3e
2024-05-20T14:58:30.2454203Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/tables/txnentries.(*flushTableTailEntry).ApplyCommit()
2024-05-20T14:58:30.2454839Z /home/runner/work/matrixone/matrixone/pkg/vm/engine/tae/tables/txnentries/flushTableTail.go:295 +0x1ac
2024-05-20T14:58:30.2455256Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/txn/txnimpl.(*txnTable).ApplyCommit()
2024-05-20T14:58:30.2455821Z /home/runner/work/matrixone/matrixone/pkg/vm/engine/tae/txn/txnimpl/table.go:1499 +0x20d
2024-05-20T14:58:30.2456231Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/txn/txnimpl.(*txnDB).ApplyCommit()
2024-05-20T14:58:30.2456857Z /home/runner/work/matrixone/matrixone/pkg/vm/engine/tae/txn/txnimpl/txndb.go:429 +0x211
2024-05-20T14:58:30.2457276Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/txn/txnimpl.(*txnStore).ApplyCommit()
2024-05-20T14:58:30.2457765Z /home/runner/work/matrixone/matrixone/pkg/vm/engine/tae/txn/txnimpl/store.go:710 +0xe4
2024-05-20T14:58:30.2458155Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/txn/txnbase.(*Txn).ApplyCommit()
2024-05-20T14:58:30.2458636Z /home/runner/work/matrixone/matrixone/pkg/vm/engine/tae/txn/txnbase/txn.go:355 +0x103
2024-05-20T14:58:30.2459081Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/txn/txnbase.(*TxnManager).on1PCPrepared()
2024-05-20T14:58:30.2459571Z /home/runner/work/matrixone/matrixone/pkg/vm/engine/tae/txn/txnbase/txnmgr.go:398 +0x3a3
2024-05-20T14:58:30.2460089Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/txn/txnbase.(*TxnManager).dequeuePrepared.func1()
2024-05-20T14:58:30.2460654Z /home/runner/work/matrixone/matrixone/pkg/vm/engine/tae/txn/txnbase/txnmgr.go:571 +0xec
2024-05-20T14:58:30.2460873Z github.com/panjf2000/ants/v2.(*goWorker).run.func1()
2024-05-20T14:58:30.2461302Z /home/runner/go/pkg/mod/github.com/panjf2000/ants/[email protected]/worker.go:67 +0xe1
2024-05-20T14:58:30.2461310Z
2024-05-20T14:58:30.2461566Z Previous read at 0x00c0021552d0 by goroutine 4506:
2024-05-20T14:58:30.2462133Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/tables/updates.(*ObjectMVCCHandle).InMemoryDeletesExisted()
2024-05-20T14:58:30.2462639Z /home/runner/work/matrixone/matrixone/pkg/vm/engine/tae/tables/updates/mvcc.go:518 +0xd0
2024-05-20T14:58:30.2463127Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/catalog.(*ObjectEntry).InMemoryDeletesExisted()
2024-05-20T14:58:30.2463605Z /home/runner/work/matrixone/matrixone/pkg/vm/engine/tae/catalog/object.go:104 +0x92
2024-05-20T14:58:30.2464015Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/tables.(*aobject).estimateRawScore()
2024-05-20T14:58:30.2464466Z /home/runner/work/matrixone/matrixone/pkg/vm/engine/tae/tables/aobj.go:356 +0xc4
2024-05-20T14:58:30.2464873Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/tables.(*aobject).RunCalibration()
2024-05-20T14:58:30.2465313Z /home/runner/work/matrixone/matrixone/pkg/vm/engine/tae/tables/aobj.go:396 +0x26
2024-05-20T14:58:30.2465774Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/logtail.(*dirtyCollector).tryCompactTree()
2024-05-20T14:58:30.2466264Z /home/runner/work/matrixone/matrixone/pkg/vm/engine/tae/logtail/collector.go:435 +0xd8c
2024-05-20T14:58:30.2466761Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/logtail.(*dirtyCollector).cleanupStorage.func1()
2024-05-20T14:58:30.2467254Z /home/runner/work/matrixone/matrixone/pkg/vm/engine/tae/logtail/collector.go:355 +0x37d
2024-05-20T14:58:30.2467600Z github.com/tidwall/btree.(*BTreeG[go.shape.*uint8]).nodeScan()
2024-05-20T14:58:30.2468034Z /home/runner/go/pkg/mod/github.com/tidwall/[email protected]/btreeg.go:372 +0x28d
2024-05-20T14:58:30.2468282Z github.com/tidwall/btree.(*BTreeG[go.shape.*uint8]).scan()
2024-05-20T14:58:30.2468690Z /home/runner/go/pkg/mod/github.com/tidwall/[email protected]/btreeg.go:364 +0x1bc
2024-05-20T14:58:30.2468935Z github.com/tidwall/btree.(*BTreeG[go.shape.*uint8]).Scan()
2024-05-20T14:58:30.2469339Z /home/runner/go/pkg/mod/github.com/tidwall/[email protected]/btreeg.go:351 +0xee
2024-05-20T14:58:30.2469803Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/logtail.(*dirtyCollector).cleanupStorage()
2024-05-20T14:58:30.2470294Z /home/runner/work/matrixone/matrixone/pkg/vm/engine/tae/logtail/collector.go:346 +0x5a
2024-05-20T14:58:30.2470676Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/logtail.(*dirtyCollector).Run()
2024-05-20T14:58:30.2471242Z /home/runner/work/matrixone/matrixone/pkg/vm/engine/tae/logtail/collector.go:182 +0x177
2024-05-20T14:58:30.2471612Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/db/test.TestDelete3.func1()
2024-05-20T14:58:30.2472097Z /home/runner/work/matrixone/matrixone/pkg/vm/engine/tae/db/test/db_test.go:3406 +0x39
2024-05-20T14:58:30.2472511Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/tasks/worker.(*lamdaHandle).OnExec()
2024-05-20T14:58:30.2473052Z /home/runner/work/matrixone/matrixone/pkg/vm/engine/tae/tasks/worker/heartbeater.go:32 +0x45
2024-05-20T14:58:30.2473502Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/tasks/worker.(*heartbeater).Start.func1()
2024-05-20T14:58:30.2474079Z /home/runner/work/matrixone/matrixone/pkg/vm/engine/tae/tasks/worker/heartbeater.go:76 +0x11d
2024-05-20T14:58:30.2474086Z
2024-05-20T14:58:30.2474220Z Goroutine 4508 (running) created at:
2024-05-20T14:58:30.2474414Z github.com/panjf2000/ants/v2.(*goWorker).run()
2024-05-20T14:58:30.2474840Z /home/runner/go/pkg/mod/github.com/panjf2000/ants/[email protected]/worker.go:48 +0xb1
2024-05-20T14:58:30.2475099Z github.com/panjf2000/ants/v2.(*Pool).retrieveWorker.func1()
2024-05-20T14:58:30.2475602Z /home/runner/go/pkg/mod/github.com/panjf2000/ants/[email protected]/pool.go:337 +0xa7
2024-05-20T14:58:30.2475821Z github.com/panjf2000/ants/v2.(*Pool).retrieveWorker()
2024-05-20T14:58:30.2476246Z /home/runner/go/pkg/mod/github.com/panjf2000/ants/[email protected]/pool.go:348 +0x186
2024-05-20T14:58:30.2476484Z github.com/panjf2000/ants/v2.(*Pool).Submit()
2024-05-20T14:58:30.2476890Z /home/runner/go/pkg/mod/github.com/panjf2000/ants/[email protected]/pool.go:222 +0x47
2024-05-20T14:58:30.2477354Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/txn/txnbase.(*TxnManager).dequeuePrepared()
2024-05-20T14:58:30.2477846Z /home/runner/work/matrixone/matrixone/pkg/vm/engine/tae/txn/txnbase/txnmgr.go:560 +0x97
2024-05-20T14:58:30.2478415Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/txn/txnbase.(*TxnManager).dequeuePrepared-fm()
2024-05-20T14:58:30.2478574Z <autogenerated>:1 +0x51
2024-05-20T14:58:30.2478997Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/logstore/sm.(*safeQueue).Start.func1()
2024-05-20T14:58:30.2479491Z /home/runner/work/matrixone/matrixone/pkg/vm/engine/tae/logstore/sm/safeq.go:89 +0x395
2024-05-20T14:58:30.2479497Z
2024-05-20T14:58:30.2479630Z Goroutine 4506 (running) created at:
2024-05-20T14:58:30.2480039Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/tasks/worker.(*heartbeater).Start()
2024-05-20T14:58:30.2480588Z /home/runner/work/matrixone/matrixone/pkg/vm/engine/tae/tasks/worker/heartbeater.go:67 +0x12d
2024-05-20T14:58:30.2480922Z github.com/matrixorigin/matrixone/pkg/vm/engine/tae/db/test.TestDelete3()
2024-05-20T14:58:30.2481408Z /home/runner/work/matrixone/matrixone/pkg/vm/engine/tae/db/test/db_test.go:3409 +0x374
2024-05-20T14:58:30.2481525Z testing.tRunner()
2024-05-20T14:58:30.2481892Z /opt/hostedtoolcache/go/1.21.5/x64/src/testing/testing.go:1595 +0x261
2024-05-20T14:58:30.2482020Z testing.(*T).Run.func1()
2024-05-20T14:58:30.2482450Z /opt/hostedtoolcache/go/1.21.5/x64/src/testing/testing.go:1648 +0x44
2024-05-20T14:58:30.2482552Z ==================