tiflow icon indicating copy to clipboard operation
tiflow copied to clipboard

consumer oom when progress big message

Open Lily2025 opened this issue 8 months ago • 3 comments

What did you do?

1、create changefeed 2、run cdc boundary workload which exist big message /workload --database-host=tc-tidb.endless-ha-test-ticdc-simple-protocol-tps-7545174-1-679 --database-port=4000 --database-db-name=cdc_boundary --database-user=root --workload-type=large_row --tps=1000 --row-count=10000000 --table-count=16 --large-row-size=1048576 --large-ratio=0.010000 --thread=16 -skip-create-table 3、consumer oom (the memory of consumer is 32GB)

What did you expect to see?

no oom

What did you see instead?

consumer oom when progress big message

Versions of the cluster

[2024/06/15 17:36:27.810 +08:00] [INFO] [version.go:47] ["Welcome to kafka consumer"] [release-version=v8.2.0-master] [git-hash=854a4abb24eb486ad026a6b95a0215a05224f8ed] [git-branch=HEAD] [utc-build-time="2024-06-11 06:45:38"] [go-version="go version go1.21.11 linux/amd64"] [failpoint-build=false] [2024/06/15 17:36:27.812 +08:00] [INFO] [tz.go:35] ["Use the timezone of the TiCDC server machine"] [timezoneName=System] [timezone=Asia/Shanghai]

current status of DM cluster (execute query-status <task-name> in dmctl)

No response

Lily2025 avatar Jun 17 '24 06:06 Lily2025