gravity

gravity copied to clipboard

带有唯一索引的表，在进行大批量数据事务的操作下，同步速率低

15

您好： 现在遇到一个问题，在带有多个字段的唯一索引的表，在进行大批量数据事务的操作下，无论的同步到tidb还是kafak,同步的速率低下， 如果把这个表在filter的配置里过滤掉，速率就会提升，下图在14:50之前是没过滤钱的速率，15:00后是过滤后的速率 

zhanjianS

job从全量切换到增量的时候,程序出现panic

1

zeusYi

Bumps [go.mongodb.org/mongo-driver](https://github.com/mongodb/mongo-go-driver) from 1.0.1 to 1.5.1. Release notes Sourced from go.mongodb.org/mongo-driver's releases. MongoDB Go Driver 1.5.1 The MongoDB Go driver team is pleased to release 1.5.1 of the official Go...

dependabot[bot]

Bumps [github.com/gogo/protobuf](https://github.com/gogo/protobuf) from 1.2.0 to 1.3.2. Release notes Sourced from github.com/gogo/protobuf's releases. Release v.1.3.2 Tested versions: go 1.15.6 protoc 3.14.0 Bug fixes: skippy peanut butter Release v1.3.1 Tested versions: go...

dependabot[bot]

decimal data type(#313)

1

x-ainger

decimal 数据类型精度丢失

1

mysqlbatch:  将 decimal 格式的数据，转换为 golang float64 类型，会导致精度丢失 此处可采用 "github.com/shopspring/decimal" decimal.Decimal{} mysqlstream: 设置 go-mysql sync 参数：UseDecimal: true

x-ainger

Outbox pattern

5

I need to implement an __outbox pattern__ using gravity. I need to capture the `create` operation on the `outbox` collection of our MongoDB database and send it as output to...

mehran-prs

For mysql, even in RC isolation level, perform replace on table with unique index has a big chance to generate dead lock. We have to support update sql engine in...

Ryan-Git

mysql数据接收到kafka topic的时候,ddl语句都被过滤掉了，不会存储到topic中.

5

[output] type = "async-kafka" # # 目标端编码规则：输出类型和版本号 # - 可选 [output.config] # 默认为 json output-format = "json" #enable-ddl = true # 默认为 0.1 版本 schema-version = "0.1" [output.config.kafka-global-config] broker-addrs =...

Douglas-gwj

MySQL2TiDB better support gh-ost

2

TiDB supports online schema change natively while MySQL often leverages tools like gh-ost. For task syncing from MySQL to TiDB, we'd better come up with a solution. @xialuo1990 could you...

Ryan-Git