chunjun icon indicating copy to clipboard operation
chunjun copied to clipboard

达蒙数据同步到hdfs效率很低

Open wushangqiao1 opened this issue 1 year ago • 3 comments
trafficstars

Search before asking

  • [ ] I had searched in the issues and found no similar question.

  • [ ] I had googled my question but i didn't get any help.

  • [ ] I had read the documentation: ChunJun doc but it didn't help me.

Description

dm数据表有3kw数据量,同步到hdfs效率很低

Code of Conduct

wushangqiao1 avatar Aug 23 '24 02:08 wushangqiao1

看代码,mysql和dm都是用的jdbc connector, dm的怎么这么慢呢

wushangqiao1 avatar Aug 23 '24 03:08 wushangqiao1

dm数据表有3kw数据量,同步到hdfs效率很低

为啥不试试 dataX 这样的工具

baisui1981 avatar Oct 21 '24 09:10 baisui1981

为什么我添加达梦数据源显示 找不到对应source Type 已经把相关jar包放入flink lib里面了

hhyhgoboy avatar Dec 24 '24 10:12 hhyhgoboy

试试fetchSize等参数调优呢

yanghuaiGit avatar Nov 05 '25 01:11 yanghuaiGit