dolphinscheduler icon indicating copy to clipboard operation
dolphinscheduler copied to clipboard

[Improvement][datax] Support DataX parameter `batchSize` for writer

Open bromine0x23 opened this issue 3 months ago • 2 comments

Search before asking

  • [X] I had searched in the issues and found no similar feature requirement.

Description

Currently DataX task does not support writer parameter batchSize, therefore only the default values can be used, which is 2048.

However this default value is too small for some databases, such as the ClickHouse I'm using. The example value in DataX is 65536.

So I need the support of batchSize parameter.

Are you willing to submit a PR?

  • [ ] Yes I am willing to submit a PR!

Code of Conduct

bromine0x23 avatar Oct 31 '24 03:10 bromine0x23