bitsail
bitsail copied to clipboard
bytedance
BitSail is a distributed high-performance data integration engine which supports batch, streaming and incremental scenarios. BitSail is widely used to synchronize hundreds of trillions of data every d...
### Prepare a Pull Request - Title: [BitSail-143][Connector] Improve kudu split strategy - Fixes: #143 ### Motivation improve kudu split strategy add partition split strategy and predication split strategy ###...
https://github.com/bytedance/bitsail/issues/149 Signed-off-by: ## Pre-Checklist Note: Please complete **_ALL_** items in the following checklist. - [x] I have read through the [CONTRIBUTING.md](https://github.com/bytedance/bitsail/blob/master/docs/contributing.md) documentation. - [x] My code has the necessary comments...
## Is your feature request related to a problem? Please describe A clear and concise description of what the problem is. Example: I'm always frustrated when [...] ## Describe the...
### What happened kafka read 配置中"format_type": "json"，从Kafka消费json数据写入到hdfs过程中解析json失败。 ### What do you expect to happen _No response_ ### How to reproduce { "job": { "common": { "job_id": 333, "instance_id": 333, "job_name":...
### Prepare a Pull Request - Title: [BitSail-141][Connector] Support DDL sync in KuduWriter - Close : #141 ### Purpose add a generic interface to support schema change and support DDL...
Hi everyone. The new year is coming, Looking forward to working with you this year to build the BitSail community better and bring convenience to more data developers Here we...
### Description Currently HadoopInputformat only supports parsing data in json/csv/pb format, reads raw data through mapredInputFormat, constructs rows through rowBuilder We can continue to expand, such as supporting data reading...
### Description For `FtpConnector`, currently we can specify directories to read by setting configuration json file using option `path_list`, but it can't specify several files' path to read. Suggetion: 1....
### Description ``` public class NativeFlinkTypeInfoUtil { ... public static RowTypeInfo getRowTypeInformation(List columnInfos, TypeInfoConverter typeInfoConverter) { String[] fieldNames = new String[columnInfos.size()]; TypeInformation[] fieldTypes = new TypeInformation[columnInfos.size()]; for (int index =...
…rface Signed-off-by: ## Pre-Checklist Note: Please complete **_ALL_** items in the following checklist. - [x] I have read through the [CONTRIBUTING.md](https://github.com/bytedance/bitsail/blob/master/docs/contributing.md) documentation. - [x] My code has the necessary comments...
