DataX
DataX copied to clipboard
Bytehouse provide
- 对源代码的改动极小,只是在DataBaseType增加了bytehouse的支持,依旧采用JDBC协议
- bytehouse reader和writer的插件基本用的都是源代码中的公共类,没有复杂的自定义部分
- 新增了ArrayColumn 简单做了string化,不会影响其它插件
- 模板
{
"job": {
"setting": {
"speed": {
"channel": 2
}
},
"content": [
{
"reader": {
"name": "clickhousereader",
"parameter": {
"username": "gcods",
"password": "O95L987rhEc5b36zmdV9",
"where":"sdk_event_date>='2024-01-01' and sdk_event_date<'2024-01-02'",
"column": [
"sdk_event_hour",
"sdk_event_minute",
"sdk_event_date",
"event_ad_code_id"
],
"connection": [
{
"table": [
"table_name"
],
"jdbcUrl": [
"jdbc:clickhouse://1p:8123/test"
]
}
]
}
}
,
"writer": {
"name": "bytehousewriter",
"parameter": {
"username": "bytehouse",
"password": "aAUvBmMEoo:eeLDmfk9Mt",
"column": [
"sdk_event_hour",
"sdk_event_minute",
"sdk_event_date",
"event_ad_code_id"
],
"preSql": [
" "
],
"connection": [
{
"jdbcUrl": "jdbc:bytehouse://ip:19000?secure=true&database=test",
"table": [
"table_name"
]
}
]
}
}
}
]
}
}