DataX icon indicating copy to clipboard operation
DataX copied to clipboard

Bytehouse provide

Open fish-gangan opened this issue 1 year ago • 0 comments

  1. 对源代码的改动极小,只是在DataBaseType增加了bytehouse的支持,依旧采用JDBC协议
  2. bytehouse reader和writer的插件基本用的都是源代码中的公共类,没有复杂的自定义部分
  3. 新增了ArrayColumn 简单做了string化,不会影响其它插件
  4. 模板
{
	"job": {
		"setting": {
			"speed": {
				"channel": 2
			}
		},
		"content": [
			{
				"reader": {
					"name": "clickhousereader",
					"parameter": {
						"username": "gcods",
						"password": "O95L987rhEc5b36zmdV9",
						"where":"sdk_event_date>='2024-01-01' and  sdk_event_date<'2024-01-02'",
						"column": [
							"sdk_event_hour",
							"sdk_event_minute",
							"sdk_event_date",
							"event_ad_code_id"
						],
						"connection": [
							{
								"table": [
									"table_name"
								],
								"jdbcUrl": [
									"jdbc:clickhouse://1p:8123/test"
								]
							}
						]
					}
				}
				,
				"writer": {
					"name": "bytehousewriter",
					"parameter": {
						"username": "bytehouse",
						"password": "aAUvBmMEoo:eeLDmfk9Mt",
						"column": [
								"sdk_event_hour",
								"sdk_event_minute",
								"sdk_event_date",
								"event_ad_code_id"
						],
						"preSql": [
							" "
						],
						"connection": [
							{
								"jdbcUrl": "jdbc:bytehouse://ip:19000?secure=true&database=test",
								"table": [
									"table_name"
								]
							}
						]
					}
				}
			}
		]
	}
}

fish-gangan avatar Nov 27 '24 10:11 fish-gangan