ingestr icon indicating copy to clipboard operation
ingestr copied to clipboard

ClickHouse support

Open Slach opened this issue 1 year ago • 9 comments

It would be great if your tool will add support for ClickHouse

Slach avatar Feb 27 '24 16:02 Slach

pretty much just passes through to https://dlthub.com/ library so I guess it would need support in https://dlthub.com/docs/dlt-ecosystem/destinations/ first

ChrisMcKee avatar Feb 27 '24 16:02 ChrisMcKee

Kinda. While dlt destinations would be preferred, I could still add a Clickhouse custom destination without waiting on dlt having it, and then contribute it.

IIRC Clickhouse has a Postgres-compatible API, would that work in the meantime?

karakanb avatar Feb 27 '24 17:02 karakanb

IIRC Clickhouse has a Postgres-compatible API, would that work in the meantime?

Have not tried it, but should work according to the documentation:

https://clickhouse.com/docs/en/interfaces/postgresql

And clickhouse can work with a number of sources directly, see eg examples for clickhouse local: https://clickhouse.com/docs/en/operations/utilities/clickhouse-local

e12e avatar Feb 28 '24 01:02 e12e

Kinda. While dlt destinations would be preferred, I could still add a Clickhouse custom destination without waiting on dlt having it, and then contribute it.

IIRC Clickhouse has a Postgres-compatible API, would that work in the meantime?

There's an issue on dlt about using ast to cover a wide range including click house.

ChrisMcKee avatar Feb 29 '24 21:02 ChrisMcKee

ClickHouse support only MySQL/PostgreSQL protocol, but doesn't support MySQL/PostgreSQL SQL dialect.

Slach avatar Mar 01 '24 07:03 Slach

Fiy everyone we are working on it and now we also have custom destinations that enable you to easily add what you want

adrianbr avatar Apr 15 '24 07:04 adrianbr

@adrianbr great news

Slach avatar Apr 15 '24 07:04 Slach