dbt-clickhouse
dbt-clickhouse copied to clipboard
The Clickhouse plugin for dbt (data build tool)
We've just published the release cut of dbt-core 1.2.0, `dbt-core 1.2.0rc1` ([PyPI](https://pypi.org/project/dbt-core/1.2.0rc1/) | [GitHub release notes](https://github.com/dbt-labs/dbt-core/releases/tag/v1.2.0rc1)). https://github.com/dbt-labs/dbt-core/discussions/5468 is an open discussion with more detailed information, and https://github.com/dbt-labs/dbt-core/issues/5474 is for keeping...
Hi, Is it possible to set a column's Codec or other column settings? I'm especially looking into Codec for better compression, as data type changes such as LowCardinality can set...
Hi, I can't create incremental table with tuple unique_key. I prepared two reproducible examples: ``` {{ config(order_by='(id1, id2)', engine='MergeTree()', materialized='incremental', unique_key='(id1, id2)') }} select 1 as id1, 2 as id2...
Hi, We're using DBT and clickhouse. Trouble begins when using UNION ALL , which is a known clickhouse issue: https://github.com/ClickHouse/ClickHouse/issues/30532 As stated in the above it's a very common pattern...
macros union_relations for clickhouse
NOTE: lightly tested (though successfully). Need help from community. Made two materializations: distributed_table for distributed version of table models and distributed_incremental for incremental models. The main idea is to make...
Hi. We have urge to use distributed engine for our ELT process. I have some work done (very unstable, but somewhat tested) in my fork of your repo Still have...
Is there any plan to support [AggregatingMergeTree](https://clickhouse.tech/docs/en/engines/table-engines/mergetree-family/aggregatingmergetree/) for `table` and `incremental` models? The `AggregatingMergeTree` is already powerful and real-time so it would potentially be much more powerful than using using...
This turned out to be a fairly minor update. Some additional tests to match the recommended DBT test-adapter and some array macros for utils are the main changes. We don't...
In order to be used by other package like [dbt-codegen](https://github.com/dbt-labs/dbt-codegen), it would be nice to provide implementation using this adapters for some macros like `get_tables_by_pattern_sql`. Happy to help in implementation...