dbt-clickhouse
dbt-clickhouse copied to clipboard
Support dbt Fusion
dbt Fusion is still in its early days. Most of their content is still in beta and they still don't have an official way to implement the new version of the adapter for ClickHouse. As far as we know, we need at least these things:
- ADBC API: ClickHouse currently have it available but it's still in its early days and not ready for dbt workloads. Work is being done to improve it. dbt folks also are supposed to open source
XDBCwhich will be the alternative so we can use ODBC until ADBC is ready. It's still not open sourced. - ANTLR Grammars: dbt still need to tell us what exactly they need. We may be able to use this ANTLR already present in the CH repository here, but we need to validate if they can be fully used for this https://github.com/ClickHouse/ClickHouse/tree/master/utils/antlr
- Implement new Macros: We still need information about which macros we need to implement. Looks like dbt people is currently working on
dbt-jinjawhich is a Rust version of Python's Jinja. - Guides for the rest of operations: for example, we need to know the process to send the new adapter to dbt Labs so it can be signed by them https://github.com/dbt-labs/dbt-fusion/issues/46.
We have not releases dates for any of these topics yet, but we hope we could start working on them soon.
Sources:
- https://docs.getdbt.com/blog/dbt-fusion-engine-components