airflow-dbt-python
airflow-dbt-python copied to clipboard
A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.
Just fixed typo and formatted the example code using [black](https://github.com/psf/black)
Currently, `airflow-dbt-python` supports pushing artifacts to XCOM. However, we do not offer pulling artifacts from XCOM. This would be particularly useful for stateful runs, like when using the `source_status:fresher+` selector...
Not quite an interface as it's not defined in `BaseHook`, but most Apache Airflow providers define proper connection types for each of their hooks. This may be a chance to...
The dbt loggers are producing multiple lines of output that are essentially the same, but one of them is the debug output. This is caused by both the file logger...
I cannot run my dbt project using a Snowflake Connection. It is okay with the connection, I tested it using [astronomer-cosmos](https://github.com/astronomer/astronomer-cosmos) When I run the using [this code](https://github.com/tomasfarias/airflow-dbt-python/blob/master/examples/airflow_connection_target_dag.py) as an...
Implements #90 This change allows users to push select dbt artifacts using a remote
We are using airflow-dbt-python to orchestrate dbt commands and running Airflow in mwaa. Version used: Amazon MWAA=2.5.1 airflow-dbt-python=0.13.2 dbt-core=1.3.4 However this is throwing below error. [2023-07-27, 17:34:28 UTC] {{taskinstance.py:1768}} ERROR...
Hi guys, Unlike the S3 or local file which we specify difference of Path corresponding to deployment environments, Git remote split them into difference branches, example, the `main` branch is...
Hello, this relates to the discussion I created I am unable to use `DbtRunOperator` with a private ssh git repo, and while I am unsure if my syntax is correct,...
I am trying to use GitLab DBT project repo using DbtGitRemoteHook ``` dbt_run = DbtRunOperator( task_id="dbt_run", project_dir="https://domain/abc/-/tree/main/dbt/db_metrics?private_token=abcdesf", dbt_conn_id="dbt_conn_id", target="dev", do_xcom_push_artifacts=["run_results.json"], ) ``` ``` raise MaxRetryError(_pool, url, error or ResponseError(cause)) urllib3.exceptions.MaxRetryError:...