airflow-provider-great-expectations

airflow-provider-great-expectations copied to clipboard

SQL Alchemy dependencies issue

4

Hi, We have a dependency conflict when using the provider package. Starting from Airflow 2.3.3, the Airflow [constraints](https://raw.githubusercontent.com/apache/airflow/constraints-2.3.3/constraints-3.7.txt) file requires Sql Alchemy **1.4.27** while the great expectations [provider](https://github.com/great-expectations/airflow-provider-great-expectations/blob/main/setup.py#L21) requires a...

itaise

Airflow deployment - Using GreatExpectationsOperator: `great_expectations.data_context.store` does not contain the class: `ProfilerStore`

1

Hi Guys, currently i have an Error when I want to use the official Airflow Operator for Great Expectations. My packages: airflow-provider-great-expectations==0.1.4 great-expectations==0.15.17 apache-airflow=2.1.4 ...

VisualDad

Error running GreatExpectationsOperator

5

**Describe the bug** When running a great_expectation suite on Google Cloud Composer using BigQuery as a datasource, I'm getting the follwing error: ``` [2021-07-23 17:40:24,866] {xcom.py:237} ERROR - Could not...

henriqueribeiro

GE version : 0.15.0, 0.15.1 I am calling the GreatExpectationsOperator from one of my airflow dags, where I am passing a checkpoint, which has runtime configuration as below : _runtime_configuration:...

Grudra1

Add operator extra link for Data Docs in the `GreatExpectationsOperator`

2

In Airflow, there is a feature which allows for external links to be present as buttons on the Task Instance modal in the Airflow UI called an [operator extra link](https://airflow.apache.org/docs/apache-airflow/stable/howto/define_extra_link.html)....

josh-fell

### Overview `GreatExpectationsOperator` fails when run validations agains `Athena` and work correct against `Redshift` ### Conditions `docker-compose` airflow airflow==2.2.3 airflow-provider-great-expectations==0.1.3 great-expectations==0.14.7 ### Procedure - Created a DAG that run validations...

guidoturtu

Hello team, I’m receiving the below error when I try to use GreatExpectationsBigQueryOperator ``` [2021-05-20 00:23:39,025] {validation_operators.py:405} ERROR - Error running action with name update_data_docs Traceback (most recent call last)...

marktanios7

Remove request to database from init method

5

The [GreatExpecatationsBigQueryOperator](https://github.com/great-expectations/airflow-provider-great-expectations/blob/main/great_expectations_provider/operators/great_expectations_bigquery.py) makes a `get_connection` request in the `init` method of the class. This is problematic for a few reasons: - It causes a fatal DAG import error if the...

petedejoy

TypeError: can't pickle _thread.lock objects when cleaning

7

This is most likely an issue with airflow itself (we use 1.10.9), but we didn't have any similar issue with it before - on clearing GE operator, whole system goes...

Casyfill

Remove `apply_defaults` from `GreatExpectationsBigQueryOperator` (or remove explicit kwargs)

1

So `apply_defaults` throws an error if any args or kwargs which are explicitly mentioned in the function signature are empty (i.e. `None`). Since `GreatExpectationsBigQueryOperator` names `expectation_suite_name` as an positional arg...

Milchdealer