great_expectations

great_expectations copied to clipboard

pyspark.sql.utils.AnalysisException: "Table or view not found: when creating an expectations suite

2

**Describe the bug** Hive metastore is not found, and so the hive table is not found. **To Reproduce** When running ``` great_expectations suite scaffold ge_demo_tbl.warning ``` I always get `pyspark.sql.utils.AnalysisException:...

jpoullet2000

GCS Data Docs lost previous testing result. It's newly created whenever testing are started.

19

**Describe the bug** Data Docs are created in the Google Cloud Storage (bucket). The Data Docs get overwritten each time a new test is executed via Cronjob. i.e. the output...

gabwon9

Unknown datatypes INT and Varchar when creating expectation suites or checkpoints accessing Teradata tables

4

**Describe the bug** A clear and concise description of what the bug is. **To Reproduce** Steps to reproduce the behavior: 1. Create a datasource accessing a Teradata DB 2. Create...

dsehnbru

SimpleCheckpoint RepresenterError: cannot represent an object with BigQuery

3

**Describe the bug** After getting BatchRequest and ExpectationSuite, I tried to programmatically create a `SimpleCheckpoint`, then persistent it to config file. There was an error when convert Checkpoint to YAML...

xudong-sph

Ability to compare two column's values at a granular level (expect_column_values_to_match_set, with Evaluation Parameter functionality)

9

**Is your feature request related to a problem? Please describe.** I really need to be able to do a 1 to 1 comparison on my batch/sample of data against another...

nateGarcia

Storing Validation Result to PostgreSQL

5

**Describe the bug** Issue related to storing Validation Result to PostgreSQL. I cannot create ge_validations_store tabel in the schema that I want. **To Reproduce** Follow the steps here: https://docs.greatexpectations.io/docs/guides/setup/configuring_metadata_stores/how_to_configure_a_validation_result_store_to_postgresql/ Everything...

AlexNae

unexpected_rows returned None or errored out for BigQuery Datasource.

5

**Describe the bug** When checkpoint ran with request_format COMPLETE with include_unexpected_rows e.g. result_format={'result_format': 'COMPLETE', 'partial_unexpected_count': 20, 'include_unexpected_rows': True} It returns either Error or None. **To Reproduce** For expectation_type = expect_column_values_to_not_be_null,...

vikramshinde12

Wrong casting for TIMESTAMP column type with BigQuery table

5

**Describe the bug** Generation of expectations using historic data does not for column type TIMESTAMP using BigQuery as source. In BigQuery there is 2 types for date: - DATETIME -...

PaulineBeurier8

Run checkpoint is not throwing an error when expected.

3

Description: When running a checkpoint within the V3 API, first I need to validate table metadata, and I only want to proceed to column validations if all the table validation...

jeduardo90

Documentation guide on how great_expectations could be used with Azure ML service

2

**Reference** [Avanade team using great_expectations in Azure Machine Learning pipeline for data expectation tests](https://greatexpectations.io/case-studies/avanade-case-study/) My team is also implementing an ML solution using Azure Machine Learning pipeline. I would like...

Li0425