Dustin Lange

Results 8 comments of Dustin Lange

Closing due to inactivity - please reopen if issues are remaining with the latest version.

Here's the interface and implementation for isNonNegative: https://github.com/awslabs/deequ/blob/db63229e83bf60da0f7cff323f081b2490578b38/src/main/scala/com/amazon/deequ/checks/Check.scala#L801 The check computes how many values are >= 0. The assertion function describes how you evaluate the resulting fraction of rows, e.g.,...

Thanks for submitting the change. Could you check if you can add a test case around here: https://github.com/awslabs/deequ/blob/32be67a4b4f9c02a139f7214f06621490ffd884d/src/test/scala/com/amazon/deequ/repository/AnalysisResultSerdeTest.scala#L64

Deequ does not support the definition of column importance. Deequ does support the definition of error levels, i.e., you can say your failed check is a warning or an error,...

Thanks for sharing the issue. We only support the Scala/Spark version of Deequ and cannot comment on other environments / language versions of Deequ.

Thanks for sharing the issue. My understanding is that Spark 3.2 is not yet released. We'll add support for Spark 3.2 when it is released.

Hi @tanvn Thanks for the great work on this issue! We merged the code with master. A new Deequ version [2.0.1-spark-3.2](https://mvnrepository.com/artifact/com.amazon.deequ/deequ/2.0.1-spark-3.2) is now available.