quinn
quinn copied to clipboard
Extend Quinn's Data Validation functionality
Add to Quinn a tool to profile incoming data, check if it adheres to registered schema and do custom data quality checks. At the end of it, a human readable report is autogenerated that can be saved separately.
- Config driven data profiling and schema validation
- Autogeneration of report after every run
- Integration with datadog monitoring system
- Extensible and highly customizable.
- Very little boiler plate code.
- Support for versioned schema validation.
@MrPowers I will be working on this. Can we get this assigned to me please. Thanks.
Have at it @souvik-databricks !