Neha Patki

**Version**: 0.8.0 (in developement) ### Problem Description Currently, we are applying the SDMetrics [NewRowSynthesis](https://docs.sdv.dev/sdmetrics/metrics/metrics-glossary/newrowsynthesis) by default in the `benchmark_single_table` script. The motivation was to capture whether new synthetic data is...

Better way to ignore columns when running a report

1

### Problem Description As described in #546, I may want to ignore certain columns in a dataset when running a report (quality or diagnostic). It is not completely intuitive how...

Make Binary Classification metrics more robust (`ValueError: Found unknown categories...`)

1

### Problem Description The [Binary Classification metrics](https://docs.sdv.dev/sdmetrics/metrics/metrics-in-beta/ml-efficacy-single-table/binary-classification), are designed to: 1. Train a binary classifier on the synthetic data, and then 2. Test the classifier on the real data The...

### Descriptions When we change around abstractions and reports, it may be the case that we accidentally change how a metric works without intending to. To pre-empt this, should we...

### Environment details * SDMetrics version: Dev Branch (for upcoming 0.11.0) ### Problem description Some datasets may not have many statistical columns*, so there may not be enough data for...

### Problem Description The detection metrics for [single table data](https://docs.sdv.dev/sdmetrics/metrics/metrics-in-beta/detection-single-table) and [sequential data](https://docs.sdv.dev/sdmetrics/metrics/metrics-in-beta/detection-sequential) both compute the `AUC (ROC)` and return `1-AUC` as the final score. The score is hard to...

### Problem Description Some metrics such as [StatisticSimilarity](https://docs.sdv.dev/sdmetrics/metrics/metrics-glossary/statisticsimilarity) are defined on a per-column level. If I want to apply it to several columns of several tables at once, I have...

### Problem Description Currently, the Single Table Detection Metrics are described in the documentation website: https://docs.sdv.dev/sdmetrics/metrics/metrics-in-beta/detection-single-table But there is no mention of the Parent Child Detection Metrics that are available...

_Filed from a conversation on the public, SDV Slack. This is a lower priority feature request._ ### Problem Description The [single table ML Efficacy metrics](https://docs.sdv.dev/sdmetrics/metrics/metrics-in-beta/ml-efficacy-single-table) make use of different ML...

### Problem Description When external users submit PRs, there is currently a CLA assistant bot that auto-responds asking them to sign an agreement. This CLA bot is **out-of-date**, as we...