continuous-eval

continuous-eval copied to clipboard

Add SQL Metrics Implementation

2

# Add SQL Metrics Implementation This pull request introduces the `SQLSyntaxMatch` class, which is designed to evaluate the syntactic similarity between generated SQL queries and a set of ground truth...

yisz

_This change addresses [review comments](https://github.com/relari-ai/continuous-eval/pull/59#pullrequestreview-2061835523) left by [@yisz](https://github.com/yisz) on PR #59: **Add SQL Metrics Implementation**_ > :warning: We couldn't build/test your project to verify our changes. [Add a Dockerfile](https://docs.ellipsis.dev/build) to...

ellipsis-dev[bot]

Enhancement: Integration with LiteLLM

4

Issue: reduce the need for inference providers with continuous-eval. Advantage: Allow users to use multiple LLMs with fallbacks/caching without building the core infra.

rachittshah

yisz

yisz

yisz

yisz

Aggregate classification metrics

6

yisz

yisz

yisz