giskard

giskard copied to clipboard

Add documentation for advanced scan usage: custom metrics and min slice size

2

luca-rossi

Implement a Gemini `LLMClient`

2

## 🚀 Feature Request Create a Gemini client that extends `LLMClient`. ## 🔈 Motivation This will allow to run the scan and tests using Gemini models ## 🛰 Alternatives N/A...

kevinmessiaen

### Issue Type Bug ### Source source ### Giskard Library Version 2.10.0 ### Giskard Hub Version N/A ### OS Platform and Distribution _No response_ ### Python version 3.11 ### Installed...

AshishGoelTR

Scan: Add a robustness detector to the scan that perturbs categorial values

7

## 🚀 Feature Request Add a robustness detector to the scan that perturbs categorial values. The scan should be able to a set of issues that capture the perturbations needed...

kevinmessiaen

## 🚀 Feature Request Add a robustness detector to the scan that perturbs numerical values. The scan should be able to a set of issues that capture the *minimum amount*...

kevinmessiaen

Scan: Overlapping slices should be grouped in the scan generated issues

2

## 🚀 Feature Request If a slice is completely contained into another slice, we should just report the biggest one. ## 🔈 Motivation It will makes the scan report more...

kevinmessiaen

[GSK-3513] Fix RAGAS metric computation

5

According to [this issue](https://github.com/Giskard-AI/giskard/issues/1924), some RAGAS metrics are not properly computed by RAGAS (this includes context recall, context precision and faithfulness). To fix it: - added a `retrieved_documents` argument to...

pierlj

## Checklist - [x] I've searched the project's [`issues`](https://github.com/Giskard-AI/giskard/issues?q=is%3Aissue). ## ❓ Question Is there any good example of how to use huggingface models and eventually perform giskard scan How can...

kbmlcoding

Update evaluate.py

2

## Description ## Related Issue ## Type of Change - [ ] 📚 Examples / docs / tutorials / dependencies update - [ ] 🔧 Bug fix (non-breaking change which...

natedem30

JSON report generation from scan results

2

## Description ## Related Issue ## Type of Change - [ ] 📚 Examples / docs / tutorials / dependencies update - [ ] 🔧 Bug fix (non-breaking change which...

bmalezieux