giskard
giskard copied to clipboard
🐢 Open-Source Evaluation & Testing for LLMs and ML models
## Description Allow to generate guardrails from scan result ## Related Issue ## Type of Change - [ ] 📚 Examples / docs / tutorials / dependencies update - [...
This PR adds a NeMo Guardrails integration allowing to generate Colang rails from the Giskard scan report. Supports both Colang v1.0 and Colang v2.x.
### Issue Type Bug ### Source source ### Giskard Library Version 2.11.0 ### Giskard Hub Version 1.3.0 ### OS Platform and Distribution Linux 5.10.215-203.850.amzn2.x86_64 x86_64 ### Python version 3.10.14 ###...
## Description This PR removes all pieces of `legacy-hub` from `giskard` project ## Related Issue [GSK-3577 (available on Linear)](https://linear.app/giskard/issue/GSK-3577/refactor-giskard-lib-to-remove-giskardclient-and-mlworker-code) ## Type of Change - [x] 📚 Examples / docs /...
## Description ## Related Issue ## Type of Change - [ ] 📚 Examples / docs / tutorials / dependencies update - [ X] 🔧 Bug fix (non-breaking change which...
## Description Implement a Gemini LLMClient and test for it. ## Related Issue Implement a Gemini LLMClient #1901 ## Type of Change - [ ] 📚 Examples / docs /...
### Issue Type Bug ### Source source ### Giskard Library Version 2.14.0 ### Giskard Hub Version not using ### OS Platform and Distribution Ubuntu 22.04.4 LTS ### Python version Python...
## 🚀 Feature Request I suggest creating a new type of synthetic questions such that providing context and reference contexts, someone could ask "Which are the choices of that option?"...
## Checklist - [x] I've searched the project's [`issues`](https://github.com/Giskard-AI/giskard/issues?q=is%3Aissue). ## ❓ Question I am interested in making tutorials or examples on how to use Giskard, maybe technical articles as well....