giskard
giskard copied to clipboard
🐢 Open-Source Evaluation & Testing for LLMs and ML models
## Description There exists an env var called `GSK_API_KEY` used to [auto-provide the API key](https://github.com/Giskard-AI/giskard/blob/6f9bc5f9008f9688a5f894ad498d4f1ec45bf265/giskard/commands/cli_worker.py#L71) in the giskard worker CLI. It makes sense to reuse the name here. We may...
## Description ## Related Issue ## Type of Change - [ ] 📚 Examples / docs / tutorials / dependencies update - [ ] 🔧 Bug fix (non-breaking change which...
- Add the possibility to store metadata for each question in the `QATestset`. - Move difficulty as metadata. - Add possibility to split a test suite into several test based...
Main branch for multiple ml workers (not yet to be merged) ## Description ## Related Issue ## Type of Change - [ ] 📚 Examples / docs / tutorials /...
Supersedes: https://github.com/Giskard-AI/giskard/pull/1549 Since the scan is our main API, it is very important to make it's output as readable as possible. For this, a set of templates and colors are...
to support Optional type 3\.10 is the default version of Colab From [SyncLinear.com](https://synclinear.com) | [GSK-1639](https://linear.app/giskard/issue/GSK-1639/set-minimum-python-version-to-310)
## Checklist - [x] I've searched the project's [`issues`](https://github.com/Giskard-AI/giskard/issues?q=is%3Aissue). ## ❓ Question As in title, is it possible to use Giskard for computer vision, i.e. image datases? I am using...
## Description ## Related Issue ## Type of Change - [ ] 📚 Examples / docs / tutorials / dependencies update - [ ] 🔧 Bug fix (non-breaking change which...
The change involves replacing the existing code `hashlib.md5(string.encode()).hexdigest()` with the more robust `hashlib.sha256(string.encode()).hexdigest()`. This adjustment enhances resistance against potential security threats and aligns with best practices for cryptographic hash functions.
## 🚀 Feature Request Users interested in running Giskard with Amazon Bedrock ## 🔈 Motivation Integrating Giskard with Amazon Bedrock would allow users to evaluate and provide more visibility on...