Kevin Messiaen

Hello @ChatBear Yes this is still an active issue, I can assign you to it. We would be grateful to have your contribution, let me know if you have question...

Hello, The perturbation should be on categorical feature. It should only perturb on column of the dataset, the goal is to ensure that the model isn't too sensitive to noise....

@arm-diaz We added support to custom LLM and added integrated mistral. In order to integrate Bedrock we need create a class that implement `LLMClient`. Example can be seen with [mistral](https://github.com/Giskard-AI/giskard/blob/294982ccab00fe24c60d24ce2da49eafd0a580a2/giskard/llm/client/mistral.py)...

Hello @PAARTH2608 Unfortunately this issue require us to update the Giskard Hub that is closed source. Only updating the hash method for the Giskard Library client will produce authentication error...

Hello @marouanetalaa , yes we still need this implementation. It would be appreciated if you can contribute to this issue! I assigned you to it, let me know if you...

> Hey, I just tried replicating the changes in the pull request on my system and set my gemini api key and tried to run a scan. > > I...

> Hey, now I'm having this issue > > ``` > 2024-07-03 20:40:01,087 pid:11428 MainThread giskard.scanner.logger INFO Running detectors: ['LLMBasicSycophancyDetector', 'LLMCharsInjectionDetector', 'LLMHarmfulContentDetector', 'LLMImplausibleOutputDetector', 'LLMInformationDisclosureDetector', 'LLMOutputFormattingDetector', 'LLMPromptInjectionDetector', 'LLMStereotypesDetector', 'LLMFaithfulnessDetector'] > Running...

Hello, In this case it seems that you only set up the call to `https://api-url.com/v1/chatbot/request` for the model to be tested. However the scan will be calling `OpenAI`. The log...

Hello @abhibongale Yes the issue is still relevant, we would appreciate your contribution on this one! Basically in the `Scanner` (`giskard.scanner.scanner.py`) we run a bunch of evaluators depending of the...

Closed since we do not support the Hub anymore