Erick Galinkin

Results 9 issues of Erick Galinkin

We need a way to instantiate generators in a way that: * Accepts a `device_map` for multi-gpu systems * Accepts a dtype (so we can load `torch.bfloat16`, for example)

bug
enhancement
generators

NIM updates have totally changed the way we interact with NVCF. Example code for correct interaction with NIMs: ``` from openai import OpenAI client = OpenAI( base_url = "https://integrate.api.nvidia.com/v1", api_key...

bug
generators

https://www.microsoft.com/en-us/security/blog/2024/06/26/mitigating-skeleton-key-a-new-type-of-generative-ai-jailbreak-technique/ Very simple probe

probes
new plugin

https://arxiv.org/abs/2401.06373

probes
new plugin

Adds support for audio probes using [the datasets I have somewhere] and multimodal NIM.

## Summary Some targets will have artificial limits on input length that are independent of the model (e.g. a web frontend that allows only _n_ characters/words of input) ### Motivation...

architecture
generators

## Summary Add support for JailbreakV: https://arxiv.org/abs/2404.03027 ### Motivation Improved support for multimodal models

probes

If a remote resource _e.g._ Huggingface model used in a detector cannot be reached, we should either fail gracefully or throw an error and offer a substitution. This will be...

bug

## Summary Detectors are sometimes skipped, but there are several reasons this can happen. We do not provide much direct information that helps people understand why the detector is skipped....

detectors
reporting
ux
quality-accuracy