Erick Galinkin
Erick Galinkin
We need a way to instantiate generators in a way that: * Accepts a `device_map` for multi-gpu systems * Accepts a dtype (so we can load `torch.bfloat16`, for example)
NIM updates have totally changed the way we interact with NVCF. Example code for correct interaction with NIMs: ``` from openai import OpenAI client = OpenAI( base_url = "https://integrate.api.nvidia.com/v1", api_key...
https://www.microsoft.com/en-us/security/blog/2024/06/26/mitigating-skeleton-key-a-new-type-of-generative-ai-jailbreak-technique/ Very simple probe
Adds support for audio probes using [the datasets I have somewhere] and multimodal NIM.
## Summary Some targets will have artificial limits on input length that are independent of the model (e.g. a web frontend that allows only _n_ characters/words of input) ### Motivation...
## Summary Add support for JailbreakV: https://arxiv.org/abs/2404.03027 ### Motivation Improved support for multimodal models
If a remote resource _e.g._ Huggingface model used in a detector cannot be reached, we should either fail gracefully or throw an error and offer a substitution. This will be...
## Summary Detectors are sometimes skipped, but there are several reasons this can happen. We do not provide much direct information that helps people understand why the detector is skipped....