Anna Sokol

device-side assert triggered when trying to use LLaMA 3.2 Vision with grammar

2

### System Info Version: `text-generation-launcher 2.4.0` Environment: ``` Target: x86_64-unknown-linux-gnu Cargo version: 1.80.1 Commit sha: 0a655a0ab5db15f08e45d8c535e263044b944190 Docker label: sha-0a655a0 ``` Hardware: 4 x A100 ``` +-----------------------------------------------------------------------------------------+ | NVIDIA-SMI 550.78 Driver...