PyRIT icon indicating copy to clipboard operation
PyRIT copied to clipboard
verified publisher icon Azure

BUG GCG runs out of memory even on huge machines

Open romanlutz opened this issue 7 months ago • 0 comments

Describe the bug

We're getting out of memory issues even on massive machines that have enough memory for several instances of the target language model. We need to investigate why and remediate the problem.

Steps/Code to Reproduce

Run GCG with 1000 steps. Note that this requires someone with experience with pytorch and running LLMs on compute.

romanlutz avatar Jun 14 '25 04:06 romanlutz