kbmlcoding

Does this means we wont be able to run garak for any model that does not fit one single gpu until multi-gpu feature from this pull request is merged to...

Awesome .. that is great @leondz ..where can i find the instructions to build garak locally on either mac/linux system if i were to make hardcoded change you suggested Assuming...

i was able to reproduce it on centos7, main branch as of 5th jun 2024 with below gpu's: +-----------------------------------------------------------------------------------------+ | NVIDIA-SMI 550.54.15 Driver Version: 550.54.15 CUDA Version: 12.4 | |-----------------------------------------+------------------------+----------------------+...

@leondz Yes, i could see gpu's being used when i ran..i even tried to reset the device.. i have not yet re-ran again after #711 has merged to main. will...