chatdocs icon indicating copy to clipboard operation
chatdocs copied to clipboard
verified publisher icon marella

Cant load big models across multiple gpu’s

Open pnylokken opened this issue 2 years ago • 0 comments

Is it possible to run models that require 48gb vram by combining two 24gb gpus? Ive tried playing around with the chatdocs.yml file to no avail.

pnylokken avatar Aug 26 '23 06:08 pnylokken