Request for support of 8gb vram system with 16 gb ram

Open Archit01 opened this issue 1 year ago • 2 comments

Is there a way to make it work on 8gb vram system with 16 gb ram. I have rtx 2060 super 8gb vram and 16 gb system memory.

Mar 05 '24 10:03 Archit01

Currently, it is difficult to run with this requirement. We will publish the Online Demo as soon as possible.

Mar 07 '24 06:03 Fanghua-Yu

If you have SSD, and you are in linux, create a swapfile that is more than 32GB. The more the better as the models will be loaded in VRAM, if not enough will try to load in RAM, if not enough it will load in SWAP space.

Apr 15 '24 17:04 sundayglee