CUDA out of memory

Open marvelmaster opened this issue 2 years ago • 2 comments

CUDA out of memory. Tried to allocate 86.00 MiB (GPU 0; 24.00 GiB total capacity; 22.99 GiB already allocated; 0 bytes free; 23.20 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF

Want to use 1xrtx3090 what can i do?

Mar 11 '23 03:03 marvelmaster

Please see issue #31

You need to delete some of the tools from self.tools

Mar 11 '23 03:03 powderblock

I already implement the Google Colab version and I only choose two models T2I and ImageCaption, everything is fine, you can try it on my Colab notebook, checkout this https://github.com/K-tang-mkv/visual-chatgpt-googlecolab

Mar 11 '23 06:03 K-tang-mkv