Langchain-Chatchat icon indicating copy to clipboard operation
Langchain-Chatchat copied to clipboard

问特定问题会出现爆显存

Open Yamol opened this issue 1 year ago • 1 comments

正常提问没问题。 结果问“你好啊”就会爆显存: OutOfMemoryError: CUDA out of memory. Tried to allocate 4.46 GiB (GPU 0; 14.62 GiB total capacity; 12.42 GiB already allocated; 529.44 MiB free; 12.98 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF

完全不知道规律。

Yamol avatar Apr 17 '23 09:04 Yamol

感觉可能是参考的TXT有特殊字符的原因。删减到1本txt好像就没事了。

Yamol avatar Apr 18 '23 01:04 Yamol