Langchain-Chatchat
Langchain-Chatchat copied to clipboard
问特定问题会出现爆显存
正常提问没问题。
结果问“你好啊”就会爆显存:
OutOfMemoryError: CUDA out of memory. Tried to allocate 4.46 GiB (GPU 0; 14.62 GiB total capacity; 12.42 GiB already allocated; 529.44 MiB free; 12.98 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF
完全不知道规律。
感觉可能是参考的TXT有特殊字符的原因。删减到1本txt好像就没事了。