not enough space in the context's memory pool (needed 827046512, available 805306368)

[wood911]

内存不足，有没有可以调整的参数

ggml_new_tensor_impl: not enough space in the context's memory pool (needed 827046512, available 805306368)
./run.sh: line 2:  6340 Segmentation fault: 11  ./main -m ./zh-models/alpaca-7b-ggml/ggml-model-q4_0.bin --color -f ./prompts/chat.txt -n 512

16G内存，运行 ggml-model-q8_0.bin 和 ggml-model-q4_0.bin 是同样错误，物理内存足够

[ymcui]

调小batch size试一下，-b参数

[Mabbs]

同样的错误，调小了一倍batch size好像没有用

[wood911]

同样的错误，调小了一倍batch size好像没有用

有用的，-b 8 甚至更小

[wood911]

./main -m ./zh-models/alpaca-7b-ggml/ggml-model-q8_0.bin --color -f ./prompts/alpaca.txt -ins -c 4096 --temp 0.25 -n 2048 --repeat_penalty 1.2 -b 16

内存不足试试调小 batch size，-b 参数

[github-actions[bot]]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your consideration.

[github-actions[bot]]

Closing the issue, since no updates observed. Feel free to re-open if you need any further assistance.