Bourne issues

Repositories
Issues
Comments

Results 1 issues of


                                            Bourne

CPU buffer size issue

I used microsoft/bitnet-b1.58-2B-4T-gguf model Setup the environment： `python setup_env.py -md ./models/BitNet-b1.58-2B-4T/ -q i2_s` usage with: `python run_inference.py -m ./models/BitNet-b1.58-2B-4T/ggml-model-i2_s.gguf -p "You are a helpful assistant" -cnv -n 1024` and output...